-- Logs begin at Thu 2022-07-14 14:50:11 UTC, end at Thu 2022-07-14 15:54:02 UTC. -- Jul 14 15:22:17.869661 dv-cinder-826510-8-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 14 15:22:17.878433 dv-cinder-826510-8-smb devstack@keystone.service[80334]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 14 15:22:17.881301 dv-cinder-826510-8-smb devstack@keystone.service[80334]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 14 15:22:17 2022] *** Jul 14 15:22:17.881301 dv-cinder-826510-8-smb devstack@keystone.service[80334]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 14 15:22:17.881301 dv-cinder-826510-8-smb devstack@keystone.service[80334]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 14 15:22:17.881301 dv-cinder-826510-8-smb devstack@keystone.service[80334]: nodename: dv-cinder-826510-8-smb Jul 14 15:22:17.881301 dv-cinder-826510-8-smb devstack@keystone.service[80334]: machine: x86_64 Jul 14 15:22:17.881301 dv-cinder-826510-8-smb devstack@keystone.service[80334]: clock source: unix Jul 14 15:22:17.881301 dv-cinder-826510-8-smb devstack@keystone.service[80334]: pcre jit disabled Jul 14 15:22:17.881301 dv-cinder-826510-8-smb devstack@keystone.service[80334]: detected number of CPU cores: 4 Jul 14 15:22:17.881301 dv-cinder-826510-8-smb devstack@keystone.service[80334]: current working directory: / Jul 14 15:22:17.881301 dv-cinder-826510-8-smb devstack@keystone.service[80334]: detected binary path: /usr/bin/uwsgi-core Jul 14 15:22:17.881301 dv-cinder-826510-8-smb devstack@keystone.service[80334]: your processes number limit is 47680 Jul 14 15:22:17.881301 dv-cinder-826510-8-smb devstack@keystone.service[80334]: your memory page size is 4096 bytes Jul 14 15:22:17.881301 dv-cinder-826510-8-smb devstack@keystone.service[80334]: detected max file descriptor number: 2048 Jul 14 15:22:17.881301 dv-cinder-826510-8-smb devstack@keystone.service[80334]: lock engine: pthread robust mutexes Jul 14 15:22:17.882078 dv-cinder-826510-8-smb devstack@keystone.service[80334]: thunder lock: enabled Jul 14 15:22:17.882078 dv-cinder-826510-8-smb devstack@keystone.service[80334]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 14 15:22:17.882078 dv-cinder-826510-8-smb devstack@keystone.service[80334]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 14 15:22:17.924875 dv-cinder-826510-8-smb devstack@keystone.service[80334]: Python main interpreter initialized at 0x556152efd9c0 Jul 14 15:22:17.924875 dv-cinder-826510-8-smb devstack@keystone.service[80334]: python threads support enabled Jul 14 15:22:17.924875 dv-cinder-826510-8-smb devstack@keystone.service[80334]: your server socket listen backlog is limited to 100 connections Jul 14 15:22:17.924875 dv-cinder-826510-8-smb devstack@keystone.service[80334]: your mercy for graceful operations on workers is 90 seconds Jul 14 15:22:17.925215 dv-cinder-826510-8-smb devstack@keystone.service[80334]: mapped 403077 bytes (393 KB) for 2 cores Jul 14 15:22:17.925334 dv-cinder-826510-8-smb devstack@keystone.service[80334]: *** Operational MODE: preforking *** Jul 14 15:22:17.925574 dv-cinder-826510-8-smb devstack@keystone.service[80334]: *** uWSGI is running in multiple interpreter mode *** Jul 14 15:22:17.925574 dv-cinder-826510-8-smb devstack@keystone.service[80334]: spawned uWSGI master process (pid: 80334) Jul 14 15:22:17.925776 dv-cinder-826510-8-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 14 15:22:17.928475 dv-cinder-826510-8-smb devstack@keystone.service[80334]: spawned uWSGI worker 1 (pid: 80344, cores: 1) Jul 14 15:22:17.928475 dv-cinder-826510-8-smb devstack@keystone.service[80334]: spawned uWSGI worker 2 (pid: 80345, cores: 1) Jul 14 15:22:17.928475 dv-cinder-826510-8-smb devstack@keystone.service[80334]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 14 15:22:23.337559 dv-cinder-826510-8-smb devstack@keystone.service[80344]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 15:22:23.337559 dv-cinder-826510-8-smb devstack@keystone.service[80344]: from cryptography.utils import int_from_bytes Jul 14 15:22:23.338391 dv-cinder-826510-8-smb devstack@keystone.service[80344]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 15:22:23.338391 dv-cinder-826510-8-smb devstack@keystone.service[80344]: from cryptography.utils import int_from_bytes Jul 14 15:22:23.338506 dv-cinder-826510-8-smb devstack@keystone.service[80345]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 15:22:23.338506 dv-cinder-826510-8-smb devstack@keystone.service[80345]: from cryptography.utils import int_from_bytes Jul 14 15:22:23.338506 dv-cinder-826510-8-smb devstack@keystone.service[80345]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 15:22:23.338506 dv-cinder-826510-8-smb devstack@keystone.service[80345]: from cryptography.utils import int_from_bytes Jul 14 15:22:23.386577 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 14 15:22:23.386772 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 14 15:22:23.386943 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] command line args: [] {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 14 15:22:23.387048 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 14 15:22:23.387210 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 14 15:22:23.387292 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 14 15:22:23.387376 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] ================================================================================ {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 14 15:22:23.387456 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] command line args: [] {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 14 15:22:23.387618 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] admin_token = **** {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:23.387699 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 14 15:22:23.387821 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] ================================================================================ {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 14 15:22:23.387900 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] config_dir = [] {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:23.388030 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:23.388116 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] admin_token = **** {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:23.388217 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] config_source = [] {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:23.388296 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] config_dir = [] {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:23.388394 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] debug = True {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:23.388485 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:23.388590 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:23.388841 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] config_source = [] {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:23.388841 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] debug = True {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:23.388954 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:23.389021 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:23.389108 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:23.389264 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:23.389349 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:23.389416 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:23.389598 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:23.389678 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:23.389825 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] list_limit = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:23.389913 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:23.390006 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] log_config_append = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:23.390124 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] list_limit = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:23.390212 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:23.390324 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] log_config_append = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:23.390403 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] log_dir = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:23.390468 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:23.390526 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] log_file = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:23.390635 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] log_dir = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:23.390718 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:23.390819 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] log_file = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:23.390964 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:23.391054 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:23.391210 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:23.391302 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:23.391453 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:23.391542 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:23.391613 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:23.391753 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:23.391835 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:23.391963 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:23.392045 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:23.392124 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:23.392242 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:23.392317 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:23.392460 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:23.392550 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:23.392688 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:23.392773 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:23.392918 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:23.393003 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:23.393146 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:23.393232 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:23.393388 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:23.393477 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:23.393631 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:23.393708 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:23.393900 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:23.394070 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:23.394208 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:23.394407 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.118/identity {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:23.394586 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] publish_errors = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:23.394814 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:23.395044 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:23.395220 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:23.395330 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.118/identity {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:23.395434 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] publish_errors = False {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:23.395537 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:23.396204 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:23.396322 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:23.396448 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:23.396547 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] standard_threads = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:23.396630 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:23.396866 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:23.396944 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:23.397105 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:23.397212 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:23.397359 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] standard_threads = False {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:23.397457 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:23.397559 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] use_journal = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:23.397660 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:23.397776 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] use_json = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:23.397851 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:23.397930 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] use_stderr = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:23.398024 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:23.398107 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] use_syslog = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:23.398186 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] use_journal = False {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:23.398258 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:23.398339 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] use_json = False {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:23.398478 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] use_stderr = False {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:23.398563 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.398641 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] use_syslog = False {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:23.398736 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.398873 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:23.398996 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.399130 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.399236 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.399371 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.399483 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.399632 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.399722 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.399872 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.399951 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.400123 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.400201 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.400364 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.400451 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.400614 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.400693 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.400853 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.400932 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.401102 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.401191 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.401349 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.401428 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.401585 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.401663 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.401822 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.401907 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.402088 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.402216 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.402326 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.402458 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.402581 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.402743 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.402820 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.402950 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.403066 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.403192 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.403300 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.403453 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.403554 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.403710 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.403815 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.403959 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.404067 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.404199 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.404315 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.404458 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.404536 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.404722 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.404802 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.404975 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.405053 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.405208 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.405288 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.405448 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.405531 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.405681 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.405766 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.405907 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.406031 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.406161 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.406250 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.406407 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.406486 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.406653 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.406738 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.406884 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.406973 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.407115 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.407199 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.407346 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.407424 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.407580 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.407665 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.407812 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.407891 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.408040 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.408118 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.408266 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.408420 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.408495 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.408565 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.408709 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.408787 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.408943 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.409029 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.409178 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.409261 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.409405 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.409482 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.409634 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.409723 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.409863 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.409989 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.410116 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.410192 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.410341 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.410437 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.410583 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.410666 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.410809 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.410892 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.411043 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.411130 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.411312 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.412051 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.412129 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.412241 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.412374 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.412483 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.412585 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.412682 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.412785 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.412882 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.412977 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.413079 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.413175 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.413271 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.413409 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.413490 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.413639 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.413737 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.413894 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.413993 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.414153 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.414236 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.414383 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.414462 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.414618 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.414747 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.414852 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.414944 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.415107 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.415186 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.415342 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.415430 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.415579 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.415660 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.415818 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.415907 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.416050 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.416138 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.416284 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.416364 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.416517 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.416599 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.416793 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.416914 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.417034 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.417120 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.417270 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.417349 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.417508 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.417588 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.417779 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.417859 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.418039 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.418125 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.418277 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.418360 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.418512 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.418592 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.418748 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.418827 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.419009 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.419096 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.419249 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.419330 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.419489 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.419569 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.419726 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.419806 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.419971 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.420050 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.420208 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.420288 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.420435 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.420512 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.420667 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.420747 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.420896 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.420975 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.421126 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.421215 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.421355 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.421436 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.421590 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.421668 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.421818 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.421896 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.422072 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.422154 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.422306 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.422385 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.422542 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.422620 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.422776 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.422858 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.423019 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.423098 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.423258 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.423347 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.423502 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.423581 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.423731 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] auth.external = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.423810 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.423960 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.424038 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.424234 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.424314 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.424471 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.424548 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.424701 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] auth.password = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.424811 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] auth.external = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.424930 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] auth.token = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.425011 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.425166 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.425259 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.425403 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.425541 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.425633 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.425717 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] auth.password = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.425866 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.425938 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] auth.token = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.426132 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.426204 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.426375 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.426467 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.426603 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.426672 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.426836 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] credential.caching = True {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.426922 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.427120 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.427207 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.427366 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.427440 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.427597 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.427681 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.427835 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.427922 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] credential.caching = True {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.428075 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.428156 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.428308 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.428385 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.428559 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.428662 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.428799 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.428879 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.429034 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.429113 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.429269 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.429355 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.429538 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.429618 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.429784 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.429862 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.430044 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.430169 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.430302 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.430385 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.430565 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.430654 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.430801 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] federation.caching = True {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.430895 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.431040 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.431125 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.431283 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.431364 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.431529 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.431636 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.431760 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.431856 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] federation.caching = True {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.432006 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.432088 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.432240 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.432328 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.432494 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.432573 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.432730 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.432867 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.432982 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.433220 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.433324 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.433476 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.433715 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.433793 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.434026 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.434213 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.434296 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.434465 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.434543 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] identity.caching = True {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.434703 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] identity.caching = True {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.434783 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.434956 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.435045 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.435205 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.435286 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.435442 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.435531 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.435679 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.435761 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.435928 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.436010 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.436163 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.436254 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.436407 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.436488 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.436655 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.436734 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.436889 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.436978 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.437119 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.437200 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.437348 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.437427 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.437579 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.437667 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.437824 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.437902 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.438092 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.438174 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.438340 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.438430 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.438591 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.438674 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.438831 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.438911 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.439067 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.439155 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.439302 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.439383 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.439532 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.439612 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.439767 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.439855 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.440002 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.440083 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.440230 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.440308 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.440466 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.440554 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.440701 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.440780 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.440939 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.441018 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.441169 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.441274 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.441409 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.441489 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.441651 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.441731 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.441886 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.442007 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.442156 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.442236 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.442399 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.442479 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.442653 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.442746 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.442893 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.442972 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.443121 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.443199 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.443349 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.443437 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.443581 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.443661 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.443816 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.443895 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.444050 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.444137 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.444285 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.444366 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.444519 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.444615 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.444770 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.444872 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.445002 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.445096 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.445230 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.445323 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.445473 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.445564 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.445717 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.445797 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.445951 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.446083 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.446206 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.446299 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.446441 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.446526 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.446670 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.user = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.446750 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.446901 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] ldap.user = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.446988 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.447142 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.447223 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.447374 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.447453 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.447619 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.447701 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.447864 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.447945 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.448107 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.448186 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.448339 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.448420 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.448567 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.448648 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.448796 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.448874 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.449026 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.449106 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.449259 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.449337 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.449483 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.449563 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.449714 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.449794 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.449987 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.450070 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.450213 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.450290 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.450452 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.450536 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.450696 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.450777 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.450925 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.451005 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.451158 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.451238 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.451389 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.451540 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.451635 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.451716 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.451841 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.451924 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.452073 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.452153 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.452306 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.452386 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.452546 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.452627 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.452780 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.452861 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.453015 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.453095 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.453245 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.453325 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.453486 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.453565 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.453717 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.453796 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.453950 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.454049 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.454207 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.454286 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.454441 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.454521 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.454679 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.454760 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.454907 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.454988 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.455137 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.455215 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.455371 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] resource.caching = True {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.455458 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.455609 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] resource.caching = True {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.455688 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.455856 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.455974 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.456079 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.456157 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.456323 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.456439 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.456568 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.456648 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.456805 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.456896 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.457055 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.457135 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.457290 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.457369 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.457529 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.457613 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.457763 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] role.caching = True {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.457844 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.458017 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] role.caching = True {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.458099 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] role.driver = sql {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.458776 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.458859 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] role.driver = sql {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.459014 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.459094 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.459261 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.459341 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.459509 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.459590 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.459755 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.459835 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.460003 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.460091 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.460246 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.460325 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.460491 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.460571 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.460737 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.460836 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.460966 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.461046 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.461210 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.461291 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.461455 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.461545 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.461702 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.461783 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.461947 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.462083 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.462220 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.462387 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.462621 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.462700 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.462857 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.462936 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.463104 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.463192 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.463351 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.463432 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.463599 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.463678 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.463829 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.463917 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.464072 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.464151 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.464319 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.464399 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.464557 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.464646 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.464786 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.464867 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.465015 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.465096 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.465246 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.465335 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.465480 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.465566 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.465731 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.465823 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.465986 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.466093 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.466228 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.466322 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.466462 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.466547 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.466691 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.466779 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.466922 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] token.caching = True {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.467020 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.467160 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.467249 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] token.caching = True {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.467405 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.467488 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.467639 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.467720 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.467892 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.467974 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.468137 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.468221 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.468377 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.468461 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.468613 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.468703 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.468852 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.468945 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.469095 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.469181 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.469329 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.469424 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.469564 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.469659 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.469795 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.469887 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.470052 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.470147 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.470303 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.470386 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.470532 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.470612 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.470789 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.470922 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.471008 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.471081 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.471300 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.471394 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] database.connection = **** {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.471541 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.471643 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] database.connection = **** {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.471787 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.471881 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.472054 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.472145 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.472235 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.472347 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.472457 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.472536 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.472689 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.472780 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.472922 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.473003 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.473154 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.473234 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.473388 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.473475 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.473619 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.473699 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.473907 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.474022 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.474167 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.474262 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.474409 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.474489 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.474640 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.474720 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.474880 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.474968 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.475107 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.475188 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.475339 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.475419 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.476161 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.476336 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.476417 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 14 15:22:23.476490 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:23.476490 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 14 15:22:23.507135 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:23.507353 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:23.507579 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:23.508317 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:23.508553 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:23.508783 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:23.515945 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:23.517124 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:23.544130 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:23.544356 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:23.545559 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:23.545792 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:23.685664 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:23.685873 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:23.735019 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:23.735637 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:23.736109 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:23.736109 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:23.800459 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:23.800677 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:23.800897 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:23.800982 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:23.801114 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:23.801198 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:23.801327 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:23.801409 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:23.801539 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:23.801631 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:23.801793 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:23.802057 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:23.826823 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:23.826954 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:23.827052 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:23.827130 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:23.827254 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:23.827337 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:23.827474 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:23.827566 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:23.827692 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:23.827774 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:23.827903 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:23.827985 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:23.828117 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:23.828204 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:23.839186 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:23.839477 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:23.852323 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:23.852481 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:23.852588 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:23.852714 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:23.852798 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:23.852936 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:23.853018 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:23.853155 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:23.853239 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:23.853363 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:23.853443 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:23.853574 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:23.853652 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:23.853787 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:23.871200 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:23.871405 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 14 15:22:23.871489 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:23.871637 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 14 15:22:23.871960 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:23.872160 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 14 15:22:23.872243 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:23.872386 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 14 15:22:23.872467 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:23.872658 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:23.872749 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:23.872910 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:23.872992 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:23.873158 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:23.873243 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:23.873410 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:23.884242 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:23.884516 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:23.884599 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:23.884781 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:23.884863 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:23.885056 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:23.885139 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:23.885385 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:23.893575 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80344) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 15:22:23.893733 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80345) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 15:22:23.897841 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80344) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 15:22:23.898027 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80345) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 15:22:23.898135 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:23.898314 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:23.898399 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:23.898601 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:23.898685 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:23.898882 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:23.898965 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:23.899203 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:23.899311 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:23.899462 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:23.899569 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:23.899721 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:23.899803 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:23.899987 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:23.900090 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:23.900249 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:23.900330 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:23.900506 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:23.900586 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:23.900769 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:23.927560 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:23.927819 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:23.929159 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80344) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 15:22:23.929434 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:23.929535 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80345) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 15:22:23.929711 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:23.934693 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80344) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 15:22:23.934969 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:23.935051 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80345) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 15:22:23.935246 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:23.935341 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:23.935528 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:23.942671 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80344) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 15:22:23.942908 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:23.942990 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80345) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 15:22:23.943229 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:23.947355 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80344) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 15:22:23.947641 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:23.947722 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80345) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 15:22:23.947920 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:23.948013 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:23.948197 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:23.948279 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:23.948468 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:23.948548 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:23.948736 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:23.948825 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:23.949000 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:23.949081 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:23.949262 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:23.949342 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:23.949524 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:23.968771 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:23.969053 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:23.969143 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:23.969381 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:23.973786 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80345) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 15:22:23.975039 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80344) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 15:22:23.978054 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:23.978402 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:23.978784 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:23.979126 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:23.983722 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80345) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 15:22:23.984205 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80344) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 15:22:23.987361 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80345) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 15:22:23.987919 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80344) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 15:22:23.991059 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:23.991356 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:23.991649 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:23.991779 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:23.991941 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:23.992071 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:23.992213 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:23.992356 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:23.992487 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:23.992617 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:23.992843 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:23.993121 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:24.011744 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80345) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 15:22:24.012029 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:24.012295 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:24.012422 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80344) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 15:22:24.012561 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:24.012700 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:24.012826 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:24.013099 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:24.020453 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:24.021517 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:24.022704 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:24.022979 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:24.023247 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:24.023518 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:24.026174 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80345) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 15:22:24.026457 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:24.026738 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:24.026867 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80344) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 15:22:24.027020 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:24.027157 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:24.027291 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:24.027417 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:24.027543 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:24.027856 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:24.041067 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80345) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 15:22:24.041343 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:24.041620 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:24.041758 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80344) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 15:22:24.041912 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:24.042071 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:24.042281 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:24.042416 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:24.042547 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:24.042677 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:24.042807 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:24.042945 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:24.043102 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:24.043383 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:24.062089 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80345) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 15:22:24.062564 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80344) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 15:22:24.065361 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80345) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 15:22:24.065819 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80344) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 15:22:24.068710 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:24.069196 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:24.070336 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:24.070816 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:24.072099 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80345) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 15:22:24.072380 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:24.072561 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80344) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 15:22:24.072690 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:24.072841 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:24.073129 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:24.079935 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:24.080417 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:24.081541 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80345) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 15:22:24.082033 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80344) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 15:22:24.085313 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:24.085600 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:24.085764 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:24.085893 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:24.086074 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:24.086204 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:24.086340 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:24.086616 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:24.095349 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80345) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 15:22:24.095640 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:24.095767 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80344) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 15:22:24.095904 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:24.096030 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:24.096297 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:24.104347 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80345) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 15:22:24.104624 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:24.104765 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80344) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 15:22:24.104893 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:24.105020 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:24.105171 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:24.105299 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:24.105425 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:24.105567 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:24.105694 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:24.105838 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:24.106003 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:24.106131 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:24.106268 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:24.106395 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:24.106561 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:24.106698 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:24.106877 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:24.107005 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:24.107133 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:24.107258 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:24.107394 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:24.107528 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:24.107654 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:24.107784 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:24.107909 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:24.108035 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:24.108163 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:24.146495 dv-cinder-826510-8-smb devstack@keystone.service[80345]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x556152efd9c0 pid: 80345 (default app) Jul 14 15:22:24.146669 dv-cinder-826510-8-smb devstack@keystone.service[80344]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x556152efd9c0 pid: 80344 (default app) Jul 14 15:22:24.149885 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095fa230-6d71-4aac-b5f7-fb29c8c87e6a None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:24.150200 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095fa230-6d71-4aac-b5f7-fb29c8c87e6a None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:24.150478 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095fa230-6d71-4aac-b5f7-fb29c8c87e6a None None] PATH_INFO: `/v3` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:24.154695 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1/1] 10.222.0.118 () {50 vars in 796 bytes} [Thu Jul 14 15:22:24 2022] GET /identity/v3/ => generated 256 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:22:31.802675 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b812de-8713-495f-99b7-70e572b08ef1 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:31.803226 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b812de-8713-495f-99b7-70e572b08ef1 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:31.803226 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b812de-8713-495f-99b7-70e572b08ef1 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:31.807514 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1/2] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:22:31 2022] GET /identity => generated 271 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:22:31.812759 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc26387-6381-4f01-9ed6-ae3fe88e5d3c None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:31.813147 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc26387-6381-4f01-9ed6-ae3fe88e5d3c None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:31.813315 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc26387-6381-4f01-9ed6-ae3fe88e5d3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:31.882485 dv-cinder-826510-8-smb devstack@keystone.service[80345]: INFO dbcounter [None req-0dc26387-6381-4f01-9ed6-ae3fe88e5d3c None None] Registered counter for database keystone Jul 14 15:22:31.904038 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG oslo_db.sqlalchemy.engines [None req-0dc26387-6381-4f01-9ed6-ae3fe88e5d3c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80345) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 15:22:31.910338 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writer thread running {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 15:22:32.088168 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG passlib.handlers.bcrypt [None req-0dc26387-6381-4f01-9ed6-ae3fe88e5d3c None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80345) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 14 15:22:32.088496 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG passlib.handlers.bcrypt [None req-0dc26387-6381-4f01-9ed6-ae3fe88e5d3c None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80345) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 14 15:22:32.142148 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-0dc26387-6381-4f01-9ed6-ae3fe88e5d3c None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:22:32.143767 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-0dc26387-6381-4f01-9ed6-ae3fe88e5d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:22:32.266695 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 2/3] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:22:31 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 455 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 14 15:22:32.452801 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b812de-8713-495f-99b7-70e572b08ef1 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:32.521813 dv-cinder-826510-8-smb devstack@keystone.service[80344]: INFO dbcounter [None req-05b812de-8713-495f-99b7-70e572b08ef1 None None] Registered counter for database keystone Jul 14 15:22:32.541307 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG oslo_db.sqlalchemy.engines [None req-05b812de-8713-495f-99b7-70e572b08ef1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80344) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 15:22:32.547711 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writer thread running {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 15:22:32.668170 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b812de-8713-495f-99b7-70e572b08ef1 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:32.672570 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25f378b-e36b-46e6-989d-b3fc304c41ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:32.673232 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25f378b-e36b-46e6-989d-b3fc304c41ed admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:32.673517 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25f378b-e36b-46e6-989d-b3fc304c41ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:32.673794 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25f378b-e36b-46e6-989d-b3fc304c41ed admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:32.682698 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25f378b-e36b-46e6-989d-b3fc304c41ed admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:32.734729 dv-cinder-826510-8-smb devstack@keystone.service[80344]: WARNING keystone.common.rbac_enforcer.enforcer [None req-c25f378b-e36b-46e6-989d-b3fc304c41ed admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 14 15:22:32.735078 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25f378b-e36b-46e6-989d-b3fc304c41ed admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:32.746178 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 2/4] 10.222.0.118 () {58 vars in 1329 bytes} [Thu Jul 14 15:22:32 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 14 15:22:32.752140 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc26387-6381-4f01-9ed6-ae3fe88e5d3c None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:32.766934 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc26387-6381-4f01-9ed6-ae3fe88e5d3c None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:32.772186 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0e9da1-a4b1-4667-b962-a40a99520176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:32.773301 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e9da1-a4b1-4667-b962-a40a99520176 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:32.773589 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e9da1-a4b1-4667-b962-a40a99520176 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:32.773864 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e9da1-a4b1-4667-b962-a40a99520176 admin admin] PATH_INFO: `/v3/projects/e864e571207e4b019bbf56cc1f0bce35` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:32.778036 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0e9da1-a4b1-4667-b962-a40a99520176 admin admin] RBAC: Authorizing `identity:get_project(project_id=e864e571207e4b019bbf56cc1f0bce35)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:32.828481 dv-cinder-826510-8-smb devstack@keystone.service[80345]: WARNING keystone.common.rbac_enforcer.enforcer [None req-2b0e9da1-a4b1-4667-b962-a40a99520176 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 14 15:22:32.829037 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0e9da1-a4b1-4667-b962-a40a99520176 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:32.833619 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 3/5] 10.222.0.118 () {56 vars in 1212 bytes} [Thu Jul 14 15:22:32 2022] GET /identity/v3/projects/e864e571207e4b019bbf56cc1f0bce35 => generated 345 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:22:34.845586 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d75165-15e5-4c4d-b1eb-9431b0847825 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:34.846147 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d75165-15e5-4c4d-b1eb-9431b0847825 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:34.846242 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d75165-15e5-4c4d-b1eb-9431b0847825 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:34.850829 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 3/6] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:22:34 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:22:34.856143 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169e9ed1-cf63-49cd-9ce1-34269a97427d None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:34.856564 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169e9ed1-cf63-49cd-9ce1-34269a97427d None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:34.856689 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169e9ed1-cf63-49cd-9ce1-34269a97427d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:34.875773 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-169e9ed1-cf63-49cd-9ce1-34269a97427d None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:22:34.877294 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-169e9ed1-cf63-49cd-9ce1-34269a97427d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:22:34.885509 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 4/7] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:22:34 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 14 15:22:34.908321 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d75165-15e5-4c4d-b1eb-9431b0847825 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:34.920970 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d75165-15e5-4c4d-b1eb-9431b0847825 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:34.925107 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adf20a1-fa6b-47e9-8656-ad5afb158661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:34.925741 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adf20a1-fa6b-47e9-8656-ad5afb158661 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:34.926049 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adf20a1-fa6b-47e9-8656-ad5afb158661 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:34.926328 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adf20a1-fa6b-47e9-8656-ad5afb158661 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:34.934134 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adf20a1-fa6b-47e9-8656-ad5afb158661 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:34.935919 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adf20a1-fa6b-47e9-8656-ad5afb158661 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:34.944694 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 4/8] 10.222.0.118 () {58 vars in 1329 bytes} [Thu Jul 14 15:22:34 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 15:22:34.950282 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169e9ed1-cf63-49cd-9ce1-34269a97427d None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:34.960243 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169e9ed1-cf63-49cd-9ce1-34269a97427d None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:34.990736 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73d2795-762b-4d70-b7de-d9bcd923d1f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:34.991554 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73d2795-762b-4d70-b7de-d9bcd923d1f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:34.991837 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73d2795-762b-4d70-b7de-d9bcd923d1f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:34.992111 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73d2795-762b-4d70-b7de-d9bcd923d1f8 admin admin] PATH_INFO: `/v3/users/3c839799004e4bd49aeaeae2457a9c6b` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:34.993614 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73d2795-762b-4d70-b7de-d9bcd923d1f8 admin admin] RBAC: Authorizing `identity:get_user(user_id=3c839799004e4bd49aeaeae2457a9c6b)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:34.995628 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73d2795-762b-4d70-b7de-d9bcd923d1f8 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:34.997278 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 5/9] 10.222.0.118 () {56 vars in 1203 bytes} [Thu Jul 14 15:22:34 2022] GET /identity/v3/users/3c839799004e4bd49aeaeae2457a9c6b => generated 248 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:22:37.092950 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7285a270-bf65-4d5c-80b4-15edc0ca84ea None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:37.093459 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7285a270-bf65-4d5c-80b4-15edc0ca84ea None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:37.093459 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7285a270-bf65-4d5c-80b4-15edc0ca84ea None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:37.094797 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 5/10] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:22:37 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 14 15:22:37.100239 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86fc7e8-e32c-4556-8ec4-8929923bbe76 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:37.100672 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86fc7e8-e32c-4556-8ec4-8929923bbe76 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:37.100876 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86fc7e8-e32c-4556-8ec4-8929923bbe76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:37.117858 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-e86fc7e8-e32c-4556-8ec4-8929923bbe76 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:22:37.119100 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-e86fc7e8-e32c-4556-8ec4-8929923bbe76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:22:37.125047 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6166175e-a960-4810-b46e-b97fa5207031 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:37.125336 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6166175e-a960-4810-b46e-b97fa5207031 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:37.125614 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6166175e-a960-4810-b46e-b97fa5207031 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:37.127441 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 6/11] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:22:37 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 14 15:22:37.133195 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b4fab-81b6-435f-b259-930061816d33 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:37.133481 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b4fab-81b6-435f-b259-930061816d33 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:37.133760 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b4fab-81b6-435f-b259-930061816d33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:37.173195 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG passlib.handlers.bcrypt [None req-e38b4fab-81b6-435f-b259-930061816d33 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80344) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 14 15:22:37.173608 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG passlib.handlers.bcrypt [None req-e38b4fab-81b6-435f-b259-930061816d33 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80344) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 14 15:22:37.201630 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 6/12] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:22:37 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:22:37.219640 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-e38b4fab-81b6-435f-b259-930061816d33 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:22:37.221261 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-e38b4fab-81b6-435f-b259-930061816d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:22:37.224627 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86fc7e8-e32c-4556-8ec4-8929923bbe76 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:37.249364 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:37.325044 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 7/13] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:22:37 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 15:22:37.329825 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86fc7e8-e32c-4556-8ec4-8929923bbe76 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:37.348122 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38b4fab-81b6-435f-b259-930061816d33 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:37.363872 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994bc5ec-0bcb-4877-9133-2a18b853f4cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:37.365174 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994bc5ec-0bcb-4877-9133-2a18b853f4cd None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:37.365461 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994bc5ec-0bcb-4877-9133-2a18b853f4cd None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:37.365739 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994bc5ec-0bcb-4877-9133-2a18b853f4cd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:37.378581 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994bc5ec-0bcb-4877-9133-2a18b853f4cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:22:37.390419 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-994bc5ec-0bcb-4877-9133-2a18b853f4cd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:22:37.390419 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:22:37.390419 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:22:37.390419 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:22:37.390419 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:22:37.390419 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:22:37.390419 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:22:37.390419 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:22:37.390419 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:22:37.390419 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:22:37.390419 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:22:37.390419 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:22:37.390419 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:22:37.390419 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:22:37.390419 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:22:37.390419 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:22:37.391325 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:22:37.391325 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:22:37.391325 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:22:37.391325 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:22:37.391325 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:22:37.391325 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:22:37.391325 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:22:37.391325 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:22:37.391325 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:22:37.391325 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:22:37.391325 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:22:37.391325 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:22:37.391325 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:22:37.391325 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:22:37.391325 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:22:37.391325 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:22:37.392146 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:22:37.392146 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:22:37.392146 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:22:37.392146 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:22:37.392146 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:22:37.392146 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:22:37.392146 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:22:37.392146 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:22:37.392146 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:22:37.392146 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:22:37.392146 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:22:37.392146 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:22:37.392146 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 7/14] 10.222.0.118 () {56 vars in 1101 bytes} [Thu Jul 14 15:22:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:22:37.398170 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994bc5ec-0bcb-4877-9133-2a18b853f4cd None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:37.452310 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38b4fab-81b6-435f-b259-930061816d33 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:37.454617 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:37.480193 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:37.491357 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e2c201-682f-4deb-8401-e1e9edd3db6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:37.492255 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e2c201-682f-4deb-8401-e1e9edd3db6f None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:37.492543 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e2c201-682f-4deb-8401-e1e9edd3db6f None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:37.492819 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e2c201-682f-4deb-8401-e1e9edd3db6f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:37.498699 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994bc5ec-0bcb-4877-9133-2a18b853f4cd None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:37.532108 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b504694-2134-4f26-b203-bfb3a747a2fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:37.532776 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b504694-2134-4f26-b203-bfb3a747a2fe None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:37.533055 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b504694-2134-4f26-b203-bfb3a747a2fe None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:37.533330 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b504694-2134-4f26-b203-bfb3a747a2fe None admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:37.534111 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b504694-2134-4f26-b203-bfb3a747a2fe None admin] RBAC: Adding query filter params (name=admin) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:22:37.534424 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b504694-2134-4f26-b203-bfb3a747a2fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:37.535832 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b504694-2134-4f26-b203-bfb3a747a2fe None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:37.547897 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 8/15] 10.222.0.118 () {56 vars in 1104 bytes} [Thu Jul 14 15:22:37 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:22:37.553931 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b504694-2134-4f26-b203-bfb3a747a2fe None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:37.561553 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e2c201-682f-4deb-8401-e1e9edd3db6f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:37.563107 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e2c201-682f-4deb-8401-e1e9edd3db6f None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:37.652568 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b504694-2134-4f26-b203-bfb3a747a2fe None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:37.662786 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 8/16] 10.222.0.118 () {58 vars in 1287 bytes} [Thu Jul 14 15:22:37 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 15:22:37.668516 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e2c201-682f-4deb-8401-e1e9edd3db6f None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:37.671251 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:37.686641 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375042c4-d17a-4184-abb1-ca888a4e2d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:37.687513 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375042c4-d17a-4184-abb1-ca888a4e2d2f None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:37.687790 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375042c4-d17a-4184-abb1-ca888a4e2d2f None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:37.688059 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375042c4-d17a-4184-abb1-ca888a4e2d2f None admin] PATH_INFO: `/v3/users/3c839799004e4bd49aeaeae2457a9c6b` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:37.689262 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375042c4-d17a-4184-abb1-ca888a4e2d2f None admin] RBAC: Authorizing `identity:get_user(user_id=3c839799004e4bd49aeaeae2457a9c6b)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:37.690758 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375042c4-d17a-4184-abb1-ca888a4e2d2f None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:37.694016 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 9/17] 10.222.0.118 () {56 vars in 1182 bytes} [Thu Jul 14 15:22:37 2022] GET /identity/v3/users/3c839799004e4bd49aeaeae2457a9c6b => generated 248 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:22:37.697848 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375042c4-d17a-4184-abb1-ca888a4e2d2f None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:37.712625 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:37.774979 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e2c201-682f-4deb-8401-e1e9edd3db6f None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:37.801691 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375042c4-d17a-4184-abb1-ca888a4e2d2f None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:37.809239 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37795388-00a2-4fc8-86d2-3c02227349ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:37.810066 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37795388-00a2-4fc8-86d2-3c02227349ab None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:37.810354 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37795388-00a2-4fc8-86d2-3c02227349ab None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:37.810637 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37795388-00a2-4fc8-86d2-3c02227349ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:37.830313 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37795388-00a2-4fc8-86d2-3c02227349ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:37.831787 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37795388-00a2-4fc8-86d2-3c02227349ab None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:37.837041 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab94f25-43da-4ed0-b4ee-d22ac6938465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:37.837839 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab94f25-43da-4ed0-b4ee-d22ac6938465 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:37.838147 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab94f25-43da-4ed0-b4ee-d22ac6938465 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:37.838426 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab94f25-43da-4ed0-b4ee-d22ac6938465 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:37.839621 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab94f25-43da-4ed0-b4ee-d22ac6938465 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:37.841082 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab94f25-43da-4ed0-b4ee-d22ac6938465 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:37.842715 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 10/18] 10.222.0.118 () {56 vars in 1113 bytes} [Thu Jul 14 15:22:37 2022] GET /identity/v3/domains/default => generated 200 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:22:37.848391 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab94f25-43da-4ed0-b4ee-d22ac6938465 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:37.853409 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-37795388-00a2-4fc8-86d2-3c02227349ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:22:37.853409 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:22:37.853409 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:22:37.853409 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:22:37.853409 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:22:37.853409 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:22:37.853409 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:22:37.853409 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:22:37.853409 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:22:37.853409 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:22:37.853409 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:22:37.853409 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:22:37.853409 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:22:37.853409 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:22:37.853409 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:22:37.854390 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:22:37.854390 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:22:37.854390 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:22:37.854390 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:22:37.854390 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:22:37.854390 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:22:37.854390 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:22:37.854390 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:22:37.854390 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:22:37.854390 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:22:37.854390 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:22:37.854390 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:22:37.854390 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:22:37.854390 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:22:37.854390 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:22:37.854390 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:22:37.854390 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:22:37.855160 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:22:37.855160 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:22:37.855160 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:22:37.855160 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:22:37.855160 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 9/19] 10.222.0.118 () {56 vars in 1113 bytes} [Thu Jul 14 15:22:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:22:37.860380 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37795388-00a2-4fc8-86d2-3c02227349ab None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:37.917403 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:37.928954 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:37.948311 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab94f25-43da-4ed0-b4ee-d22ac6938465 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:37.961502 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37795388-00a2-4fc8-86d2-3c02227349ab None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:37.982966 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59add4b3-6147-471a-9534-0e2e00caea9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:37.983623 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59add4b3-6147-471a-9534-0e2e00caea9d None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:37.983905 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59add4b3-6147-471a-9534-0e2e00caea9d None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:37.984178 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59add4b3-6147-471a-9534-0e2e00caea9d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:37.985013 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59add4b3-6147-471a-9534-0e2e00caea9d None admin] RBAC: Adding query filter params (role.id=3b880cef7dcf4baf87b50f8610c0c56e, scope.domain.id=default, user.id=3c839799004e4bd49aeaeae2457a9c6b) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:22:37.985330 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59add4b3-6147-471a-9534-0e2e00caea9d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:37.986811 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59add4b3-6147-471a-9534-0e2e00caea9d None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:37.993533 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 11/20] 10.222.0.118 () {56 vars in 1327 bytes} [Thu Jul 14 15:22:37 2022] GET /identity/v3/role_assignments?user.id=3c839799004e4bd49aeaeae2457a9c6b&scope.domain.id=default&role.id=3b880cef7dcf4baf87b50f8610c0c56e => generated 234 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:22:37.995355 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80dbd4a-6ba1-43db-87d3-038e7a39cf70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:37.996019 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80dbd4a-6ba1-43db-87d3-038e7a39cf70 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:37.996301 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80dbd4a-6ba1-43db-87d3-038e7a39cf70 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:37.996579 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80dbd4a-6ba1-43db-87d3-038e7a39cf70 None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:37.997323 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80dbd4a-6ba1-43db-87d3-038e7a39cf70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:22:37.997633 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80dbd4a-6ba1-43db-87d3-038e7a39cf70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:37.999101 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80dbd4a-6ba1-43db-87d3-038e7a39cf70 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:38.019128 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 10/21] 10.222.0.118 () {56 vars in 1114 bytes} [Thu Jul 14 15:22:37 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:22:40.236840 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f37d49-0f65-481e-914a-8bfef13d1e97 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:40.237885 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f37d49-0f65-481e-914a-8bfef13d1e97 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:40.238387 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f37d49-0f65-481e-914a-8bfef13d1e97 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:40.240277 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 12/22] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:22:40 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:22:40.245543 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71e4335-aaa5-4448-8d01-f147808c2db0 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:40.246389 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71e4335-aaa5-4448-8d01-f147808c2db0 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:40.246872 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71e4335-aaa5-4448-8d01-f147808c2db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:40.271481 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-d71e4335-aaa5-4448-8d01-f147808c2db0 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:22:40.273035 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-d71e4335-aaa5-4448-8d01-f147808c2db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:22:40.355289 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 11/23] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:22:40 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:22:40.391956 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f37d49-0f65-481e-914a-8bfef13d1e97 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:40.476678 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7284a52c-4389-481d-a7ab-4e3b0b137f70 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:40.477405 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7284a52c-4389-481d-a7ab-4e3b0b137f70 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:40.478027 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7284a52c-4389-481d-a7ab-4e3b0b137f70 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:40.479854 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 12/24] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:22:40 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:22:40.484699 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace5505d-da03-438f-95d2-c44febfabb60 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:40.485193 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace5505d-da03-438f-95d2-c44febfabb60 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:40.485657 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace5505d-da03-438f-95d2-c44febfabb60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:40.518645 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-ace5505d-da03-438f-95d2-c44febfabb60 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:22:40.520274 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-ace5505d-da03-438f-95d2-c44febfabb60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:22:40.557010 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f37d49-0f65-481e-914a-8bfef13d1e97 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:40.592794 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:40.606183 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f0c50c-206d-4b82-b709-b214de739aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:40.607352 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f0c50c-206d-4b82-b709-b214de739aa4 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:40.607781 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f0c50c-206d-4b82-b709-b214de739aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:40.608202 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f0c50c-206d-4b82-b709-b214de739aa4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:40.626183 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f0c50c-206d-4b82-b709-b214de739aa4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:22:40.643111 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-32f0c50c-206d-4b82-b709-b214de739aa4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:22:40.643111 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:22:40.643111 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:22:40.643111 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:22:40.643111 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:22:40.643111 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:22:40.643111 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:22:40.643111 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:22:40.643111 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:22:40.643111 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:22:40.643111 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:22:40.643111 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:22:40.643111 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:22:40.643111 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:22:40.643111 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:22:40.643111 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:22:40.644715 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:22:40.644715 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:22:40.644715 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:22:40.644715 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:22:40.644715 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:22:40.644715 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:22:40.644715 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:22:40.644715 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:22:40.644715 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:22:40.644715 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:22:40.644715 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:22:40.644715 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:22:40.644715 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:22:40.644715 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:22:40.644715 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:22:40.644715 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:22:40.645505 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:22:40.645505 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:22:40.645505 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:22:40.645505 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:22:40.645505 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:22:40.645505 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:22:40.645505 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:22:40.645505 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:22:40.645505 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:22:40.645505 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:22:40.645505 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:22:40.645505 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:22:40.646093 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 13/25] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:22:40 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:22:40.648002 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 13/26] 10.222.0.118 () {56 vars in 1101 bytes} [Thu Jul 14 15:22:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:22:40.654036 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace5505d-da03-438f-95d2-c44febfabb60 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:40.681751 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f0c50c-206d-4b82-b709-b214de739aa4 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:40.690462 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:40.866544 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace5505d-da03-438f-95d2-c44febfabb60 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:40.923370 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b9ee3a-88b2-433f-ba4c-e9e375fb0090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:40.924884 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b9ee3a-88b2-433f-ba4c-e9e375fb0090 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:40.925172 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b9ee3a-88b2-433f-ba4c-e9e375fb0090 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:40.925559 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b9ee3a-88b2-433f-ba4c-e9e375fb0090 None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:40.927549 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b9ee3a-88b2-433f-ba4c-e9e375fb0090 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:22:40.927877 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b9ee3a-88b2-433f-ba4c-e9e375fb0090 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:40.929298 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b9ee3a-88b2-433f-ba4c-e9e375fb0090 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:40.935321 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f0c50c-206d-4b82-b709-b214de739aa4 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:40.961275 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 14/27] 10.222.0.118 () {56 vars in 1104 bytes} [Thu Jul 14 15:22:40 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:22:40.962665 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a3732a-d046-4ffb-a0e7-65e9b0cb52fb None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:40.962957 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a3732a-d046-4ffb-a0e7-65e9b0cb52fb None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:40.963236 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a3732a-d046-4ffb-a0e7-65e9b0cb52fb None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:40.964516 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 15/28] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:22:40 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:22:40.973072 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a3732a-d046-4ffb-a0e7-65e9b0cb52fb None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:40.998265 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adee06ec-215a-4ee4-b31f-2d19ab73341b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:40.999330 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adee06ec-215a-4ee4-b31f-2d19ab73341b None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:41.000183 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adee06ec-215a-4ee4-b31f-2d19ab73341b None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:41.000632 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adee06ec-215a-4ee4-b31f-2d19ab73341b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:41.014882 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adee06ec-215a-4ee4-b31f-2d19ab73341b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:41.017384 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adee06ec-215a-4ee4-b31f-2d19ab73341b None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:41.021340 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:41.041415 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-adee06ec-215a-4ee4-b31f-2d19ab73341b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:22:41.041415 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:22:41.041415 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:22:41.041415 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:22:41.041415 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:22:41.041415 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:22:41.041415 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:22:41.041415 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:22:41.041415 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:22:41.041415 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:22:41.041415 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:22:41.041415 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:22:41.041415 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:22:41.041415 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:22:41.041415 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:22:41.042458 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:22:41.042458 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:22:41.042458 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:22:41.042458 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:22:41.042458 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:22:41.042458 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:22:41.042458 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:22:41.042458 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:22:41.042458 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:22:41.042458 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:22:41.042458 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:22:41.042458 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:22:41.042458 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:22:41.042458 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:22:41.042458 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:22:41.042458 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:22:41.042458 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:22:41.043428 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:22:41.043428 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:22:41.043428 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:22:41.043428 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:22:41.045530 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 14/29] 10.222.0.118 () {56 vars in 1113 bytes} [Thu Jul 14 15:22:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 364 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:22:41.047127 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d3e3ab-3271-45cc-bed4-b0cf13651293 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:41.047936 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d3e3ab-3271-45cc-bed4-b0cf13651293 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:41.048540 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d3e3ab-3271-45cc-bed4-b0cf13651293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:41.069571 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-27d3e3ab-3271-45cc-bed4-b0cf13651293 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:22:41.071059 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-27d3e3ab-3271-45cc-bed4-b0cf13651293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:22:41.100055 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a3732a-d046-4ffb-a0e7-65e9b0cb52fb None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:41.126275 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:41.142820 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b26689-47e3-4846-9997-c3801a4aca68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:41.144136 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b26689-47e3-4846-9997-c3801a4aca68 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:41.144367 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 15/30] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:22:41 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:22:41.146468 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf25325-b820-49a9-aea1-2869e5901d1a None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:41.146974 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf25325-b820-49a9-aea1-2869e5901d1a None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:41.147446 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf25325-b820-49a9-aea1-2869e5901d1a None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:41.148933 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 16/31] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:22:41 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:22:41.149817 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf25325-b820-49a9-aea1-2869e5901d1a None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:41.150692 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b26689-47e3-4846-9997-c3801a4aca68 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:41.151001 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b26689-47e3-4846-9997-c3801a4aca68 None admin] PATH_INFO: `/v3/users/3c839799004e4bd49aeaeae2457a9c6b` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:41.154102 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b26689-47e3-4846-9997-c3801a4aca68 None admin] RBAC: Authorizing `identity:get_user(user_id=3c839799004e4bd49aeaeae2457a9c6b)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:41.155898 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b26689-47e3-4846-9997-c3801a4aca68 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:41.162387 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 16/32] 10.222.0.118 () {56 vars in 1182 bytes} [Thu Jul 14 15:22:40 2022] GET /identity/v3/users/3c839799004e4bd49aeaeae2457a9c6b => generated 248 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:22:41.164783 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b26689-47e3-4846-9997-c3801a4aca68 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:41.259402 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf25325-b820-49a9-aea1-2869e5901d1a None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:41.296454 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851adf90-0f6d-444f-acb4-06ff8fcf3095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:41.297307 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851adf90-0f6d-444f-acb4-06ff8fcf3095 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:41.297689 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851adf90-0f6d-444f-acb4-06ff8fcf3095 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:41.298097 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851adf90-0f6d-444f-acb4-06ff8fcf3095 None admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:41.298933 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851adf90-0f6d-444f-acb4-06ff8fcf3095 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:22:41.299340 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851adf90-0f6d-444f-acb4-06ff8fcf3095 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:41.300952 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851adf90-0f6d-444f-acb4-06ff8fcf3095 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:41.302977 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b26689-47e3-4846-9997-c3801a4aca68 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:41.311089 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:41.320156 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 17/33] 10.222.0.118 () {56 vars in 1114 bytes} [Thu Jul 14 15:22:41 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:22:41.321301 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb9358a-f59c-4c4d-849d-73f9ceeecb7d None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:41.321883 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb9358a-f59c-4c4d-849d-73f9ceeecb7d None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:41.322071 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb9358a-f59c-4c4d-849d-73f9ceeecb7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:41.339837 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-3fb9358a-f59c-4c4d-849d-73f9ceeecb7d None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:22:41.341265 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-3fb9358a-f59c-4c4d-849d-73f9ceeecb7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:22:41.345009 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bd010e-8331-4f4d-b70c-c2e02cbe942e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:41.346103 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bd010e-8331-4f4d-b70c-c2e02cbe942e None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:41.346579 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bd010e-8331-4f4d-b70c-c2e02cbe942e None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:41.347060 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bd010e-8331-4f4d-b70c-c2e02cbe942e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:41.348485 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bd010e-8331-4f4d-b70c-c2e02cbe942e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:41.350292 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bd010e-8331-4f4d-b70c-c2e02cbe942e None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:41.356908 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 17/34] 10.222.0.118 () {56 vars in 1113 bytes} [Thu Jul 14 15:22:41 2022] GET /identity/v3/domains/default => generated 200 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:22:41.358100 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bd010e-8331-4f4d-b70c-c2e02cbe942e None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:41.389185 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:41.421984 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 18/35] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:22:41 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:22:41.421984 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb9358a-f59c-4c4d-849d-73f9ceeecb7d None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:41.492874 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bd010e-8331-4f4d-b70c-c2e02cbe942e None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:41.529121 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae576958-8731-4564-a6dd-3ef4486fee6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:41.530185 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae576958-8731-4564-a6dd-3ef4486fee6e None admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:41.530682 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae576958-8731-4564-a6dd-3ef4486fee6e None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:41.530913 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb9358a-f59c-4c4d-849d-73f9ceeecb7d None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:41.531345 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae576958-8731-4564-a6dd-3ef4486fee6e None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:41.532301 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae576958-8731-4564-a6dd-3ef4486fee6e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:41.533882 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae576958-8731-4564-a6dd-3ef4486fee6e None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:41.569928 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7506cf-8277-4c30-80f8-eed4334a4e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:41.570694 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7506cf-8277-4c30-80f8-eed4334a4e69 None admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:41.571055 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7506cf-8277-4c30-80f8-eed4334a4e69 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:41.571356 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7506cf-8277-4c30-80f8-eed4334a4e69 None admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:41.572080 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7506cf-8277-4c30-80f8-eed4334a4e69 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:41.573678 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7506cf-8277-4c30-80f8-eed4334a4e69 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:41.674175 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 18/36] 10.222.0.118 () {60 vars in 1136 bytes} [Thu Jul 14 15:22:41 2022] POST /identity/v3/roles => generated 220 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:22:41.675763 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae576958-8731-4564-a6dd-3ef4486fee6e None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:41.721554 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 19/37] 10.222.0.118 () {60 vars in 1146 bytes} [Thu Jul 14 15:22:41 2022] POST /identity/v3/projects => generated 302 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:22:41.721554 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7506cf-8277-4c30-80f8-eed4334a4e69 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:41.741375 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:41.760227 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:41.857999 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7506cf-8277-4c30-80f8-eed4334a4e69 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:41.858220 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae576958-8731-4564-a6dd-3ef4486fee6e None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:41.893471 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ee31d3-d6ca-49e3-86a6-a6ea909d960f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:41.896236 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ee31d3-d6ca-49e3-86a6-a6ea909d960f None admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:41.896236 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ee31d3-d6ca-49e3-86a6-a6ea909d960f None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:41.896236 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ee31d3-d6ca-49e3-86a6-a6ea909d960f None admin] PATH_INFO: `/v3/domains/default/users/3c839799004e4bd49aeaeae2457a9c6b/roles/3b880cef7dcf4baf87b50f8610c0c56e` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:41.898442 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ee31d3-d6ca-49e3-86a6-a6ea909d960f None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=3c839799004e4bd49aeaeae2457a9c6b, role_id=3b880cef7dcf4baf87b50f8610c0c56e)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:41.900281 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ee31d3-d6ca-49e3-86a6-a6ea909d960f None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:41.923774 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 19/38] 10.222.0.118 () {58 vars in 1366 bytes} [Thu Jul 14 15:22:41 2022] PUT /identity/v3/domains/default/users/3c839799004e4bd49aeaeae2457a9c6b/roles/3b880cef7dcf4baf87b50f8610c0c56e => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:22:41.925710 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e79bc5-61d9-4106-895a-3cdc87b20367 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:41.926058 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e79bc5-61d9-4106-895a-3cdc87b20367 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:41.926375 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e79bc5-61d9-4106-895a-3cdc87b20367 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:41.929449 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 20/39] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:22:41 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:22:41.934180 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1edadc-facd-4d51-b9eb-c100b3e90bee None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:41.934542 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1edadc-facd-4d51-b9eb-c100b3e90bee None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:41.934896 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1edadc-facd-4d51-b9eb-c100b3e90bee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:41.935394 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1e13f5-ae7f-4df6-9c8e-832a07ee4da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:41.936255 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1e13f5-ae7f-4df6-9c8e-832a07ee4da3 None admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:41.936694 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1e13f5-ae7f-4df6-9c8e-832a07ee4da3 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:41.937252 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1e13f5-ae7f-4df6-9c8e-832a07ee4da3 None admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:41.938280 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1e13f5-ae7f-4df6-9c8e-832a07ee4da3 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:41.940171 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1e13f5-ae7f-4df6-9c8e-832a07ee4da3 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:41.971351 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-df1edadc-facd-4d51-b9eb-c100b3e90bee None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:22:41.973093 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-df1edadc-facd-4d51-b9eb-c100b3e90bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:22:41.975239 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 20/40] 10.222.0.118 () {60 vars in 1136 bytes} [Thu Jul 14 15:22:41 2022] POST /identity/v3/roles => generated 226 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:22:42.063533 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 21/41] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:22:41 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 15:22:42.088536 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1e13f5-ae7f-4df6-9c8e-832a07ee4da3 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:42.204774 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe9d8c-f2c8-4526-8b01-027b7654483b None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:42.205074 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe9d8c-f2c8-4526-8b01-027b7654483b None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:42.205296 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe9d8c-f2c8-4526-8b01-027b7654483b None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:42.206959 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 22/42] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:22:42 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:22:42.214948 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7862a9-7437-4bdc-a22a-b97e3e49c8d6 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:42.215236 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7862a9-7437-4bdc-a22a-b97e3e49c8d6 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:42.215515 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7862a9-7437-4bdc-a22a-b97e3e49c8d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:42.238326 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-2f7862a9-7437-4bdc-a22a-b97e3e49c8d6 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:22:42.239199 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-2f7862a9-7437-4bdc-a22a-b97e3e49c8d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:22:42.268761 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:42.326202 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:42.341408 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 23/43] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:22:42 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 15:22:42.341903 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1e13f5-ae7f-4df6-9c8e-832a07ee4da3 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:42.361480 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7862a9-7437-4bdc-a22a-b97e3e49c8d6 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:42.382021 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804011c9-5ed1-4a0d-88f0-2ed3b203bb45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:42.382745 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804011c9-5ed1-4a0d-88f0-2ed3b203bb45 None admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:42.383089 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804011c9-5ed1-4a0d-88f0-2ed3b203bb45 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:42.383375 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804011c9-5ed1-4a0d-88f0-2ed3b203bb45 None admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:42.384147 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804011c9-5ed1-4a0d-88f0-2ed3b203bb45 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:42.385554 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804011c9-5ed1-4a0d-88f0-2ed3b203bb45 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:42.400447 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 21/44] 10.222.0.118 () {60 vars in 1136 bytes} [Thu Jul 14 15:22:42 2022] POST /identity/v3/roles => generated 224 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:22:42.477642 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7862a9-7437-4bdc-a22a-b97e3e49c8d6 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:42.519540 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a591b72f-7047-4a52-9ede-7111c5958be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:42.520108 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a591b72f-7047-4a52-9ede-7111c5958be7 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:42.520477 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a591b72f-7047-4a52-9ede-7111c5958be7 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:42.520754 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a591b72f-7047-4a52-9ede-7111c5958be7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:42.522079 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a591b72f-7047-4a52-9ede-7111c5958be7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:42.523649 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a591b72f-7047-4a52-9ede-7111c5958be7 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:42.525561 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 24/45] 10.222.0.118 () {56 vars in 1113 bytes} [Thu Jul 14 15:22:42 2022] GET /identity/v3/domains/default => generated 200 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:22:42.531280 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804011c9-5ed1-4a0d-88f0-2ed3b203bb45 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:42.638150 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804011c9-5ed1-4a0d-88f0-2ed3b203bb45 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:42.670573 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fd9ee4-b671-4d5c-afdb-b4260b2d6301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:42.671300 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fd9ee4-b671-4d5c-afdb-b4260b2d6301 None admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:42.671593 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fd9ee4-b671-4d5c-afdb-b4260b2d6301 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:42.671874 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fd9ee4-b671-4d5c-afdb-b4260b2d6301 None admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:42.672599 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fd9ee4-b671-4d5c-afdb-b4260b2d6301 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:42.674081 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fd9ee4-b671-4d5c-afdb-b4260b2d6301 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:42.695457 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:42.709992 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 22/46] 10.222.0.118 () {60 vars in 1146 bytes} [Thu Jul 14 15:22:42 2022] POST /identity/v3/projects => generated 313 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:22:44.094280 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b045d6-5e02-451b-a698-21fccef71e4b None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:44.094763 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b045d6-5e02-451b-a698-21fccef71e4b None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:44.094763 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b045d6-5e02-451b-a698-21fccef71e4b None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:44.096129 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 25/47] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:22:44 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:22:44.101679 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dd1691-f608-45cd-b3a8-fa5a2e219a60 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:44.102100 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dd1691-f608-45cd-b3a8-fa5a2e219a60 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:44.102390 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dd1691-f608-45cd-b3a8-fa5a2e219a60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:44.119636 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-22dd1691-f608-45cd-b3a8-fa5a2e219a60 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:22:44.121172 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-22dd1691-f608-45cd-b3a8-fa5a2e219a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:22:44.192899 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 23/48] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:22:44 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:22:44.216165 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b045d6-5e02-451b-a698-21fccef71e4b None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:44.240986 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:44.319608 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b045d6-5e02-451b-a698-21fccef71e4b None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:44.353288 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7f3fcd-96f3-4ffb-8be9-7dddf8a9f6d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:44.354027 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f3fcd-96f3-4ffb-8be9-7dddf8a9f6d7 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:44.354313 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f3fcd-96f3-4ffb-8be9-7dddf8a9f6d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:44.354590 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f3fcd-96f3-4ffb-8be9-7dddf8a9f6d7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:44.366199 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7f3fcd-96f3-4ffb-8be9-7dddf8a9f6d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:22:44.374888 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-bd7f3fcd-96f3-4ffb-8be9-7dddf8a9f6d7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:22:44.374888 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:22:44.374888 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:22:44.374888 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:22:44.374888 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:22:44.374888 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:22:44.374888 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:22:44.374888 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:22:44.374888 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:22:44.374888 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:22:44.374888 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:22:44.374888 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:22:44.374888 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:22:44.374888 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:22:44.374888 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:22:44.374888 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:22:44.375876 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:22:44.375876 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:22:44.375876 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:22:44.375876 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:22:44.375876 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:22:44.375876 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:22:44.375876 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:22:44.375876 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:22:44.375876 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:22:44.375876 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:22:44.375876 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:22:44.375876 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:22:44.375876 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:22:44.375876 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:22:44.375876 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:22:44.375876 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:22:44.376724 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:22:44.376724 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:22:44.376724 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:22:44.376724 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:22:44.376724 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:22:44.376724 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:22:44.376724 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:22:44.376724 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:22:44.376724 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:22:44.376724 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:22:44.376724 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:22:44.376724 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:22:44.376724 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 26/49] 10.222.0.118 () {56 vars in 1101 bytes} [Thu Jul 14 15:22:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:22:44.383462 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dd1691-f608-45cd-b3a8-fa5a2e219a60 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:44.479079 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dd1691-f608-45cd-b3a8-fa5a2e219a60 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:44.507639 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:44.513773 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c997f777-aa2e-4a40-976a-8aae2187c912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:44.514490 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c997f777-aa2e-4a40-976a-8aae2187c912 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:44.514773 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c997f777-aa2e-4a40-976a-8aae2187c912 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:44.515049 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c997f777-aa2e-4a40-976a-8aae2187c912 None admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:44.515806 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c997f777-aa2e-4a40-976a-8aae2187c912 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:22:44.516114 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c997f777-aa2e-4a40-976a-8aae2187c912 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:44.517511 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c997f777-aa2e-4a40-976a-8aae2187c912 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:44.525838 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 24/50] 10.222.0.118 () {56 vars in 1104 bytes} [Thu Jul 14 15:22:44 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:22:44.531410 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7f3fcd-96f3-4ffb-8be9-7dddf8a9f6d7 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:44.612962 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:44.632528 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7f3fcd-96f3-4ffb-8be9-7dddf8a9f6d7 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:44.665065 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fde4ec-3246-4939-8247-f3392387da0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:44.665987 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fde4ec-3246-4939-8247-f3392387da0a None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:44.666261 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fde4ec-3246-4939-8247-f3392387da0a None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:44.666533 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fde4ec-3246-4939-8247-f3392387da0a None admin] PATH_INFO: `/v3/users/3c839799004e4bd49aeaeae2457a9c6b` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:44.667716 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fde4ec-3246-4939-8247-f3392387da0a None admin] RBAC: Authorizing `identity:get_user(user_id=3c839799004e4bd49aeaeae2457a9c6b)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:44.669175 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fde4ec-3246-4939-8247-f3392387da0a None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:44.670845 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 27/51] 10.222.0.118 () {56 vars in 1182 bytes} [Thu Jul 14 15:22:44 2022] GET /identity/v3/users/3c839799004e4bd49aeaeae2457a9c6b => generated 248 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:22:44.676232 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c997f777-aa2e-4a40-976a-8aae2187c912 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:44.759619 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfbe870-0dd1-4cce-9ac6-235eaf7275e7 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:44.760025 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfbe870-0dd1-4cce-9ac6-235eaf7275e7 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:44.760360 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfbe870-0dd1-4cce-9ac6-235eaf7275e7 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:44.761771 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 28/52] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:22:44 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 14 15:22:44.768397 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fcb6c4-d741-4537-b864-c0b4cf76a776 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:44.768685 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fcb6c4-d741-4537-b864-c0b4cf76a776 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:44.768963 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fcb6c4-d741-4537-b864-c0b4cf76a776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:44.780377 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c997f777-aa2e-4a40-976a-8aae2187c912 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:44.786913 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-56fcb6c4-d741-4537-b864-c0b4cf76a776 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:22:44.788128 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-56fcb6c4-d741-4537-b864-c0b4cf76a776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:22:44.814317 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e838a06-0077-4e4e-8403-1dffcfbd4203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:44.815114 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e838a06-0077-4e4e-8403-1dffcfbd4203 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:44.815399 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e838a06-0077-4e4e-8403-1dffcfbd4203 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:44.815673 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e838a06-0077-4e4e-8403-1dffcfbd4203 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:44.816864 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e838a06-0077-4e4e-8403-1dffcfbd4203 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:44.818376 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e838a06-0077-4e4e-8403-1dffcfbd4203 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:44.822154 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 25/53] 10.222.0.118 () {56 vars in 1113 bytes} [Thu Jul 14 15:22:44 2022] GET /identity/v3/domains/default => generated 200 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:22:44.826618 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e838a06-0077-4e4e-8403-1dffcfbd4203 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:44.896087 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:44.941411 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e838a06-0077-4e4e-8403-1dffcfbd4203 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:44.976959 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2d5e06-4606-443e-9e52-5182ccf949a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:44.977745 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2d5e06-4606-443e-9e52-5182ccf949a9 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:44.978132 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2d5e06-4606-443e-9e52-5182ccf949a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:44.978416 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2d5e06-4606-443e-9e52-5182ccf949a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:44.979274 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2d5e06-4606-443e-9e52-5182ccf949a9 None admin] RBAC: Adding query filter params (role.id=3b880cef7dcf4baf87b50f8610c0c56e, scope.domain.id=default, user.id=3c839799004e4bd49aeaeae2457a9c6b) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:22:44.979588 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2d5e06-4606-443e-9e52-5182ccf949a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:44.981073 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2d5e06-4606-443e-9e52-5182ccf949a9 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:44.983022 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 29/54] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:22:44 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:22:44.987197 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 26/55] 10.222.0.118 () {56 vars in 1327 bytes} [Thu Jul 14 15:22:44 2022] GET /identity/v3/role_assignments?user.id=3c839799004e4bd49aeaeae2457a9c6b&scope.domain.id=default&role.id=3b880cef7dcf4baf87b50f8610c0c56e => generated 532 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:22:45.007420 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fcb6c4-d741-4537-b864-c0b4cf76a776 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:45.092889 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:45.114364 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fcb6c4-d741-4537-b864-c0b4cf76a776 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:45.151171 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48577656-bd10-44a5-aeb9-bfc4d7bccfd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:45.151890 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48577656-bd10-44a5-aeb9-bfc4d7bccfd6 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:45.152175 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48577656-bd10-44a5-aeb9-bfc4d7bccfd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:45.152455 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48577656-bd10-44a5-aeb9-bfc4d7bccfd6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:45.153624 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48577656-bd10-44a5-aeb9-bfc4d7bccfd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:45.155153 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48577656-bd10-44a5-aeb9-bfc4d7bccfd6 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:45.156772 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 30/56] 10.222.0.118 () {56 vars in 1113 bytes} [Thu Jul 14 15:22:45 2022] GET /identity/v3/domains/default => generated 200 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:22:45.166801 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2d5e06-4606-443e-9e52-5182ccf949a9 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:45.280762 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2d5e06-4606-443e-9e52-5182ccf949a9 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:45.315209 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:45.327430 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75d72a4-78d6-4f0a-b91e-0781df610304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:45.328093 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75d72a4-78d6-4f0a-b91e-0781df610304 None admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:45.328377 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75d72a4-78d6-4f0a-b91e-0781df610304 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:45.328654 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75d72a4-78d6-4f0a-b91e-0781df610304 None admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:45.329398 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75d72a4-78d6-4f0a-b91e-0781df610304 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:45.330859 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75d72a4-78d6-4f0a-b91e-0781df610304 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:45.355576 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 27/57] 10.222.0.118 () {60 vars in 1145 bytes} [Thu Jul 14 15:22:45 2022] POST /identity/v3/projects => generated 299 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:22:47.404631 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9999cf-f74b-444e-8b6a-2c1132968172 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:47.405173 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9999cf-f74b-444e-8b6a-2c1132968172 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:47.405173 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9999cf-f74b-444e-8b6a-2c1132968172 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:47.406593 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 31/58] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:22:47 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:22:47.412484 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e300f2d5-780e-4255-92f0-ccfe0df4ce62 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:47.412907 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e300f2d5-780e-4255-92f0-ccfe0df4ce62 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:47.413047 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e300f2d5-780e-4255-92f0-ccfe0df4ce62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:47.430017 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-e300f2d5-780e-4255-92f0-ccfe0df4ce62 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:22:47.431248 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-e300f2d5-780e-4255-92f0-ccfe0df4ce62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:22:47.495970 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 28/59] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:22:47 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:22:47.521264 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9999cf-f74b-444e-8b6a-2c1132968172 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:47.621435 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9999cf-f74b-444e-8b6a-2c1132968172 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:47.654575 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52f84b6-d81b-405f-8c6f-8069d9318c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:47.655403 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52f84b6-d81b-405f-8c6f-8069d9318c44 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:47.655639 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52f84b6-d81b-405f-8c6f-8069d9318c44 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:47.655918 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52f84b6-d81b-405f-8c6f-8069d9318c44 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:47.657103 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52f84b6-d81b-405f-8c6f-8069d9318c44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:47.658609 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52f84b6-d81b-405f-8c6f-8069d9318c44 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:47.660232 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 32/60] 10.222.0.118 () {56 vars in 1113 bytes} [Thu Jul 14 15:22:47 2022] GET /identity/v3/domains/default => generated 200 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:22:47.666296 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e300f2d5-780e-4255-92f0-ccfe0df4ce62 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:47.765981 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e300f2d5-780e-4255-92f0-ccfe0df4ce62 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:47.773614 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:47.800380 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba572fad-53ae-4d63-8ced-5ec1b1ef57c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:47.801058 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba572fad-53ae-4d63-8ced-5ec1b1ef57c2 None admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:47.801340 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba572fad-53ae-4d63-8ced-5ec1b1ef57c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:47.801648 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba572fad-53ae-4d63-8ced-5ec1b1ef57c2 None admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:47.802409 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba572fad-53ae-4d63-8ced-5ec1b1ef57c2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:47.803864 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba572fad-53ae-4d63-8ced-5ec1b1ef57c2 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:47.828329 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 29/61] 10.222.0.118 () {60 vars in 1137 bytes} [Thu Jul 14 15:22:47 2022] POST /identity/v3/users => generated 276 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:22:51.044274 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d796b007-5fc9-49ac-a50b-81470c495134 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:51.045223 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d796b007-5fc9-49ac-a50b-81470c495134 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:51.045707 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d796b007-5fc9-49ac-a50b-81470c495134 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:51.047507 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 33/62] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:22:51 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:22:51.059264 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e089cc9-53b2-41a9-947d-cc52c4275418 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:51.060208 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e089cc9-53b2-41a9-947d-cc52c4275418 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:51.060718 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e089cc9-53b2-41a9-947d-cc52c4275418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:51.087253 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-7e089cc9-53b2-41a9-947d-cc52c4275418 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:22:51.088618 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-7e089cc9-53b2-41a9-947d-cc52c4275418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:22:51.180518 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24856f29-0bff-48d9-b2f9-a44cb39da35e None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:51.182072 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24856f29-0bff-48d9-b2f9-a44cb39da35e None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:51.183002 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24856f29-0bff-48d9-b2f9-a44cb39da35e None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:51.186883 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 34/63] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:22:51 2022] GET /identity => generated 271 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:22:51.196413 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1805e6ca-f8ad-48ab-b482-8b129702d778 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:51.197310 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1805e6ca-f8ad-48ab-b482-8b129702d778 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:51.198072 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1805e6ca-f8ad-48ab-b482-8b129702d778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:51.236654 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-1805e6ca-f8ad-48ab-b482-8b129702d778 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:22:51.237862 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-1805e6ca-f8ad-48ab-b482-8b129702d778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:22:51.240803 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 30/64] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:22:51 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:22:51.258362 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:51.331579 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e089cc9-53b2-41a9-947d-cc52c4275418 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:51.343651 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 35/65] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:22:51 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:22:51.345365 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc179013-3b3a-4b4a-9fde-1c51e629eea1 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:51.345940 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc179013-3b3a-4b4a-9fde-1c51e629eea1 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:51.346465 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc179013-3b3a-4b4a-9fde-1c51e629eea1 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:51.348244 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 36/66] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:22:51 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:22:51.354328 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beee928-51fc-4425-8fe4-1cd2fc688a50 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:51.354915 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beee928-51fc-4425-8fe4-1cd2fc688a50 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:51.355394 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beee928-51fc-4425-8fe4-1cd2fc688a50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:51.379297 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-3beee928-51fc-4425-8fe4-1cd2fc688a50 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:22:51.380796 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-3beee928-51fc-4425-8fe4-1cd2fc688a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:22:51.451246 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:51.458691 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 37/67] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:22:51 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 15:22:51.459585 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beee928-51fc-4425-8fe4-1cd2fc688a50 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:51.476590 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e089cc9-53b2-41a9-947d-cc52c4275418 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:51.527663 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbd8332-0f61-40f6-8bb0-26e289ebd3f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:51.528735 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd8332-0f61-40f6-8bb0-26e289ebd3f6 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:51.529066 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd8332-0f61-40f6-8bb0-26e289ebd3f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:51.529355 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd8332-0f61-40f6-8bb0-26e289ebd3f6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:51.543381 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbd8332-0f61-40f6-8bb0-26e289ebd3f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:22:51.554305 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-6fbd8332-0f61-40f6-8bb0-26e289ebd3f6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 15:22:51.554305 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:22:51.554305 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:22:51.554305 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:22:51.554305 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:22:51.554305 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:22:51.554305 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:22:51.554305 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:22:51.554305 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:22:51.554305 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:22:51.554305 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:22:51.554305 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:22:51.554305 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:22:51.554305 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:22:51.554305 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:22:51.554305 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:22:51.555327 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:22:51.555327 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:22:51.555327 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:22:51.555327 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:22:51.555327 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:22:51.555327 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:22:51.555327 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:22:51.555327 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:22:51.555327 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:22:51.555327 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:22:51.555327 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:22:51.555327 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:22:51.555327 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:22:51.555327 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:22:51.555327 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:22:51.555327 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:22:51.556085 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:22:51.556085 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:22:51.556085 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:22:51.556085 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:22:51.556085 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:22:51.556085 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:22:51.556085 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:22:51.556085 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:22:51.556085 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:22:51.556085 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:22:51.556085 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 15:22:51.556085 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:22:51.556085 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 31/68] 10.222.0.118 () {56 vars in 1104 bytes} [Thu Jul 14 15:22:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:22:51.557383 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbd8332-0f61-40f6-8bb0-26e289ebd3f6 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:51.570598 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:51.596267 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beee928-51fc-4425-8fe4-1cd2fc688a50 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:51.633633 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39eb373-b35c-40dd-a8f5-b40340d21878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:51.634471 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39eb373-b35c-40dd-a8f5-b40340d21878 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:51.634759 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39eb373-b35c-40dd-a8f5-b40340d21878 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:51.635038 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39eb373-b35c-40dd-a8f5-b40340d21878 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:51.646642 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39eb373-b35c-40dd-a8f5-b40340d21878 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:22:51.654346 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-e39eb373-b35c-40dd-a8f5-b40340d21878 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:22:51.654346 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:22:51.654346 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:22:51.654346 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:22:51.654346 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:22:51.654346 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:22:51.654346 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:22:51.654346 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:22:51.654346 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:22:51.654346 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:22:51.654346 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:22:51.654346 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:22:51.654346 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:22:51.654346 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:22:51.654346 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:22:51.654346 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:22:51.655167 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:22:51.655167 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:22:51.655167 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:22:51.655167 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:22:51.655167 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:22:51.655167 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:22:51.655167 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:22:51.655167 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:22:51.655167 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:22:51.655167 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:22:51.655167 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:22:51.655167 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:22:51.655167 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:22:51.655167 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:22:51.655167 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:22:51.655167 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:22:51.655903 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:22:51.655903 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:22:51.655903 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:22:51.655903 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:22:51.655903 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:22:51.655903 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:22:51.655903 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:22:51.655903 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:22:51.655903 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:22:51.655903 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:22:51.655903 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:22:51.655903 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:22:51.655903 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 38/69] 10.222.0.118 () {56 vars in 1101 bytes} [Thu Jul 14 15:22:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:22:51.656514 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39eb373-b35c-40dd-a8f5-b40340d21878 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:51.682341 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbd8332-0f61-40f6-8bb0-26e289ebd3f6 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:51.724040 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd782575-816a-4804-a049-0636b7661bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:51.724857 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd782575-816a-4804-a049-0636b7661bae None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:51.725135 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd782575-816a-4804-a049-0636b7661bae None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:51.725404 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd782575-816a-4804-a049-0636b7661bae None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:51.736363 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd782575-816a-4804-a049-0636b7661bae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:22:51.745358 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-bd782575-816a-4804-a049-0636b7661bae None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 15:22:51.745358 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:22:51.745358 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:22:51.745358 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:22:51.745358 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:22:51.745358 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:22:51.745358 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:22:51.745358 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:22:51.745358 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:22:51.745358 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:22:51.745358 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:22:51.745358 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:22:51.745358 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:22:51.745358 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:22:51.745358 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:22:51.745358 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:22:51.746225 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:22:51.746225 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:22:51.746225 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:22:51.746225 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:22:51.746225 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:22:51.746225 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:22:51.746225 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:22:51.746225 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:22:51.746225 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:22:51.746225 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:22:51.746225 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:22:51.746225 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:22:51.746225 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:22:51.746225 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:22:51.746225 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:22:51.746225 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:22:51.746969 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:22:51.746969 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:22:51.746969 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:22:51.746969 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:22:51.746969 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:22:51.746969 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:22:51.746969 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:22:51.746969 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:22:51.746969 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:22:51.746969 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:22:51.746969 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 15:22:51.746969 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:22:51.746969 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 32/70] 10.222.0.118 () {56 vars in 1119 bytes} [Thu Jul 14 15:22:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:22:51.748127 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6685591e-01ba-4749-9253-8e9017bd2c42 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:51.748127 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6685591e-01ba-4749-9253-8e9017bd2c42 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:51.748424 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6685591e-01ba-4749-9253-8e9017bd2c42 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:51.753370 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 33/71] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:22:51 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:22:51.753370 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6685591e-01ba-4749-9253-8e9017bd2c42 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:51.766320 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:51.773425 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39eb373-b35c-40dd-a8f5-b40340d21878 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:51.806557 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6401b858-eeb1-4272-8b7a-df2cd907d1e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:51.807221 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6401b858-eeb1-4272-8b7a-df2cd907d1e6 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:51.807508 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6401b858-eeb1-4272-8b7a-df2cd907d1e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:51.807786 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6401b858-eeb1-4272-8b7a-df2cd907d1e6 None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:51.808540 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6401b858-eeb1-4272-8b7a-df2cd907d1e6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:22:51.808852 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6401b858-eeb1-4272-8b7a-df2cd907d1e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:51.810263 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6401b858-eeb1-4272-8b7a-df2cd907d1e6 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:51.812499 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:51.819607 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 39/72] 10.222.0.118 () {56 vars in 1106 bytes} [Thu Jul 14 15:22:51 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:22:51.820875 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8697d2fc-5678-44d6-a32b-37922e26f755 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:51.821161 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8697d2fc-5678-44d6-a32b-37922e26f755 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:51.821440 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8697d2fc-5678-44d6-a32b-37922e26f755 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:51.822720 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 40/73] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:22:51 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:22:51.823429 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8697d2fc-5678-44d6-a32b-37922e26f755 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:51.861684 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6685591e-01ba-4749-9253-8e9017bd2c42 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:51.895625 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e4d06c-2178-4008-9ba7-d7f27be5c199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:51.896292 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e4d06c-2178-4008-9ba7-d7f27be5c199 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:51.896580 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e4d06c-2178-4008-9ba7-d7f27be5c199 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:51.896860 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e4d06c-2178-4008-9ba7-d7f27be5c199 None admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:51.897623 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e4d06c-2178-4008-9ba7-d7f27be5c199 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:22:51.897936 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e4d06c-2178-4008-9ba7-d7f27be5c199 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:51.899363 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e4d06c-2178-4008-9ba7-d7f27be5c199 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:51.907829 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 34/74] 10.222.0.118 () {56 vars in 1104 bytes} [Thu Jul 14 15:22:51 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:22:51.909033 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f997b8-d148-471e-ad4b-06f280e9b74f None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:51.909322 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f997b8-d148-471e-ad4b-06f280e9b74f None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:51.909692 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f997b8-d148-471e-ad4b-06f280e9b74f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:51.924910 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8697d2fc-5678-44d6-a32b-37922e26f755 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:51.925562 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-e2f997b8-d148-471e-ad4b-06f280e9b74f None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:22:51.927591 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-e2f997b8-d148-471e-ad4b-06f280e9b74f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:22:51.958590 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab489e7a-ce3d-4da3-bf33-27575bb62531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:51.959251 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab489e7a-ce3d-4da3-bf33-27575bb62531 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:51.959533 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab489e7a-ce3d-4da3-bf33-27575bb62531 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:51.959808 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab489e7a-ce3d-4da3-bf33-27575bb62531 None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:51.960563 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab489e7a-ce3d-4da3-bf33-27575bb62531 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:22:51.960870 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab489e7a-ce3d-4da3-bf33-27575bb62531 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:51.962277 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab489e7a-ce3d-4da3-bf33-27575bb62531 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:51.970067 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 41/75] 10.222.0.118 () {56 vars in 1116 bytes} [Thu Jul 14 15:22:51 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:22:51.970839 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab489e7a-ce3d-4da3-bf33-27575bb62531 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:51.992859 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 35/76] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:22:51 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:22:51.994158 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e69a37-e0a8-4499-8a9b-85ec5c4a9bdb None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:51.994444 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e69a37-e0a8-4499-8a9b-85ec5c4a9bdb None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:51.994715 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e69a37-e0a8-4499-8a9b-85ec5c4a9bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:52.000909 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:52.013295 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-60e69a37-e0a8-4499-8a9b-85ec5c4a9bdb None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:22:52.014668 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-60e69a37-e0a8-4499-8a9b-85ec5c4a9bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:22:52.031623 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:52.073793 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab489e7a-ce3d-4da3-bf33-27575bb62531 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:52.079282 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 36/77] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:22:51 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:22:52.080123 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e69a37-e0a8-4499-8a9b-85ec5c4a9bdb None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:52.108450 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b7afb0-889d-4688-909c-c0925eefcea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:52.109407 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b7afb0-889d-4688-909c-c0925eefcea6 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:52.109779 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b7afb0-889d-4688-909c-c0925eefcea6 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:52.110222 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b7afb0-889d-4688-909c-c0925eefcea6 None admin] PATH_INFO: `/v3/users/59bb0f609774438d83c9741c52519818` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:52.125679 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b7afb0-889d-4688-909c-c0925eefcea6 None admin] RBAC: Authorizing `identity:get_user(user_id=59bb0f609774438d83c9741c52519818)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:52.127197 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b7afb0-889d-4688-909c-c0925eefcea6 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:52.128951 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 42/78] 10.222.0.118 () {56 vars in 1182 bytes} [Thu Jul 14 15:22:51 2022] GET /identity/v3/users/59bb0f609774438d83c9741c52519818 => generated 276 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:22:52.133263 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b7afb0-889d-4688-909c-c0925eefcea6 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:52.182679 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e69a37-e0a8-4499-8a9b-85ec5c4a9bdb None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:52.227828 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60402b3-9a65-49fe-b191-a8e166a0c56f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:52.228842 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60402b3-9a65-49fe-b191-a8e166a0c56f None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:52.229127 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60402b3-9a65-49fe-b191-a8e166a0c56f None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:52.229407 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60402b3-9a65-49fe-b191-a8e166a0c56f None admin] PATH_INFO: `/v3/users/3c839799004e4bd49aeaeae2457a9c6b` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:52.230613 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60402b3-9a65-49fe-b191-a8e166a0c56f None admin] RBAC: Authorizing `identity:get_user(user_id=3c839799004e4bd49aeaeae2457a9c6b)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:52.231565 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b7afb0-889d-4688-909c-c0925eefcea6 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:52.232095 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60402b3-9a65-49fe-b191-a8e166a0c56f None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:52.233750 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 37/79] 10.222.0.118 () {56 vars in 1182 bytes} [Thu Jul 14 15:22:52 2022] GET /identity/v3/users/3c839799004e4bd49aeaeae2457a9c6b => generated 248 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:22:52.236888 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60402b3-9a65-49fe-b191-a8e166a0c56f None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:52.237391 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:52.251405 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:52.268815 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d535eb-1c1c-4503-8104-1b2793149b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:52.269690 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d535eb-1c1c-4503-8104-1b2793149b41 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:52.269995 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d535eb-1c1c-4503-8104-1b2793149b41 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:52.270301 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d535eb-1c1c-4503-8104-1b2793149b41 None admin] PATH_INFO: `/v3/users/59bb0f609774438d83c9741c52519818` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:52.272228 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d535eb-1c1c-4503-8104-1b2793149b41 None admin] RBAC: Authorizing `identity:get_user(user_id=59bb0f609774438d83c9741c52519818)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:52.273697 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d535eb-1c1c-4503-8104-1b2793149b41 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:52.275522 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 43/80] 10.222.0.118 () {56 vars in 1182 bytes} [Thu Jul 14 15:22:52 2022] GET /identity/v3/users/59bb0f609774438d83c9741c52519818 => generated 276 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:22:52.276513 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d535eb-1c1c-4503-8104-1b2793149b41 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:52.335380 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60402b3-9a65-49fe-b191-a8e166a0c56f None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:52.369104 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b3a961-2108-4bd0-a66b-eee88bbd76a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:52.369891 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b3a961-2108-4bd0-a66b-eee88bbd76a0 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:52.370197 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b3a961-2108-4bd0-a66b-eee88bbd76a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:52.370470 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b3a961-2108-4bd0-a66b-eee88bbd76a0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:52.375916 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d535eb-1c1c-4503-8104-1b2793149b41 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:52.380884 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b3a961-2108-4bd0-a66b-eee88bbd76a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:22:52.388549 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-b0b3a961-2108-4bd0-a66b-eee88bbd76a0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 15:22:52.388549 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:22:52.388549 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:22:52.388549 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:22:52.388549 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:22:52.388549 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:22:52.388549 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:22:52.388549 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:22:52.388549 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:22:52.388549 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:22:52.388549 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:22:52.388549 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:22:52.388549 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:22:52.388549 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:22:52.388549 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:22:52.388549 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:22:52.389417 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:22:52.389417 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:22:52.389417 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:22:52.389417 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:22:52.389417 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:22:52.389417 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:22:52.389417 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:22:52.389417 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:22:52.389417 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:22:52.389417 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:22:52.389417 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:22:52.389417 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:22:52.389417 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:22:52.389417 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:22:52.389417 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:22:52.389417 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:22:52.390238 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:22:52.390238 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:22:52.390238 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:22:52.390238 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:22:52.390238 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:22:52.390238 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:22:52.390238 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:22:52.390238 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:22:52.390238 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:22:52.390238 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:22:52.390238 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 15:22:52.390238 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:22:52.390238 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 38/81] 10.222.0.118 () {56 vars in 1104 bytes} [Thu Jul 14 15:22:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:22:52.390868 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b3a961-2108-4bd0-a66b-eee88bbd76a0 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:52.413382 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03470d2-2dc5-4cd4-855f-aefe7819205b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:52.414209 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03470d2-2dc5-4cd4-855f-aefe7819205b None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:52.414494 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03470d2-2dc5-4cd4-855f-aefe7819205b None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:52.414773 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03470d2-2dc5-4cd4-855f-aefe7819205b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:52.415965 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03470d2-2dc5-4cd4-855f-aefe7819205b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:52.417429 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03470d2-2dc5-4cd4-855f-aefe7819205b None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:52.419097 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 44/82] 10.222.0.118 () {56 vars in 1113 bytes} [Thu Jul 14 15:22:52 2022] GET /identity/v3/domains/default => generated 200 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:22:52.419863 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03470d2-2dc5-4cd4-855f-aefe7819205b None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:52.457854 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:52.474617 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:52.498711 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b3a961-2108-4bd0-a66b-eee88bbd76a0 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:52.524819 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03470d2-2dc5-4cd4-855f-aefe7819205b None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:52.532219 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f047cc4c-5e09-444c-914e-9ff3a49d0025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:52.532871 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f047cc4c-5e09-444c-914e-9ff3a49d0025 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:52.533155 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f047cc4c-5e09-444c-914e-9ff3a49d0025 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:52.533434 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f047cc4c-5e09-444c-914e-9ff3a49d0025 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:52.558053 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3e388a-8e5d-4fa3-862e-c0e165b83171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:52.558710 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e388a-8e5d-4fa3-862e-c0e165b83171 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:52.558976 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e388a-8e5d-4fa3-862e-c0e165b83171 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:52.559248 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e388a-8e5d-4fa3-862e-c0e165b83171 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:52.599598 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f047cc4c-5e09-444c-914e-9ff3a49d0025 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:52.601127 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f047cc4c-5e09-444c-914e-9ff3a49d0025 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:52.626369 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3e388a-8e5d-4fa3-862e-c0e165b83171 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:52.627772 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3e388a-8e5d-4fa3-862e-c0e165b83171 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:52.660526 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:52.682809 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:52.701088 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 39/83] 10.222.0.118 () {58 vars in 1287 bytes} [Thu Jul 14 15:22:52 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 15:22:52.701931 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f047cc4c-5e09-444c-914e-9ff3a49d0025 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:52.731239 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 45/84] 10.222.0.118 () {58 vars in 1287 bytes} [Thu Jul 14 15:22:52 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 15:22:52.732088 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3e388a-8e5d-4fa3-862e-c0e165b83171 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:52.799365 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f047cc4c-5e09-444c-914e-9ff3a49d0025 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:52.833342 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32763003-8eda-4e0a-955f-c94893ce2846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:52.834019 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32763003-8eda-4e0a-955f-c94893ce2846 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:52.834305 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32763003-8eda-4e0a-955f-c94893ce2846 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:52.834582 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32763003-8eda-4e0a-955f-c94893ce2846 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:52.834692 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3e388a-8e5d-4fa3-862e-c0e165b83171 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:52.865508 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:52.874421 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e46fc8-3138-49fc-9c01-ca9dfdafd539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:52.875101 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e46fc8-3138-49fc-9c01-ca9dfdafd539 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:52.875382 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e46fc8-3138-49fc-9c01-ca9dfdafd539 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:52.875710 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e46fc8-3138-49fc-9c01-ca9dfdafd539 None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:52.876520 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e46fc8-3138-49fc-9c01-ca9dfdafd539 None admin] RBAC: Adding query filter params (name=member) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:22:52.876774 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e46fc8-3138-49fc-9c01-ca9dfdafd539 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:52.878240 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e46fc8-3138-49fc-9c01-ca9dfdafd539 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:52.887578 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 46/85] 10.222.0.118 () {56 vars in 1106 bytes} [Thu Jul 14 15:22:52 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:22:52.888363 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e46fc8-3138-49fc-9c01-ca9dfdafd539 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:52.906807 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:52.908098 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32763003-8eda-4e0a-955f-c94893ce2846 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:52.909518 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32763003-8eda-4e0a-955f-c94893ce2846 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:52.988630 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e46fc8-3138-49fc-9c01-ca9dfdafd539 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:53.009536 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 40/86] 10.222.0.118 () {58 vars in 1287 bytes} [Thu Jul 14 15:22:52 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 15:22:53.010420 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32763003-8eda-4e0a-955f-c94893ce2846 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:53.022918 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b5485a-b802-481d-8622-0c4961a01112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:53.023595 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b5485a-b802-481d-8622-0c4961a01112 None admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:53.023877 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b5485a-b802-481d-8622-0c4961a01112 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:53.024177 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b5485a-b802-481d-8622-0c4961a01112 None admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:53.024903 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b5485a-b802-481d-8622-0c4961a01112 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:53.026382 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b5485a-b802-481d-8622-0c4961a01112 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:53.052959 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 47/87] 10.222.0.118 () {60 vars in 1137 bytes} [Thu Jul 14 15:22:52 2022] POST /identity/v3/users => generated 290 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:22:53.053790 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b5485a-b802-481d-8622-0c4961a01112 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:53.089941 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:53.134280 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:53.139076 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32763003-8eda-4e0a-955f-c94893ce2846 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:53.169029 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b5485a-b802-481d-8622-0c4961a01112 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:53.177778 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0f1fa0-da92-4cce-a3cf-9ad05444a5e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:53.178700 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0f1fa0-da92-4cce-a3cf-9ad05444a5e2 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:53.178984 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0f1fa0-da92-4cce-a3cf-9ad05444a5e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:53.179262 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0f1fa0-da92-4cce-a3cf-9ad05444a5e2 None admin] PATH_INFO: `/v3/projects/a99d762a7cad4fc1ac87113f5b01b5b2` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:53.180545 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0f1fa0-da92-4cce-a3cf-9ad05444a5e2 None admin] RBAC: Authorizing `identity:get_project(project_id=a99d762a7cad4fc1ac87113f5b01b5b2)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:53.182080 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0f1fa0-da92-4cce-a3cf-9ad05444a5e2 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:53.188755 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 41/88] 10.222.0.118 () {56 vars in 1191 bytes} [Thu Jul 14 15:22:53 2022] GET /identity/v3/projects/a99d762a7cad4fc1ac87113f5b01b5b2 => generated 299 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:22:53.188755 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0f1fa0-da92-4cce-a3cf-9ad05444a5e2 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:53.216371 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1fc58b-9a9f-420d-b014-ddfa351c8b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:53.217447 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1fc58b-9a9f-420d-b014-ddfa351c8b4f None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:53.217553 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1fc58b-9a9f-420d-b014-ddfa351c8b4f None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:53.217793 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1fc58b-9a9f-420d-b014-ddfa351c8b4f None admin] PATH_INFO: `/v3/projects/a99d762a7cad4fc1ac87113f5b01b5b2` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:53.219063 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1fc58b-9a9f-420d-b014-ddfa351c8b4f None admin] RBAC: Authorizing `identity:get_project(project_id=a99d762a7cad4fc1ac87113f5b01b5b2)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:53.221945 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1fc58b-9a9f-420d-b014-ddfa351c8b4f None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:53.223048 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 48/89] 10.222.0.118 () {56 vars in 1191 bytes} [Thu Jul 14 15:22:53 2022] GET /identity/v3/projects/a99d762a7cad4fc1ac87113f5b01b5b2 => generated 299 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:22:53.224244 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1fc58b-9a9f-420d-b014-ddfa351c8b4f None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:53.310018 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0f1fa0-da92-4cce-a3cf-9ad05444a5e2 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:53.346679 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:53.355718 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62735ef7-a685-4890-a1e0-862325a62503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:53.355898 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1fc58b-9a9f-420d-b014-ddfa351c8b4f None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:53.356610 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62735ef7-a685-4890-a1e0-862325a62503 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:53.356897 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62735ef7-a685-4890-a1e0-862325a62503 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:53.357181 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62735ef7-a685-4890-a1e0-862325a62503 None admin] PATH_INFO: `/v3/users/59bb0f609774438d83c9741c52519818` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:53.358430 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62735ef7-a685-4890-a1e0-862325a62503 None admin] RBAC: Authorizing `identity:get_user(user_id=59bb0f609774438d83c9741c52519818)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:53.359906 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62735ef7-a685-4890-a1e0-862325a62503 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:53.361563 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 42/90] 10.222.0.118 () {56 vars in 1182 bytes} [Thu Jul 14 15:22:53 2022] GET /identity/v3/users/59bb0f609774438d83c9741c52519818 => generated 276 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:22:53.362478 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62735ef7-a685-4890-a1e0-862325a62503 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:53.398464 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5d05a2-16a7-49fe-a852-e4daf199e93b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:53.399329 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5d05a2-16a7-49fe-a852-e4daf199e93b None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:53.399609 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5d05a2-16a7-49fe-a852-e4daf199e93b None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:53.399881 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5d05a2-16a7-49fe-a852-e4daf199e93b None admin] PATH_INFO: `/v3/projects/a99d762a7cad4fc1ac87113f5b01b5b2` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:53.401071 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5d05a2-16a7-49fe-a852-e4daf199e93b None admin] RBAC: Authorizing `identity:get_project(project_id=a99d762a7cad4fc1ac87113f5b01b5b2)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:53.402570 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5d05a2-16a7-49fe-a852-e4daf199e93b None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:53.404270 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 49/91] 10.222.0.118 () {56 vars in 1191 bytes} [Thu Jul 14 15:22:53 2022] GET /identity/v3/projects/a99d762a7cad4fc1ac87113f5b01b5b2 => generated 299 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:22:53.405025 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5d05a2-16a7-49fe-a852-e4daf199e93b None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:53.416498 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:53.496422 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62735ef7-a685-4890-a1e0-862325a62503 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:53.522009 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5d05a2-16a7-49fe-a852-e4daf199e93b None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:53.533025 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf90065-c663-481e-87f6-1992d9b267c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:53.533790 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf90065-c663-481e-87f6-1992d9b267c1 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:53.534169 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf90065-c663-481e-87f6-1992d9b267c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:53.534449 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf90065-c663-481e-87f6-1992d9b267c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:53.535289 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf90065-c663-481e-87f6-1992d9b267c1 None admin] RBAC: Adding query filter params (role.id=4abcf5e5e7cd4b53ae1828fec6550d53, scope.project.id=a99d762a7cad4fc1ac87113f5b01b5b2, user.id=59bb0f609774438d83c9741c52519818) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:22:53.535604 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf90065-c663-481e-87f6-1992d9b267c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:53.537302 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf90065-c663-481e-87f6-1992d9b267c1 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:53.543546 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 43/92] 10.222.0.118 () {56 vars in 1379 bytes} [Thu Jul 14 15:22:53 2022] GET /identity/v3/role_assignments?user.id=59bb0f609774438d83c9741c52519818&scope.project.id=a99d762a7cad4fc1ac87113f5b01b5b2&role.id=4abcf5e5e7cd4b53ae1828fec6550d53 => generated 260 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:22:53.544355 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf90065-c663-481e-87f6-1992d9b267c1 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:53.559726 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a054d56e-c5f9-43ab-9d38-0f69e17fce0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:53.560391 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a054d56e-c5f9-43ab-9d38-0f69e17fce0f None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:53.560834 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a054d56e-c5f9-43ab-9d38-0f69e17fce0f None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:53.561110 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a054d56e-c5f9-43ab-9d38-0f69e17fce0f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:53.562453 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a054d56e-c5f9-43ab-9d38-0f69e17fce0f None admin] RBAC: Adding query filter params (role.id=3b880cef7dcf4baf87b50f8610c0c56e, scope.project.id=a99d762a7cad4fc1ac87113f5b01b5b2, user.id=3c839799004e4bd49aeaeae2457a9c6b) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:22:53.563028 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a054d56e-c5f9-43ab-9d38-0f69e17fce0f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:53.564650 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a054d56e-c5f9-43ab-9d38-0f69e17fce0f None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:53.574698 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 50/93] 10.222.0.118 () {56 vars in 1379 bytes} [Thu Jul 14 15:22:53 2022] GET /identity/v3/role_assignments?user.id=3c839799004e4bd49aeaeae2457a9c6b&scope.project.id=a99d762a7cad4fc1ac87113f5b01b5b2&role.id=3b880cef7dcf4baf87b50f8610c0c56e => generated 260 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:22:53.575582 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a054d56e-c5f9-43ab-9d38-0f69e17fce0f None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:53.662652 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:53.667134 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:53.705922 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a054d56e-c5f9-43ab-9d38-0f69e17fce0f None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:53.753218 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4079d83-7ad2-4589-a543-628957292c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:53.754143 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4079d83-7ad2-4589-a543-628957292c62 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:53.754424 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4079d83-7ad2-4589-a543-628957292c62 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:53.754732 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4079d83-7ad2-4589-a543-628957292c62 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:53.756446 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4079d83-7ad2-4589-a543-628957292c62 None admin] RBAC: Adding query filter params (role.id=f4e85c621e6d4e749149099dd9303934, scope.project.id=a99d762a7cad4fc1ac87113f5b01b5b2, user.id=59bb0f609774438d83c9741c52519818) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:22:53.756921 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4079d83-7ad2-4589-a543-628957292c62 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:53.758445 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4079d83-7ad2-4589-a543-628957292c62 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:53.765408 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 51/94] 10.222.0.118 () {56 vars in 1379 bytes} [Thu Jul 14 15:22:53 2022] GET /identity/v3/role_assignments?user.id=59bb0f609774438d83c9741c52519818&scope.project.id=a99d762a7cad4fc1ac87113f5b01b5b2&role.id=f4e85c621e6d4e749149099dd9303934 => generated 260 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:22:53.777297 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf90065-c663-481e-87f6-1992d9b267c1 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:53.832367 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621cece4-b3ed-4c6c-b145-5fdfee11bdbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:53.833167 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621cece4-b3ed-4c6c-b145-5fdfee11bdbb None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:53.833447 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621cece4-b3ed-4c6c-b145-5fdfee11bdbb None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:53.833721 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621cece4-b3ed-4c6c-b145-5fdfee11bdbb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:53.939952 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621cece4-b3ed-4c6c-b145-5fdfee11bdbb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:53.941388 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621cece4-b3ed-4c6c-b145-5fdfee11bdbb None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:54.010094 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:54.061217 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 44/95] 10.222.0.118 () {58 vars in 1287 bytes} [Thu Jul 14 15:22:53 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 15:22:54.066844 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4079d83-7ad2-4589-a543-628957292c62 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:54.188401 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4079d83-7ad2-4589-a543-628957292c62 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:54.223608 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4742a72d-f84f-4515-a40c-7d0503734fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:54.224477 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4742a72d-f84f-4515-a40c-7d0503734fa4 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:54.224761 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4742a72d-f84f-4515-a40c-7d0503734fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:54.225035 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4742a72d-f84f-4515-a40c-7d0503734fa4 None admin] PATH_INFO: `/v3/projects/2e878702c372449a92bd192b66f2b3a3` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:54.226268 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4742a72d-f84f-4515-a40c-7d0503734fa4 None admin] RBAC: Authorizing `identity:get_project(project_id=2e878702c372449a92bd192b66f2b3a3)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:54.227734 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4742a72d-f84f-4515-a40c-7d0503734fa4 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:54.229629 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 52/96] 10.222.0.118 () {56 vars in 1191 bytes} [Thu Jul 14 15:22:54 2022] GET /identity/v3/projects/2e878702c372449a92bd192b66f2b3a3 => generated 313 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:22:54.235621 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621cece4-b3ed-4c6c-b145-5fdfee11bdbb None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:54.339048 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621cece4-b3ed-4c6c-b145-5fdfee11bdbb None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:54.374693 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5228151-53ca-4617-803d-7ae72a4ecb46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:54.375354 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5228151-53ca-4617-803d-7ae72a4ecb46 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:54.375632 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5228151-53ca-4617-803d-7ae72a4ecb46 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:54.375908 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5228151-53ca-4617-803d-7ae72a4ecb46 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:54.376750 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5228151-53ca-4617-803d-7ae72a4ecb46 None admin] RBAC: Adding query filter params (role.id=4abcf5e5e7cd4b53ae1828fec6550d53, scope.project.id=2e878702c372449a92bd192b66f2b3a3, user.id=59bb0f609774438d83c9741c52519818) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:22:54.377112 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5228151-53ca-4617-803d-7ae72a4ecb46 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:54.378666 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5228151-53ca-4617-803d-7ae72a4ecb46 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:54.385954 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 45/97] 10.222.0.118 () {56 vars in 1379 bytes} [Thu Jul 14 15:22:54 2022] GET /identity/v3/role_assignments?user.id=59bb0f609774438d83c9741c52519818&scope.project.id=2e878702c372449a92bd192b66f2b3a3&role.id=4abcf5e5e7cd4b53ae1828fec6550d53 => generated 260 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:22:55.730161 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e44fdb-9ef9-4231-b6ff-f1f64df6b02c None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:55.730580 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e44fdb-9ef9-4231-b6ff-f1f64df6b02c None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:55.730757 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e44fdb-9ef9-4231-b6ff-f1f64df6b02c None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:55.732240 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 53/98] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:22:55 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:22:55.740340 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e114776-2584-4a1b-b79e-3a7a91fa8f52 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:55.741157 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e114776-2584-4a1b-b79e-3a7a91fa8f52 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:55.741624 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e114776-2584-4a1b-b79e-3a7a91fa8f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:55.765322 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-4e114776-2584-4a1b-b79e-3a7a91fa8f52 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:22:55.766876 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-4e114776-2584-4a1b-b79e-3a7a91fa8f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:22:55.792434 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:55.846922 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 46/99] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:22:55 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:22:55.870208 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e44fdb-9ef9-4231-b6ff-f1f64df6b02c None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:55.874111 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:55.976603 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e44fdb-9ef9-4231-b6ff-f1f64df6b02c None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:56.011480 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5a48a2-bbb0-405d-81d3-131ac768453d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:56.012290 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5a48a2-bbb0-405d-81d3-131ac768453d None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:56.012703 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5a48a2-bbb0-405d-81d3-131ac768453d None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:56.012977 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5a48a2-bbb0-405d-81d3-131ac768453d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:56.024262 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5a48a2-bbb0-405d-81d3-131ac768453d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:22:56.031874 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-2c5a48a2-bbb0-405d-81d3-131ac768453d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 15:22:56.031874 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:22:56.031874 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:22:56.031874 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:22:56.031874 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:22:56.031874 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:22:56.031874 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:22:56.031874 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:22:56.031874 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:22:56.031874 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:22:56.031874 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:22:56.031874 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:22:56.031874 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:22:56.031874 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:22:56.031874 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:22:56.031874 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:22:56.032706 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:22:56.032706 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:22:56.032706 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:22:56.032706 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:22:56.032706 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:22:56.032706 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:22:56.032706 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:22:56.032706 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:22:56.032706 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:22:56.032706 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:22:56.032706 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:22:56.032706 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:22:56.032706 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:22:56.032706 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:22:56.032706 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:22:56.032706 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:22:56.033434 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:22:56.033434 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:22:56.033434 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:22:56.033434 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:22:56.033434 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:22:56.033434 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:22:56.033434 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:22:56.033434 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:22:56.033434 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:22:56.033434 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:22:56.033434 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 15:22:56.033434 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:22:56.033434 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 54/100] 10.222.0.118 () {56 vars in 1104 bytes} [Thu Jul 14 15:22:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:22:56.039057 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e114776-2584-4a1b-b79e-3a7a91fa8f52 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:56.139739 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e114776-2584-4a1b-b79e-3a7a91fa8f52 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:56.174229 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4b0ca3-2881-4a68-b4af-03d69757ee34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:56.174903 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4b0ca3-2881-4a68-b4af-03d69757ee34 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:56.175184 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4b0ca3-2881-4a68-b4af-03d69757ee34 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:56.175458 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4b0ca3-2881-4a68-b4af-03d69757ee34 None admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:56.176211 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4b0ca3-2881-4a68-b4af-03d69757ee34 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:22:56.176582 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4b0ca3-2881-4a68-b4af-03d69757ee34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:56.177998 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4b0ca3-2881-4a68-b4af-03d69757ee34 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:56.186331 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 47/101] 10.222.0.118 () {56 vars in 1106 bytes} [Thu Jul 14 15:22:56 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:22:56.192519 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5a48a2-bbb0-405d-81d3-131ac768453d None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:56.257151 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:56.295533 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5a48a2-bbb0-405d-81d3-131ac768453d None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:56.335997 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c766aef-ec00-4368-bccd-9770110f47c7 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:56.336305 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c766aef-ec00-4368-bccd-9770110f47c7 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:56.336549 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c766aef-ec00-4368-bccd-9770110f47c7 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:56.337927 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 48/102] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:22:56 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 14 15:22:56.338359 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18828678-5847-410a-8776-322f6eb8f1e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:56.339229 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18828678-5847-410a-8776-322f6eb8f1e7 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:56.339505 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18828678-5847-410a-8776-322f6eb8f1e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:56.339776 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18828678-5847-410a-8776-322f6eb8f1e7 None admin] PATH_INFO: `/v3/users/345265699b4e46cfbcf188bfe47c22fa` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:56.343228 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de433b34-c697-424d-aa6c-31bcefe589b0 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:56.343507 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de433b34-c697-424d-aa6c-31bcefe589b0 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:56.343775 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de433b34-c697-424d-aa6c-31bcefe589b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:56.370433 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-de433b34-c697-424d-aa6c-31bcefe589b0 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:22:56.371663 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-de433b34-c697-424d-aa6c-31bcefe589b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:22:56.378876 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18828678-5847-410a-8776-322f6eb8f1e7 None admin] RBAC: Authorizing `identity:get_user(user_id=345265699b4e46cfbcf188bfe47c22fa)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:56.381536 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18828678-5847-410a-8776-322f6eb8f1e7 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:56.383540 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 55/103] 10.222.0.118 () {56 vars in 1182 bytes} [Thu Jul 14 15:22:56 2022] GET /identity/v3/users/345265699b4e46cfbcf188bfe47c22fa => generated 290 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:22:56.389683 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18828678-5847-410a-8776-322f6eb8f1e7 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:56.398328 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:56.547822 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18828678-5847-410a-8776-322f6eb8f1e7 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:56.555348 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 49/104] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:22:56 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 15:22:56.583184 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52384712-e6cb-4916-b5e0-05151f021f44 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:56.583534 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52384712-e6cb-4916-b5e0-05151f021f44 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:56.583753 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52384712-e6cb-4916-b5e0-05151f021f44 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:56.589378 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 50/105] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:22:56 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:22:56.589726 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:56.590917 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fecff81-0533-4721-95f6-9a2f2a3b4a71 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:56.591212 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fecff81-0533-4721-95f6-9a2f2a3b4a71 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:56.591493 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fecff81-0533-4721-95f6-9a2f2a3b4a71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:56.604040 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c18388-ab38-4e15-99e9-276e1e541aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:56.604703 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c18388-ab38-4e15-99e9-276e1e541aca None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:56.604982 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c18388-ab38-4e15-99e9-276e1e541aca None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:56.605254 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c18388-ab38-4e15-99e9-276e1e541aca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:56.608738 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-0fecff81-0533-4721-95f6-9a2f2a3b4a71 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:22:56.609945 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-0fecff81-0533-4721-95f6-9a2f2a3b4a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:22:56.726111 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 51/106] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:22:56 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 15:22:56.727225 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fecff81-0533-4721-95f6-9a2f2a3b4a71 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:56.753477 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c18388-ab38-4e15-99e9-276e1e541aca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:56.756472 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c18388-ab38-4e15-99e9-276e1e541aca None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:56.820493 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:56.848791 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fecff81-0533-4721-95f6-9a2f2a3b4a71 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:56.879941 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 56/107] 10.222.0.118 () {58 vars in 1287 bytes} [Thu Jul 14 15:22:56 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 15:22:56.881850 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dac217-c602-4ed9-8df5-8d2384465ab8 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:56.882484 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dac217-c602-4ed9-8df5-8d2384465ab8 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:56.882958 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dac217-c602-4ed9-8df5-8d2384465ab8 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:56.884481 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 57/108] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:22:56 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:22:56.885450 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dac217-c602-4ed9-8df5-8d2384465ab8 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:56.897993 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8443287-0153-4361-8651-a145342c5de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:56.897993 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8443287-0153-4361-8651-a145342c5de7 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:56.897993 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8443287-0153-4361-8651-a145342c5de7 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:56.897993 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8443287-0153-4361-8651-a145342c5de7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:56.898360 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8443287-0153-4361-8651-a145342c5de7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:56.898360 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8443287-0153-4361-8651-a145342c5de7 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:56.898360 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 52/109] 10.222.0.118 () {56 vars in 1113 bytes} [Thu Jul 14 15:22:56 2022] GET /identity/v3/domains/default => generated 200 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:22:56.899048 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8443287-0153-4361-8651-a145342c5de7 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:56.916376 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:57.016780 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8443287-0153-4361-8651-a145342c5de7 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:57.022242 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dac217-c602-4ed9-8df5-8d2384465ab8 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:57.057621 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab42ea2a-ea3a-4631-8825-ef3758ca3bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:57.059391 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab42ea2a-ea3a-4631-8825-ef3758ca3bc7 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:57.059670 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab42ea2a-ea3a-4631-8825-ef3758ca3bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:57.059942 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab42ea2a-ea3a-4631-8825-ef3758ca3bc7 None admin] PATH_INFO: `/v3/projects/a99d762a7cad4fc1ac87113f5b01b5b2` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:57.062954 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab42ea2a-ea3a-4631-8825-ef3758ca3bc7 None admin] RBAC: Authorizing `identity:get_project(project_id=a99d762a7cad4fc1ac87113f5b01b5b2)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:57.065279 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab42ea2a-ea3a-4631-8825-ef3758ca3bc7 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:57.073336 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 53/110] 10.222.0.118 () {56 vars in 1191 bytes} [Thu Jul 14 15:22:56 2022] GET /identity/v3/projects/a99d762a7cad4fc1ac87113f5b01b5b2 => generated 299 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:22:57.073336 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d428fe-2aef-4f87-a367-c7debf1272ba None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:57.073336 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d428fe-2aef-4f87-a367-c7debf1272ba None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:57.073336 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d428fe-2aef-4f87-a367-c7debf1272ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:57.081771 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b303ded7-577a-4006-b2dd-8d138271fd6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:57.082959 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b303ded7-577a-4006-b2dd-8d138271fd6d None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:57.083437 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b303ded7-577a-4006-b2dd-8d138271fd6d None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:57.083904 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b303ded7-577a-4006-b2dd-8d138271fd6d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:57.091847 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-b3d428fe-2aef-4f87-a367-c7debf1272ba None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:22:57.093202 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-b3d428fe-2aef-4f87-a367-c7debf1272ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:22:57.097628 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b303ded7-577a-4006-b2dd-8d138271fd6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:22:57.104216 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:57.108551 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-b303ded7-577a-4006-b2dd-8d138271fd6d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:22:57.108551 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:22:57.108551 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:22:57.108551 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:22:57.108551 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:22:57.108551 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:22:57.108551 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:22:57.108551 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:22:57.108551 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:22:57.108551 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:22:57.108551 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:22:57.108551 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:22:57.108551 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:22:57.108551 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:22:57.108551 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:22:57.108551 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:22:57.109388 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:22:57.109388 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:22:57.109388 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:22:57.109388 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:22:57.109388 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:22:57.109388 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:22:57.109388 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:22:57.109388 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:22:57.109388 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:22:57.109388 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:22:57.109388 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:22:57.109388 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:22:57.109388 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:22:57.109388 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:22:57.109388 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:22:57.109388 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:22:57.110155 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:22:57.110155 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:22:57.110155 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:22:57.110155 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:22:57.110155 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:22:57.110155 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:22:57.110155 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:22:57.110155 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:22:57.110155 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:22:57.110155 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:22:57.110155 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:22:57.110155 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:22:57.111366 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 58/111] 10.222.0.118 () {56 vars in 1101 bytes} [Thu Jul 14 15:22:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:22:57.112706 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b303ded7-577a-4006-b2dd-8d138271fd6d None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:57.176192 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 54/112] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:22:57 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:22:57.186814 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d428fe-2aef-4f87-a367-c7debf1272ba None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:57.218148 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:57.237736 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b303ded7-577a-4006-b2dd-8d138271fd6d None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:57.274783 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1918cff2-3df6-48cf-9d50-e87848b4e387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:57.275736 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1918cff2-3df6-48cf-9d50-e87848b4e387 None admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:57.276017 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1918cff2-3df6-48cf-9d50-e87848b4e387 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:57.276280 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1918cff2-3df6-48cf-9d50-e87848b4e387 None admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:57.276996 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1918cff2-3df6-48cf-9d50-e87848b4e387 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:57.278482 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1918cff2-3df6-48cf-9d50-e87848b4e387 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:57.308018 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 59/113] 10.222.0.118 () {60 vars in 1146 bytes} [Thu Jul 14 15:22:57 2022] POST /identity/v3/projects => generated 303 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:22:57.308662 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1918cff2-3df6-48cf-9d50-e87848b4e387 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:57.315616 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d428fe-2aef-4f87-a367-c7debf1272ba None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:57.367952 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b47ace-5508-4250-9ef1-c51435634cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:57.369312 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b47ace-5508-4250-9ef1-c51435634cfb None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:57.370269 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b47ace-5508-4250-9ef1-c51435634cfb None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:57.370754 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b47ace-5508-4250-9ef1-c51435634cfb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:57.371870 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b47ace-5508-4250-9ef1-c51435634cfb None admin] RBAC: Adding query filter params (role.id=63af4c63b0c343909af17164f6e26a71, scope.project.id=a99d762a7cad4fc1ac87113f5b01b5b2, user.id=345265699b4e46cfbcf188bfe47c22fa) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:22:57.372394 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b47ace-5508-4250-9ef1-c51435634cfb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:57.375136 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b47ace-5508-4250-9ef1-c51435634cfb None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:57.393994 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 55/114] 10.222.0.118 () {56 vars in 1379 bytes} [Thu Jul 14 15:22:57 2022] GET /identity/v3/role_assignments?user.id=345265699b4e46cfbcf188bfe47c22fa&scope.project.id=a99d762a7cad4fc1ac87113f5b01b5b2&role.id=63af4c63b0c343909af17164f6e26a71 => generated 260 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:22:57.393994 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b47ace-5508-4250-9ef1-c51435634cfb None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:57.417064 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:57.481238 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1918cff2-3df6-48cf-9d50-e87848b4e387 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:57.527904 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed08f171-3a87-4c3d-9ef5-084d79c5518d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:57.528304 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed08f171-3a87-4c3d-9ef5-084d79c5518d None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:57.528590 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed08f171-3a87-4c3d-9ef5-084d79c5518d None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:57.528861 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed08f171-3a87-4c3d-9ef5-084d79c5518d None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:57.529701 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed08f171-3a87-4c3d-9ef5-084d79c5518d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:22:57.530050 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed08f171-3a87-4c3d-9ef5-084d79c5518d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:57.531684 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed08f171-3a87-4c3d-9ef5-084d79c5518d None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:57.533204 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:57.549248 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 60/115] 10.222.0.118 () {56 vars in 1104 bytes} [Thu Jul 14 15:22:57 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:22:57.549248 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae18384-0561-47f4-81b5-cb4d0094c258 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:57.550388 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae18384-0561-47f4-81b5-cb4d0094c258 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:57.550674 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae18384-0561-47f4-81b5-cb4d0094c258 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:57.552491 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 61/116] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:22:57 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:22:57.557236 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984ae4e5-7df1-4594-a0fc-08013f86b501 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:57.557236 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984ae4e5-7df1-4594-a0fc-08013f86b501 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:57.557236 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984ae4e5-7df1-4594-a0fc-08013f86b501 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:57.557765 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 62/117] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:22:57 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:22:57.558732 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984ae4e5-7df1-4594-a0fc-08013f86b501 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:57.580200 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b47ace-5508-4250-9ef1-c51435634cfb None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:57.632057 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360d1145-a21b-4afb-8983-a9025cc99929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:57.632820 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360d1145-a21b-4afb-8983-a9025cc99929 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:57.633101 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360d1145-a21b-4afb-8983-a9025cc99929 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:57.633365 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360d1145-a21b-4afb-8983-a9025cc99929 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:57.648026 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360d1145-a21b-4afb-8983-a9025cc99929 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:22:57.656278 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-360d1145-a21b-4afb-8983-a9025cc99929 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 15:22:57.656278 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:22:57.656278 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:22:57.656278 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:22:57.656278 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:22:57.656278 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:22:57.656278 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:22:57.656278 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:22:57.656278 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:22:57.656278 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:22:57.656278 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:22:57.656278 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:22:57.656278 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:22:57.656278 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:22:57.656278 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:22:57.656278 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:22:57.657281 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:22:57.657281 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:22:57.657281 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:22:57.657281 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:22:57.657281 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:22:57.657281 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:22:57.657281 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:22:57.657281 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:22:57.657281 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:22:57.657281 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:22:57.657281 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:22:57.657281 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:22:57.657281 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:22:57.657281 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:22:57.657281 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:22:57.657281 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:22:57.658033 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:22:57.658033 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:22:57.658033 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:22:57.658033 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:22:57.658033 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:22:57.658033 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:22:57.658033 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:22:57.658033 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:22:57.658033 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:22:57.658033 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:22:57.658033 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 15:22:57.658033 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:22:57.658033 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 56/118] 10.222.0.118 () {56 vars in 1104 bytes} [Thu Jul 14 15:22:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:22:57.658658 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f160b399-39c2-419e-8e05-67d19b9d1223 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:57.658658 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f160b399-39c2-419e-8e05-67d19b9d1223 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:57.659610 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f160b399-39c2-419e-8e05-67d19b9d1223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:57.677258 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-f160b399-39c2-419e-8e05-67d19b9d1223 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:22:57.678541 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-f160b399-39c2-419e-8e05-67d19b9d1223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:22:57.695475 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984ae4e5-7df1-4594-a0fc-08013f86b501 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:57.733238 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4133466f-cf73-4980-b052-493f910dab1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:57.733839 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4133466f-cf73-4980-b052-493f910dab1b None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:57.734156 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4133466f-cf73-4980-b052-493f910dab1b None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:57.734434 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4133466f-cf73-4980-b052-493f910dab1b None admin] PATH_INFO: `/v3/users/3c839799004e4bd49aeaeae2457a9c6b` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:57.735671 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4133466f-cf73-4980-b052-493f910dab1b None admin] RBAC: Authorizing `identity:get_user(user_id=3c839799004e4bd49aeaeae2457a9c6b)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:57.737162 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4133466f-cf73-4980-b052-493f910dab1b None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:57.738885 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 63/119] 10.222.0.118 () {56 vars in 1182 bytes} [Thu Jul 14 15:22:57 2022] GET /identity/v3/users/3c839799004e4bd49aeaeae2457a9c6b => generated 248 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:22:57.744670 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb2fca6-7025-46ed-aad8-dbcb31d0c74a None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:57.744959 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb2fca6-7025-46ed-aad8-dbcb31d0c74a None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:57.745247 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb2fca6-7025-46ed-aad8-dbcb31d0c74a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:57.765199 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-fbb2fca6-7025-46ed-aad8-dbcb31d0c74a None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:22:57.766879 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:57.768188 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-fbb2fca6-7025-46ed-aad8-dbcb31d0c74a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:22:57.782152 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 57/120] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:22:57 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:22:57.783486 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f160b399-39c2-419e-8e05-67d19b9d1223 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:57.838068 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:57.854302 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 64/121] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:22:57 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:22:57.855198 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb2fca6-7025-46ed-aad8-dbcb31d0c74a None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:57.915932 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f160b399-39c2-419e-8e05-67d19b9d1223 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:57.953519 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d9fa5b-199e-4238-996c-fc452561f5cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:57.954601 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d9fa5b-199e-4238-996c-fc452561f5cc None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:57.955106 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d9fa5b-199e-4238-996c-fc452561f5cc None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:57.955864 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d9fa5b-199e-4238-996c-fc452561f5cc None admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:57.957036 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d9fa5b-199e-4238-996c-fc452561f5cc None admin] RBAC: Adding query filter params (name=member) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:22:57.957602 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d9fa5b-199e-4238-996c-fc452561f5cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:57.959247 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d9fa5b-199e-4238-996c-fc452561f5cc None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:57.968372 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 58/122] 10.222.0.118 () {56 vars in 1106 bytes} [Thu Jul 14 15:22:57 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:22:57.969453 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d9fa5b-199e-4238-996c-fc452561f5cc None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:57.981532 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb2fca6-7025-46ed-aad8-dbcb31d0c74a None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:58.018016 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82850339-fb4e-4ddc-a8c7-412dd8da0bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:58.018892 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82850339-fb4e-4ddc-a8c7-412dd8da0bf8 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:58.019177 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82850339-fb4e-4ddc-a8c7-412dd8da0bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:58.019453 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82850339-fb4e-4ddc-a8c7-412dd8da0bf8 None admin] PATH_INFO: `/v3/projects/a99d762a7cad4fc1ac87113f5b01b5b2` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:58.020844 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82850339-fb4e-4ddc-a8c7-412dd8da0bf8 None admin] RBAC: Authorizing `identity:get_project(project_id=a99d762a7cad4fc1ac87113f5b01b5b2)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:58.022490 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82850339-fb4e-4ddc-a8c7-412dd8da0bf8 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:58.024296 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 65/123] 10.222.0.118 () {56 vars in 1191 bytes} [Thu Jul 14 15:22:57 2022] GET /identity/v3/projects/a99d762a7cad4fc1ac87113f5b01b5b2 => generated 299 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:22:58.029767 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82850339-fb4e-4ddc-a8c7-412dd8da0bf8 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:58.051977 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:58.079787 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d9fa5b-199e-4238-996c-fc452561f5cc None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:58.114698 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:58.119069 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f9e22e-98c8-4b47-89d7-81c86fe06c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:58.120124 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f9e22e-98c8-4b47-89d7-81c86fe06c52 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:58.120555 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f9e22e-98c8-4b47-89d7-81c86fe06c52 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:58.121003 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f9e22e-98c8-4b47-89d7-81c86fe06c52 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:58.133768 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f9e22e-98c8-4b47-89d7-81c86fe06c52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:22:58.137208 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82850339-fb4e-4ddc-a8c7-412dd8da0bf8 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:58.142533 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-32f9e22e-98c8-4b47-89d7-81c86fe06c52 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 15:22:58.142533 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:22:58.142533 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:22:58.142533 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:22:58.142533 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:22:58.142533 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:22:58.142533 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:22:58.142533 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:22:58.142533 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:22:58.142533 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:22:58.142533 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:22:58.142533 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:22:58.142533 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:22:58.142533 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:22:58.142533 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:22:58.142533 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:22:58.143399 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:22:58.143399 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:22:58.143399 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:22:58.143399 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:22:58.143399 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:22:58.143399 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:22:58.143399 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:22:58.143399 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:22:58.143399 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:22:58.143399 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:22:58.143399 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:22:58.143399 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:22:58.143399 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:22:58.143399 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:22:58.143399 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:22:58.143399 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:22:58.144274 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:22:58.144274 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:22:58.144274 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:22:58.144274 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:22:58.144274 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:22:58.144274 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:22:58.144274 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:22:58.144274 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:22:58.144274 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:22:58.144274 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:22:58.144274 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 15:22:58.144274 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:22:58.146747 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 59/124] 10.222.0.118 () {56 vars in 1119 bytes} [Thu Jul 14 15:22:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:22:58.147803 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f9e22e-98c8-4b47-89d7-81c86fe06c52 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:58.180905 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8ef907-784f-4013-ad78-0b817321a8c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:58.181621 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8ef907-784f-4013-ad78-0b817321a8c6 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:58.181909 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8ef907-784f-4013-ad78-0b817321a8c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:58.182228 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8ef907-784f-4013-ad78-0b817321a8c6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:58.193769 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8ef907-784f-4013-ad78-0b817321a8c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:22:58.201989 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-ae8ef907-784f-4013-ad78-0b817321a8c6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 15:22:58.201989 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:22:58.201989 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:22:58.201989 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:22:58.201989 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:22:58.201989 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:22:58.201989 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:22:58.201989 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:22:58.201989 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:22:58.201989 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:22:58.201989 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:22:58.201989 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:22:58.201989 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:22:58.201989 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:22:58.201989 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:22:58.201989 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:22:58.202864 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:22:58.202864 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:22:58.202864 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:22:58.202864 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:22:58.202864 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:22:58.202864 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:22:58.202864 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:22:58.202864 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:22:58.202864 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:22:58.202864 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:22:58.202864 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:22:58.202864 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:22:58.202864 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:22:58.202864 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:22:58.202864 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:22:58.202864 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:22:58.203642 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:22:58.203642 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:22:58.203642 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:22:58.203642 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:22:58.203642 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:22:58.203642 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:22:58.203642 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:22:58.203642 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:22:58.203642 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:22:58.203642 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:22:58.203642 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 15:22:58.203642 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:22:58.203642 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 66/125] 10.222.0.118 () {56 vars in 1104 bytes} [Thu Jul 14 15:22:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:22:58.204276 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8ef907-784f-4013-ad78-0b817321a8c6 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:58.266087 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f9e22e-98c8-4b47-89d7-81c86fe06c52 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:58.304965 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:58.324669 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ca60b2-7297-46b5-92ca-1eaafa5b16b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:58.325977 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ca60b2-7297-46b5-92ca-1eaafa5b16b3 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:58.326287 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ca60b2-7297-46b5-92ca-1eaafa5b16b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:58.326569 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ca60b2-7297-46b5-92ca-1eaafa5b16b3 None admin] PATH_INFO: `/v3/users/59bb0f609774438d83c9741c52519818` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:58.328165 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ca60b2-7297-46b5-92ca-1eaafa5b16b3 None admin] RBAC: Authorizing `identity:get_user(user_id=59bb0f609774438d83c9741c52519818)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:58.330678 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ca60b2-7297-46b5-92ca-1eaafa5b16b3 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:58.332333 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 60/126] 10.222.0.118 () {56 vars in 1182 bytes} [Thu Jul 14 15:22:58 2022] GET /identity/v3/users/59bb0f609774438d83c9741c52519818 => generated 276 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:22:58.333415 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8ef907-784f-4013-ad78-0b817321a8c6 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:58.333745 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ca60b2-7297-46b5-92ca-1eaafa5b16b3 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:58.358978 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:58.373271 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d77da2-0ac7-43f0-93cd-ff3e301fecc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:58.374585 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d77da2-0ac7-43f0-93cd-ff3e301fecc4 None admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:58.375171 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d77da2-0ac7-43f0-93cd-ff3e301fecc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:58.375666 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d77da2-0ac7-43f0-93cd-ff3e301fecc4 None admin] PATH_INFO: `/v3/projects/a99d762a7cad4fc1ac87113f5b01b5b2/users/3c839799004e4bd49aeaeae2457a9c6b/roles/3b880cef7dcf4baf87b50f8610c0c56e` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:58.378062 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d77da2-0ac7-43f0-93cd-ff3e301fecc4 None admin] RBAC: Authorizing `identity:create_grant(project_id=a99d762a7cad4fc1ac87113f5b01b5b2, user_id=3c839799004e4bd49aeaeae2457a9c6b, role_id=3b880cef7dcf4baf87b50f8610c0c56e)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:58.380858 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d77da2-0ac7-43f0-93cd-ff3e301fecc4 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:58.399577 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 67/127] 10.222.0.118 () {58 vars in 1444 bytes} [Thu Jul 14 15:22:58 2022] PUT /identity/v3/projects/a99d762a7cad4fc1ac87113f5b01b5b2/users/3c839799004e4bd49aeaeae2457a9c6b/roles/3b880cef7dcf4baf87b50f8610c0c56e => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:22:58.402737 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d77da2-0ac7-43f0-93cd-ff3e301fecc4 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:58.507228 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ca60b2-7297-46b5-92ca-1eaafa5b16b3 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:58.581292 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d66f7b8-0173-4dfe-8e79-409a76592443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:58.582383 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d66f7b8-0173-4dfe-8e79-409a76592443 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:58.582920 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d66f7b8-0173-4dfe-8e79-409a76592443 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:58.583419 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d66f7b8-0173-4dfe-8e79-409a76592443 None admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:58.584262 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d66f7b8-0173-4dfe-8e79-409a76592443 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:22:58.584581 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d66f7b8-0173-4dfe-8e79-409a76592443 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:58.586168 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d66f7b8-0173-4dfe-8e79-409a76592443 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:58.596710 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 61/128] 10.222.0.118 () {56 vars in 1116 bytes} [Thu Jul 14 15:22:58 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:22:58.602138 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d66f7b8-0173-4dfe-8e79-409a76592443 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:58.626060 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d77da2-0ac7-43f0-93cd-ff3e301fecc4 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:58.659548 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:58.669512 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275f6214-aef4-470e-b203-0b8b0c3218a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:58.670784 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275f6214-aef4-470e-b203-0b8b0c3218a7 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:58.671325 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275f6214-aef4-470e-b203-0b8b0c3218a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:58.671803 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275f6214-aef4-470e-b203-0b8b0c3218a7 None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:58.673015 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275f6214-aef4-470e-b203-0b8b0c3218a7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:22:58.673549 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275f6214-aef4-470e-b203-0b8b0c3218a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:58.675316 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275f6214-aef4-470e-b203-0b8b0c3218a7 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:58.685516 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 68/129] 10.222.0.118 () {56 vars in 1106 bytes} [Thu Jul 14 15:22:58 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:22:58.686647 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275f6214-aef4-470e-b203-0b8b0c3218a7 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:58.716603 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d66f7b8-0173-4dfe-8e79-409a76592443 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:58.745412 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:58.756133 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d628d3-6b5c-455b-b205-6b22138f5b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:58.757070 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d628d3-6b5c-455b-b205-6b22138f5b5b None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:58.757404 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d628d3-6b5c-455b-b205-6b22138f5b5b None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:58.757677 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d628d3-6b5c-455b-b205-6b22138f5b5b None admin] PATH_INFO: `/v3/projects/a99d762a7cad4fc1ac87113f5b01b5b2` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:58.759810 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d628d3-6b5c-455b-b205-6b22138f5b5b None admin] RBAC: Authorizing `identity:get_project(project_id=a99d762a7cad4fc1ac87113f5b01b5b2)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:58.761404 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d628d3-6b5c-455b-b205-6b22138f5b5b None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:58.763421 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 62/130] 10.222.0.118 () {56 vars in 1191 bytes} [Thu Jul 14 15:22:58 2022] GET /identity/v3/projects/a99d762a7cad4fc1ac87113f5b01b5b2 => generated 299 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:22:58.764282 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d628d3-6b5c-455b-b205-6b22138f5b5b None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:58.810530 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275f6214-aef4-470e-b203-0b8b0c3218a7 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:58.849355 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6758ad7-6ae0-4b39-9229-04329b3d2cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:58.850732 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6758ad7-6ae0-4b39-9229-04329b3d2cf8 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:58.851217 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6758ad7-6ae0-4b39-9229-04329b3d2cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:58.851693 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6758ad7-6ae0-4b39-9229-04329b3d2cf8 None admin] PATH_INFO: `/v3/users/59bb0f609774438d83c9741c52519818` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:58.853209 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6758ad7-6ae0-4b39-9229-04329b3d2cf8 None admin] RBAC: Authorizing `identity:get_user(user_id=59bb0f609774438d83c9741c52519818)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:58.855046 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6758ad7-6ae0-4b39-9229-04329b3d2cf8 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:58.857025 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 69/131] 10.222.0.118 () {56 vars in 1182 bytes} [Thu Jul 14 15:22:58 2022] GET /identity/v3/users/59bb0f609774438d83c9741c52519818 => generated 276 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:22:58.858085 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6758ad7-6ae0-4b39-9229-04329b3d2cf8 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:58.891362 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d628d3-6b5c-455b-b205-6b22138f5b5b None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:58.925842 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:58.963575 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5bd4d5-092d-41e3-8df0-8bd90eedd8b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:58.964790 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5bd4d5-092d-41e3-8df0-8bd90eedd8b3 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:58.964901 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5bd4d5-092d-41e3-8df0-8bd90eedd8b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:58.965106 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5bd4d5-092d-41e3-8df0-8bd90eedd8b3 None admin] PATH_INFO: `/v3/users/59bb0f609774438d83c9741c52519818` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:58.966365 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5bd4d5-092d-41e3-8df0-8bd90eedd8b3 None admin] RBAC: Authorizing `identity:get_user(user_id=59bb0f609774438d83c9741c52519818)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:58.967844 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5bd4d5-092d-41e3-8df0-8bd90eedd8b3 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:58.969882 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 63/132] 10.222.0.118 () {56 vars in 1182 bytes} [Thu Jul 14 15:22:58 2022] GET /identity/v3/users/59bb0f609774438d83c9741c52519818 => generated 276 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:22:58.975313 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5bd4d5-092d-41e3-8df0-8bd90eedd8b3 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:58.979296 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6758ad7-6ae0-4b39-9229-04329b3d2cf8 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:59.017344 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd667b5-2ef7-4d7a-b144-b3bec45032cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:59.018658 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd667b5-2ef7-4d7a-b144-b3bec45032cf None admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:59.019144 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd667b5-2ef7-4d7a-b144-b3bec45032cf None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:59.019620 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd667b5-2ef7-4d7a-b144-b3bec45032cf None admin] PATH_INFO: `/v3/projects/a99d762a7cad4fc1ac87113f5b01b5b2/users/59bb0f609774438d83c9741c52519818/roles/4abcf5e5e7cd4b53ae1828fec6550d53` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:59.022097 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd667b5-2ef7-4d7a-b144-b3bec45032cf None admin] RBAC: Authorizing `identity:create_grant(project_id=a99d762a7cad4fc1ac87113f5b01b5b2, user_id=59bb0f609774438d83c9741c52519818, role_id=4abcf5e5e7cd4b53ae1828fec6550d53)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:59.023751 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd667b5-2ef7-4d7a-b144-b3bec45032cf None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:59.028947 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:59.043557 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 70/133] 10.222.0.118 () {58 vars in 1444 bytes} [Thu Jul 14 15:22:58 2022] PUT /identity/v3/projects/a99d762a7cad4fc1ac87113f5b01b5b2/users/59bb0f609774438d83c9741c52519818/roles/4abcf5e5e7cd4b53ae1828fec6550d53 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:22:59.044908 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd667b5-2ef7-4d7a-b144-b3bec45032cf None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:59.094966 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5bd4d5-092d-41e3-8df0-8bd90eedd8b3 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:59.143552 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee5d0ee-401f-4251-bbe1-6f67a3552066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:59.144427 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee5d0ee-401f-4251-bbe1-6f67a3552066 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:59.144711 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee5d0ee-401f-4251-bbe1-6f67a3552066 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:59.144997 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee5d0ee-401f-4251-bbe1-6f67a3552066 None admin] PATH_INFO: `/v3/projects/a99d762a7cad4fc1ac87113f5b01b5b2` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:59.146266 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee5d0ee-401f-4251-bbe1-6f67a3552066 None admin] RBAC: Authorizing `identity:get_project(project_id=a99d762a7cad4fc1ac87113f5b01b5b2)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:59.147757 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee5d0ee-401f-4251-bbe1-6f67a3552066 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:59.149501 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 64/134] 10.222.0.118 () {56 vars in 1191 bytes} [Thu Jul 14 15:22:58 2022] GET /identity/v3/projects/a99d762a7cad4fc1ac87113f5b01b5b2 => generated 299 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:22:59.155559 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee5d0ee-401f-4251-bbe1-6f67a3552066 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:59.184550 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd667b5-2ef7-4d7a-b144-b3bec45032cf None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:59.219894 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:59.249885 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ca57f3-265e-4701-a0ad-e0c82a585b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:59.251315 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ca57f3-265e-4701-a0ad-e0c82a585b7f None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:59.251855 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ca57f3-265e-4701-a0ad-e0c82a585b7f None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:59.252436 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ca57f3-265e-4701-a0ad-e0c82a585b7f None admin] PATH_INFO: `/v3/projects/2e878702c372449a92bd192b66f2b3a3` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:59.256071 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ca57f3-265e-4701-a0ad-e0c82a585b7f None admin] RBAC: Authorizing `identity:get_project(project_id=2e878702c372449a92bd192b66f2b3a3)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:59.257921 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ca57f3-265e-4701-a0ad-e0c82a585b7f None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:59.260160 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 71/135] 10.222.0.118 () {56 vars in 1191 bytes} [Thu Jul 14 15:22:59 2022] GET /identity/v3/projects/2e878702c372449a92bd192b66f2b3a3 => generated 313 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:22:59.265822 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ca57f3-265e-4701-a0ad-e0c82a585b7f None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:59.269829 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee5d0ee-401f-4251-bbe1-6f67a3552066 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:59.310016 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a467aca6-ff3e-4824-a019-c9b34c601df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:59.310016 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a467aca6-ff3e-4824-a019-c9b34c601df4 None admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:59.310016 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a467aca6-ff3e-4824-a019-c9b34c601df4 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:59.310016 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a467aca6-ff3e-4824-a019-c9b34c601df4 None admin] PATH_INFO: `/v3/projects/a99d762a7cad4fc1ac87113f5b01b5b2/users/59bb0f609774438d83c9741c52519818/roles/f4e85c621e6d4e749149099dd9303934` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:59.310414 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a467aca6-ff3e-4824-a019-c9b34c601df4 None admin] RBAC: Authorizing `identity:create_grant(project_id=a99d762a7cad4fc1ac87113f5b01b5b2, user_id=59bb0f609774438d83c9741c52519818, role_id=f4e85c621e6d4e749149099dd9303934)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:59.311846 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a467aca6-ff3e-4824-a019-c9b34c601df4 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:59.331132 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 65/136] 10.222.0.118 () {58 vars in 1444 bytes} [Thu Jul 14 15:22:59 2022] PUT /identity/v3/projects/a99d762a7cad4fc1ac87113f5b01b5b2/users/59bb0f609774438d83c9741c52519818/roles/f4e85c621e6d4e749149099dd9303934 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:22:59.342535 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:59.427940 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ca57f3-265e-4701-a0ad-e0c82a585b7f None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:59.464963 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2944e3-72f5-47fa-81da-d61e5b1f5ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:59.465866 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2944e3-72f5-47fa-81da-d61e5b1f5ff0 None admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:59.466281 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2944e3-72f5-47fa-81da-d61e5b1f5ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:59.466565 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2944e3-72f5-47fa-81da-d61e5b1f5ff0 None admin] PATH_INFO: `/v3/projects/2e878702c372449a92bd192b66f2b3a3/users/59bb0f609774438d83c9741c52519818/roles/4abcf5e5e7cd4b53ae1828fec6550d53` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:59.468652 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2944e3-72f5-47fa-81da-d61e5b1f5ff0 None admin] RBAC: Authorizing `identity:create_grant(project_id=2e878702c372449a92bd192b66f2b3a3, user_id=59bb0f609774438d83c9741c52519818, role_id=4abcf5e5e7cd4b53ae1828fec6550d53)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:59.470141 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2944e3-72f5-47fa-81da-d61e5b1f5ff0 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:59.488425 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 72/137] 10.222.0.118 () {58 vars in 1444 bytes} [Thu Jul 14 15:22:59 2022] PUT /identity/v3/projects/2e878702c372449a92bd192b66f2b3a3/users/59bb0f609774438d83c9741c52519818/roles/4abcf5e5e7cd4b53ae1828fec6550d53 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:22:59.733152 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5730a60d-946a-40a7-ace7-9289c7712068 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:59.733470 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5730a60d-946a-40a7-ace7-9289c7712068 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:59.733721 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5730a60d-946a-40a7-ace7-9289c7712068 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:59.735607 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 66/138] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:22:59 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:22:59.744443 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5b14d1-1387-4184-a6aa-b94615b1df39 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:59.745084 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5b14d1-1387-4184-a6aa-b94615b1df39 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:59.745566 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5b14d1-1387-4184-a6aa-b94615b1df39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:59.768959 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-4a5b14d1-1387-4184-a6aa-b94615b1df39 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:22:59.770582 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-4a5b14d1-1387-4184-a6aa-b94615b1df39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:22:59.849617 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 73/139] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:22:59 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:22:59.886261 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5730a60d-946a-40a7-ace7-9289c7712068 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:00.011337 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5730a60d-946a-40a7-ace7-9289c7712068 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:00.035112 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:00.062995 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b87e2a-4e06-4c6c-9705-dfecdacf7823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:00.063811 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b87e2a-4e06-4c6c-9705-dfecdacf7823 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:00.064097 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b87e2a-4e06-4c6c-9705-dfecdacf7823 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:00.064377 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b87e2a-4e06-4c6c-9705-dfecdacf7823 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:00.083501 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b87e2a-4e06-4c6c-9705-dfecdacf7823 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:23:00.091302 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-37b87e2a-4e06-4c6c-9705-dfecdacf7823 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 15:23:00.091302 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:00.091302 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:00.091302 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:00.091302 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:00.091302 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:00.091302 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:00.091302 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:00.091302 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:00.091302 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:00.091302 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:00.091302 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:00.091302 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:23:00.091302 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:23:00.091302 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:23:00.091302 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:23:00.092215 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:23:00.092215 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:23:00.092215 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:23:00.092215 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:23:00.092215 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:00.092215 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:00.092215 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:00.092215 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:00.092215 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:00.092215 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:00.092215 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:00.092215 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:00.092215 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:00.092215 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:00.092215 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:00.092215 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:00.092986 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:00.092986 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:00.092986 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:00.092986 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:00.092986 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:23:00.092986 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:23:00.092986 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:23:00.092986 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:23:00.092986 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:23:00.092986 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:23:00.092986 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 15:23:00.092986 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:23:00.092986 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 67/140] 10.222.0.118 () {56 vars in 1104 bytes} [Thu Jul 14 15:22:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:00.099312 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5b14d1-1387-4184-a6aa-b94615b1df39 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:00.132422 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:00.136096 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abddfa4b-22f0-49a9-b828-ecb9c54e3af9 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:00.136382 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abddfa4b-22f0-49a9-b828-ecb9c54e3af9 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:00.136661 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abddfa4b-22f0-49a9-b828-ecb9c54e3af9 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:00.138097 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 68/141] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:23:00 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 14 15:23:00.151606 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5def41a6-c855-4d3b-873c-ce5efc05ec96 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:00.151925 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5def41a6-c855-4d3b-873c-ce5efc05ec96 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:00.152158 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5def41a6-c855-4d3b-873c-ce5efc05ec96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:00.175969 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-5def41a6-c855-4d3b-873c-ce5efc05ec96 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:00.178130 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-5def41a6-c855-4d3b-873c-ce5efc05ec96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:00.266109 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5b14d1-1387-4184-a6aa-b94615b1df39 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:00.306559 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 69/142] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:23:00 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 15:23:00.340670 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71ae3fa-ff12-498b-bcff-3b2ff54c16cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:00.341356 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71ae3fa-ff12-498b-bcff-3b2ff54c16cc None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:00.341638 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71ae3fa-ff12-498b-bcff-3b2ff54c16cc None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:00.341910 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71ae3fa-ff12-498b-bcff-3b2ff54c16cc None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:00.342764 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71ae3fa-ff12-498b-bcff-3b2ff54c16cc None admin] RBAC: Adding query filter params (name=reader) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:00.343071 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71ae3fa-ff12-498b-bcff-3b2ff54c16cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:00.344553 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71ae3fa-ff12-498b-bcff-3b2ff54c16cc None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:00.356643 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 74/143] 10.222.0.118 () {56 vars in 1106 bytes} [Thu Jul 14 15:23:00 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:00.362460 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5def41a6-c855-4d3b-873c-ce5efc05ec96 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:00.418486 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71ae3fa-ff12-498b-bcff-3b2ff54c16cc None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:00.556869 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5def41a6-c855-4d3b-873c-ce5efc05ec96 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:00.582333 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:00.658520 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daebb9a8-f5d0-4b81-ab89-8e3f8df8b30e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:00.659422 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daebb9a8-f5d0-4b81-ab89-8e3f8df8b30e None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:00.659700 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daebb9a8-f5d0-4b81-ab89-8e3f8df8b30e None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:00.659974 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daebb9a8-f5d0-4b81-ab89-8e3f8df8b30e None admin] PATH_INFO: `/v3/users/345265699b4e46cfbcf188bfe47c22fa` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:00.661834 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daebb9a8-f5d0-4b81-ab89-8e3f8df8b30e None admin] RBAC: Authorizing `identity:get_user(user_id=345265699b4e46cfbcf188bfe47c22fa)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:00.663331 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daebb9a8-f5d0-4b81-ab89-8e3f8df8b30e None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:00.664762 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:00.671501 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 70/144] 10.222.0.118 () {56 vars in 1182 bytes} [Thu Jul 14 15:23:00 2022] GET /identity/v3/users/345265699b4e46cfbcf188bfe47c22fa => generated 290 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:00.683164 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daebb9a8-f5d0-4b81-ab89-8e3f8df8b30e None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:00.709095 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71ae3fa-ff12-498b-bcff-3b2ff54c16cc None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:00.823610 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04352ea1-8298-42aa-83ab-d3ebf243d9b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:00.824358 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04352ea1-8298-42aa-83ab-d3ebf243d9b6 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:00.825990 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04352ea1-8298-42aa-83ab-d3ebf243d9b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:00.825990 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04352ea1-8298-42aa-83ab-d3ebf243d9b6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:00.826163 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04352ea1-8298-42aa-83ab-d3ebf243d9b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:00.829707 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04352ea1-8298-42aa-83ab-d3ebf243d9b6 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:00.829707 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 75/145] 10.222.0.118 () {56 vars in 1113 bytes} [Thu Jul 14 15:23:00 2022] GET /identity/v3/domains/default => generated 200 bytes in 411 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:23:00.842932 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04352ea1-8298-42aa-83ab-d3ebf243d9b6 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:01.104617 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04352ea1-8298-42aa-83ab-d3ebf243d9b6 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:01.135996 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daebb9a8-f5d0-4b81-ab89-8e3f8df8b30e None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:01.220330 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5146cf9c-2975-4abb-a7a1-2d08c973eeba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:01.221403 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5146cf9c-2975-4abb-a7a1-2d08c973eeba None admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:01.221899 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5146cf9c-2975-4abb-a7a1-2d08c973eeba None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:01.223479 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5146cf9c-2975-4abb-a7a1-2d08c973eeba None admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:01.225076 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5146cf9c-2975-4abb-a7a1-2d08c973eeba None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:01.227430 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5146cf9c-2975-4abb-a7a1-2d08c973eeba None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:01.251874 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9ce022-3c4a-47fa-9cee-c3b02ff50ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:01.253105 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ce022-3c4a-47fa-9cee-c3b02ff50ecd None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:01.253590 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ce022-3c4a-47fa-9cee-c3b02ff50ecd None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:01.254112 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ce022-3c4a-47fa-9cee-c3b02ff50ecd None admin] PATH_INFO: `/v3/projects/a99d762a7cad4fc1ac87113f5b01b5b2` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:01.256811 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9ce022-3c4a-47fa-9cee-c3b02ff50ecd None admin] RBAC: Authorizing `identity:get_project(project_id=a99d762a7cad4fc1ac87113f5b01b5b2)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:01.267841 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9ce022-3c4a-47fa-9cee-c3b02ff50ecd None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:01.276393 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 71/146] 10.222.0.118 () {56 vars in 1191 bytes} [Thu Jul 14 15:23:00 2022] GET /identity/v3/projects/a99d762a7cad4fc1ac87113f5b01b5b2 => generated 299 bytes in 594 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:01.282299 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9ce022-3c4a-47fa-9cee-c3b02ff50ecd None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:01.284410 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 76/147] 10.222.0.118 () {60 vars in 1137 bytes} [Thu Jul 14 15:23:00 2022] POST /identity/v3/users => generated 284 bytes in 446 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:23:01.410452 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:01.526076 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9ce022-3c4a-47fa-9cee-c3b02ff50ecd None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:01.572972 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80cdda3-6b1a-434f-9eba-13d22dc4ec80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:01.573877 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80cdda3-6b1a-434f-9eba-13d22dc4ec80 None admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:01.574246 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80cdda3-6b1a-434f-9eba-13d22dc4ec80 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:01.574573 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80cdda3-6b1a-434f-9eba-13d22dc4ec80 None admin] PATH_INFO: `/v3/projects/a99d762a7cad4fc1ac87113f5b01b5b2/users/345265699b4e46cfbcf188bfe47c22fa/roles/63af4c63b0c343909af17164f6e26a71` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:01.576604 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80cdda3-6b1a-434f-9eba-13d22dc4ec80 None admin] RBAC: Authorizing `identity:create_grant(project_id=a99d762a7cad4fc1ac87113f5b01b5b2, user_id=345265699b4e46cfbcf188bfe47c22fa, role_id=63af4c63b0c343909af17164f6e26a71)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:01.578098 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80cdda3-6b1a-434f-9eba-13d22dc4ec80 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:01.594759 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 72/148] 10.222.0.118 () {58 vars in 1444 bytes} [Thu Jul 14 15:23:01 2022] PUT /identity/v3/projects/a99d762a7cad4fc1ac87113f5b01b5b2/users/345265699b4e46cfbcf188bfe47c22fa/roles/63af4c63b0c343909af17164f6e26a71 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:23:01.617179 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194e64bd-2985-4a34-adef-fe2f58b58513 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:01.617536 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194e64bd-2985-4a34-adef-fe2f58b58513 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:01.617734 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194e64bd-2985-4a34-adef-fe2f58b58513 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:01.619299 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 77/149] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:23:01 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:23:01.625209 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5d8d04-9adc-4fbb-808e-a2e2ad70aa46 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:01.625527 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5d8d04-9adc-4fbb-808e-a2e2ad70aa46 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:01.625779 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5d8d04-9adc-4fbb-808e-a2e2ad70aa46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:01.645701 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-7b5d8d04-9adc-4fbb-808e-a2e2ad70aa46 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:01.647390 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-7b5d8d04-9adc-4fbb-808e-a2e2ad70aa46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:01.736411 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 73/150] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:23:01 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:23:01.773388 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194e64bd-2985-4a34-adef-fe2f58b58513 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:01.796627 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:01.904178 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194e64bd-2985-4a34-adef-fe2f58b58513 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:01.942922 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3defb11d-0385-47a9-b637-956f7085da80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:01.943727 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3defb11d-0385-47a9-b637-956f7085da80 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:01.944006 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3defb11d-0385-47a9-b637-956f7085da80 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:01.944280 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3defb11d-0385-47a9-b637-956f7085da80 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:01.956436 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3defb11d-0385-47a9-b637-956f7085da80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:23:01.964736 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-3defb11d-0385-47a9-b637-956f7085da80 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:23:01.964736 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:01.964736 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:01.964736 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:01.964736 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:01.964736 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:01.964736 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:01.964736 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:01.964736 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:01.964736 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:01.964736 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:01.964736 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:01.964736 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:23:01.964736 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:23:01.964736 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:23:01.964736 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:23:01.965569 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:23:01.965569 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:23:01.965569 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:23:01.965569 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:23:01.965569 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:01.965569 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:01.965569 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:01.965569 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:01.965569 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:01.965569 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:01.965569 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:01.965569 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:01.965569 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:01.965569 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:01.965569 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:01.965569 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:01.966360 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:01.966360 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:01.966360 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:01.966360 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:01.966360 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:23:01.966360 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:23:01.966360 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:23:01.966360 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:23:01.966360 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:23:01.966360 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:23:01.966360 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:23:01.966360 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:23:01.966360 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 78/151] 10.222.0.118 () {56 vars in 1101 bytes} [Thu Jul 14 15:23:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:01.979201 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5d8d04-9adc-4fbb-808e-a2e2ad70aa46 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:02.021092 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:02.108695 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5d8d04-9adc-4fbb-808e-a2e2ad70aa46 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:02.151036 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb4b847-402f-43d7-9257-aaaa3ccd41c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:02.151793 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb4b847-402f-43d7-9257-aaaa3ccd41c7 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:02.151986 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb4b847-402f-43d7-9257-aaaa3ccd41c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:02.152263 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb4b847-402f-43d7-9257-aaaa3ccd41c7 None admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:02.153031 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb4b847-402f-43d7-9257-aaaa3ccd41c7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:02.153338 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb4b847-402f-43d7-9257-aaaa3ccd41c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:02.154762 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb4b847-402f-43d7-9257-aaaa3ccd41c7 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:02.164495 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 74/152] 10.222.0.118 () {56 vars in 1104 bytes} [Thu Jul 14 15:23:01 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:02.170394 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3defb11d-0385-47a9-b637-956f7085da80 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:02.302493 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:02.322995 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3defb11d-0385-47a9-b637-956f7085da80 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:02.377765 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2211cc-da1e-46b4-a49b-634ebebdd71e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:02.378737 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2211cc-da1e-46b4-a49b-634ebebdd71e None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:02.379024 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2211cc-da1e-46b4-a49b-634ebebdd71e None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:02.379326 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2211cc-da1e-46b4-a49b-634ebebdd71e None admin] PATH_INFO: `/v3/users/3c839799004e4bd49aeaeae2457a9c6b` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:02.381177 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2211cc-da1e-46b4-a49b-634ebebdd71e None admin] RBAC: Authorizing `identity:get_user(user_id=3c839799004e4bd49aeaeae2457a9c6b)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:02.383014 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2211cc-da1e-46b4-a49b-634ebebdd71e None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:02.387793 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 79/153] 10.222.0.118 () {56 vars in 1182 bytes} [Thu Jul 14 15:23:02 2022] GET /identity/v3/users/3c839799004e4bd49aeaeae2457a9c6b => generated 248 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:02.395646 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb4b847-402f-43d7-9257-aaaa3ccd41c7 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:02.445668 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d311a34a-5f53-4c86-bb8e-a4409e3a022e None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:02.446279 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d311a34a-5f53-4c86-bb8e-a4409e3a022e None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:02.446744 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d311a34a-5f53-4c86-bb8e-a4409e3a022e None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:02.448304 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 80/154] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:23:02 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 14 15:23:02.454550 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b4069d-7e48-408c-a970-32d9961d7ad5 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:02.455116 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b4069d-7e48-408c-a970-32d9961d7ad5 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:02.455564 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b4069d-7e48-408c-a970-32d9961d7ad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:02.473569 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-31b4069d-7e48-408c-a970-32d9961d7ad5 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:02.475209 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-31b4069d-7e48-408c-a970-32d9961d7ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:02.534323 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:02.549883 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb4b847-402f-43d7-9257-aaaa3ccd41c7 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:02.596676 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7335d8-a0a6-49fd-a8d3-8a982d6a6fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:02.597270 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7335d8-a0a6-49fd-a8d3-8a982d6a6fce None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:02.597555 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7335d8-a0a6-49fd-a8d3-8a982d6a6fce None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:02.597837 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7335d8-a0a6-49fd-a8d3-8a982d6a6fce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:02.620336 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 81/155] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:23:02 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:23:02.661824 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b4069d-7e48-408c-a970-32d9961d7ad5 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:02.695580 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7335d8-a0a6-49fd-a8d3-8a982d6a6fce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:02.697088 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7335d8-a0a6-49fd-a8d3-8a982d6a6fce None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:02.796810 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:02.826548 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b4069d-7e48-408c-a970-32d9961d7ad5 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:02.835231 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:02.854442 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 75/156] 10.222.0.118 () {58 vars in 1287 bytes} [Thu Jul 14 15:23:02 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 15:23:02.855519 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a9c44-1507-48da-a456-82a928c90968 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:02.855809 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a9c44-1507-48da-a456-82a928c90968 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:02.856088 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a9c44-1507-48da-a456-82a928c90968 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:02.857525 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 76/157] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:23:02 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:23:02.860931 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825a9c44-1507-48da-a456-82a928c90968 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:02.873453 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f85008-9799-4452-aa0c-a89ce95ceaf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:02.875167 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f85008-9799-4452-aa0c-a89ce95ceaf1 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:02.875665 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f85008-9799-4452-aa0c-a89ce95ceaf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:02.876144 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f85008-9799-4452-aa0c-a89ce95ceaf1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:02.890781 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f85008-9799-4452-aa0c-a89ce95ceaf1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:23:02.899743 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-47f85008-9799-4452-aa0c-a89ce95ceaf1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 15:23:02.899743 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:02.899743 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:02.899743 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:02.899743 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:02.899743 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:02.899743 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:02.899743 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:02.899743 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:02.899743 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:02.899743 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:02.899743 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:02.899743 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:23:02.899743 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:23:02.899743 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:23:02.899743 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:23:02.900849 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:23:02.900849 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:23:02.900849 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:23:02.900849 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:23:02.900849 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:02.900849 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:02.900849 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:02.900849 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:02.900849 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:02.900849 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:02.900849 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:02.900849 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:02.900849 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:02.900849 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:02.900849 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:02.900849 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:02.901659 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:02.901659 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:02.901659 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:02.901659 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:02.901659 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:23:02.901659 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:23:02.901659 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:23:02.901659 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:23:02.901659 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:23:02.901659 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:23:02.901659 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 15:23:02.901659 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:23:02.904228 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 82/158] 10.222.0.118 () {56 vars in 1104 bytes} [Thu Jul 14 15:23:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:23:02.905889 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1abcfa0-e16f-44e5-b67a-f2ee7b3089ef None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:02.906406 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1abcfa0-e16f-44e5-b67a-f2ee7b3089ef None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:02.906891 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1abcfa0-e16f-44e5-b67a-f2ee7b3089ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:02.933102 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-c1abcfa0-e16f-44e5-b67a-f2ee7b3089ef None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:02.935732 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-c1abcfa0-e16f-44e5-b67a-f2ee7b3089ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:03.038211 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 83/159] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:23:02 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:23:03.039881 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1abcfa0-e16f-44e5-b67a-f2ee7b3089ef None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:03.099287 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825a9c44-1507-48da-a456-82a928c90968 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:03.127021 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:03.175038 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1abcfa0-e16f-44e5-b67a-f2ee7b3089ef None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:03.206952 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6308369e-2adc-4e5c-a5ca-ca3e564c3b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:03.208243 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6308369e-2adc-4e5c-a5ca-ca3e564c3b45 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:03.208365 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6308369e-2adc-4e5c-a5ca-ca3e564c3b45 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:03.208725 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6308369e-2adc-4e5c-a5ca-ca3e564c3b45 None admin] PATH_INFO: `/v3/projects/a99d762a7cad4fc1ac87113f5b01b5b2` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:03.209954 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6308369e-2adc-4e5c-a5ca-ca3e564c3b45 None admin] RBAC: Authorizing `identity:get_project(project_id=a99d762a7cad4fc1ac87113f5b01b5b2)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:03.211462 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6308369e-2adc-4e5c-a5ca-ca3e564c3b45 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:03.213423 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 77/160] 10.222.0.118 () {56 vars in 1191 bytes} [Thu Jul 14 15:23:02 2022] GET /identity/v3/projects/a99d762a7cad4fc1ac87113f5b01b5b2 => generated 299 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:03.214668 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc993c9-b7d5-4b79-82db-ae1c0ac5f43d None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:03.215005 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc993c9-b7d5-4b79-82db-ae1c0ac5f43d None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:03.215209 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc993c9-b7d5-4b79-82db-ae1c0ac5f43d None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:03.219349 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f0eb02-c52f-430f-ba66-32c4e6e3b3c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:03.220312 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f0eb02-c52f-430f-ba66-32c4e6e3b3c3 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:03.220797 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f0eb02-c52f-430f-ba66-32c4e6e3b3c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:03.221407 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f0eb02-c52f-430f-ba66-32c4e6e3b3c3 None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:03.221647 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 78/161] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:23:03 2022] GET /identity => generated 271 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:23:03.222471 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc993c9-b7d5-4b79-82db-ae1c0ac5f43d None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:03.223751 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f0eb02-c52f-430f-ba66-32c4e6e3b3c3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:03.224301 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f0eb02-c52f-430f-ba66-32c4e6e3b3c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:03.225974 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f0eb02-c52f-430f-ba66-32c4e6e3b3c3 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:03.237685 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 84/162] 10.222.0.118 () {56 vars in 1106 bytes} [Thu Jul 14 15:23:03 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:03.238965 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f0eb02-c52f-430f-ba66-32c4e6e3b3c3 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:03.381072 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f0eb02-c52f-430f-ba66-32c4e6e3b3c3 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:03.403429 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:03.415841 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:03.429087 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ec7375-1994-4cbf-8f72-000c3c753bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:03.430327 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ec7375-1994-4cbf-8f72-000c3c753bc4 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:03.430844 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ec7375-1994-4cbf-8f72-000c3c753bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:03.431318 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ec7375-1994-4cbf-8f72-000c3c753bc4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:03.432953 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ec7375-1994-4cbf-8f72-000c3c753bc4 None admin] RBAC: Adding query filter params (role.id=3b880cef7dcf4baf87b50f8610c0c56e, scope.project.id=a99d762a7cad4fc1ac87113f5b01b5b2, user.id=3c839799004e4bd49aeaeae2457a9c6b) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:03.433526 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ec7375-1994-4cbf-8f72-000c3c753bc4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:03.435470 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ec7375-1994-4cbf-8f72-000c3c753bc4 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:03.444434 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 85/163] 10.222.0.118 () {56 vars in 1379 bytes} [Thu Jul 14 15:23:03 2022] GET /identity/v3/role_assignments?user.id=3c839799004e4bd49aeaeae2457a9c6b&scope.project.id=a99d762a7cad4fc1ac87113f5b01b5b2&role.id=3b880cef7dcf4baf87b50f8610c0c56e => generated 610 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:03.446096 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c314522-eb69-49cd-b368-6ef076012193 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:03.446579 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c314522-eb69-49cd-b368-6ef076012193 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:03.447053 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c314522-eb69-49cd-b368-6ef076012193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:03.467867 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-0c314522-eb69-49cd-b368-6ef076012193 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:03.469720 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-0c314522-eb69-49cd-b368-6ef076012193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:03.538717 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc993c9-b7d5-4b79-82db-ae1c0ac5f43d None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:03.554271 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 86/164] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:23:03 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:23:03.555449 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c314522-eb69-49cd-b368-6ef076012193 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:03.683095 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbe8947-e991-4587-8798-2c32cf5801f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:03.684411 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe8947-e991-4587-8798-2c32cf5801f7 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:03.684879 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe8947-e991-4587-8798-2c32cf5801f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:03.685336 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe8947-e991-4587-8798-2c32cf5801f7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:03.715088 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbe8947-e991-4587-8798-2c32cf5801f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:23:03.731925 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-fdbe8947-e991-4587-8798-2c32cf5801f7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 15:23:03.731925 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:03.731925 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:03.731925 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:03.731925 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:03.731925 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:03.731925 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:03.731925 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:03.731925 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:03.731925 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:03.731925 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:03.731925 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:03.731925 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:23:03.731925 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:23:03.731925 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:23:03.731925 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:23:03.732932 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:23:03.732932 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:23:03.732932 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:23:03.732932 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:23:03.732932 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:03.732932 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:03.732932 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:03.732932 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:03.732932 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:03.732932 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:03.732932 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:03.732932 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:03.732932 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:03.732932 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:03.732932 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:03.732932 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:03.734410 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:03.734410 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:03.734410 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:03.734410 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:03.734410 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:23:03.734410 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:23:03.734410 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:23:03.734410 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:23:03.734410 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:23:03.734410 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:23:03.734410 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 15:23:03.734410 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:23:03.734410 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 79/165] 10.222.0.118 () {56 vars in 1119 bytes} [Thu Jul 14 15:23:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 511 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:03.734410 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbe8947-e991-4587-8798-2c32cf5801f7 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:03.772588 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c314522-eb69-49cd-b368-6ef076012193 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:03.817249 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:03.858875 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2afdba-773b-4697-956f-62da616d6ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:03.859736 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2afdba-773b-4697-956f-62da616d6ead None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:03.860012 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2afdba-773b-4697-956f-62da616d6ead None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:03.860284 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2afdba-773b-4697-956f-62da616d6ead None admin] PATH_INFO: `/v3/users/59bb0f609774438d83c9741c52519818` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:03.861557 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2afdba-773b-4697-956f-62da616d6ead None admin] RBAC: Authorizing `identity:get_user(user_id=59bb0f609774438d83c9741c52519818)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:03.863076 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2afdba-773b-4697-956f-62da616d6ead None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:03.864791 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 87/166] 10.222.0.118 () {56 vars in 1182 bytes} [Thu Jul 14 15:23:03 2022] GET /identity/v3/users/59bb0f609774438d83c9741c52519818 => generated 276 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:03.865561 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2afdba-773b-4697-956f-62da616d6ead None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:03.912521 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbe8947-e991-4587-8798-2c32cf5801f7 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:03.955038 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:03.998668 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442ef0ac-d65c-4cd5-89a5-6e98709e08c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:03.999486 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442ef0ac-d65c-4cd5-89a5-6e98709e08c6 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:03.999769 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442ef0ac-d65c-4cd5-89a5-6e98709e08c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:04.000047 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442ef0ac-d65c-4cd5-89a5-6e98709e08c6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:04.009436 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2afdba-773b-4697-956f-62da616d6ead None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:04.030892 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442ef0ac-d65c-4cd5-89a5-6e98709e08c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:23:04.039370 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-442ef0ac-d65c-4cd5-89a5-6e98709e08c6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 15:23:04.039370 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:04.039370 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:04.039370 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:04.039370 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:04.039370 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:04.039370 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:04.039370 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:04.039370 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:04.039370 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:04.039370 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:04.039370 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:04.039370 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:23:04.039370 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:23:04.039370 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:23:04.039370 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:23:04.040274 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:23:04.040274 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:23:04.040274 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:23:04.040274 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:23:04.040274 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:04.040274 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:04.040274 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:04.040274 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:04.040274 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:04.040274 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:04.040274 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:04.040274 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:04.040274 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:04.040274 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:04.040274 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:04.040274 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:04.041048 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:04.041048 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:04.041048 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:04.041048 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:04.041048 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:23:04.041048 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:23:04.041048 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:23:04.041048 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:23:04.041048 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:23:04.041048 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:23:04.041048 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 15:23:04.041048 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:23:04.041048 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 80/167] 10.222.0.118 () {56 vars in 1104 bytes} [Thu Jul 14 15:23:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:04.046849 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442ef0ac-d65c-4cd5-89a5-6e98709e08c6 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:04.067080 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9f2773-cba8-44e5-b8ff-1a4c4dfb2135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:04.067762 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9f2773-cba8-44e5-b8ff-1a4c4dfb2135 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:04.068037 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9f2773-cba8-44e5-b8ff-1a4c4dfb2135 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:04.068305 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9f2773-cba8-44e5-b8ff-1a4c4dfb2135 None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:04.069064 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9f2773-cba8-44e5-b8ff-1a4c4dfb2135 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:04.069369 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9f2773-cba8-44e5-b8ff-1a4c4dfb2135 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:04.070796 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9f2773-cba8-44e5-b8ff-1a4c4dfb2135 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:04.084792 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 88/168] 10.222.0.118 () {56 vars in 1116 bytes} [Thu Jul 14 15:23:03 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:04.085646 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9f2773-cba8-44e5-b8ff-1a4c4dfb2135 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:04.159867 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:04.238325 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9f2773-cba8-44e5-b8ff-1a4c4dfb2135 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:04.297521 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36faadc-d9f8-4740-9916-ec81b1db1c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:04.298706 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36faadc-d9f8-4740-9916-ec81b1db1c83 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:04.299440 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36faadc-d9f8-4740-9916-ec81b1db1c83 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:04.299929 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36faadc-d9f8-4740-9916-ec81b1db1c83 None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:04.301823 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36faadc-d9f8-4740-9916-ec81b1db1c83 None admin] RBAC: Adding query filter params (name=member) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:04.302345 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36faadc-d9f8-4740-9916-ec81b1db1c83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:04.303912 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36faadc-d9f8-4740-9916-ec81b1db1c83 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:04.321499 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 89/169] 10.222.0.118 () {56 vars in 1106 bytes} [Thu Jul 14 15:23:04 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:04.323016 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36faadc-d9f8-4740-9916-ec81b1db1c83 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:04.324417 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442ef0ac-d65c-4cd5-89a5-6e98709e08c6 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:04.435621 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8537a2b-f435-4672-9ed5-c46743079e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:04.436294 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8537a2b-f435-4672-9ed5-c46743079e11 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:04.436580 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8537a2b-f435-4672-9ed5-c46743079e11 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:04.436861 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8537a2b-f435-4672-9ed5-c46743079e11 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:04.528492 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36faadc-d9f8-4740-9916-ec81b1db1c83 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:04.554201 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:04.562412 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:04.591005 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8537a2b-f435-4672-9ed5-c46743079e11 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:04.592516 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8537a2b-f435-4672-9ed5-c46743079e11 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:04.596889 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9009e6-6e4a-4a26-ad9c-41c9bc118563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:04.598124 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9009e6-6e4a-4a26-ad9c-41c9bc118563 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:04.598607 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9009e6-6e4a-4a26-ad9c-41c9bc118563 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:04.605983 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9009e6-6e4a-4a26-ad9c-41c9bc118563 None admin] PATH_INFO: `/v3/users/59bb0f609774438d83c9741c52519818` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:04.607632 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9009e6-6e4a-4a26-ad9c-41c9bc118563 None admin] RBAC: Authorizing `identity:get_user(user_id=59bb0f609774438d83c9741c52519818)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:04.609343 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9009e6-6e4a-4a26-ad9c-41c9bc118563 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:04.611428 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 90/170] 10.222.0.118 () {56 vars in 1182 bytes} [Thu Jul 14 15:23:04 2022] GET /identity/v3/users/59bb0f609774438d83c9741c52519818 => generated 276 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:04.612375 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9009e6-6e4a-4a26-ad9c-41c9bc118563 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:04.735199 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 81/171] 10.222.0.118 () {58 vars in 1287 bytes} [Thu Jul 14 15:23:04 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 694 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 15:23:04.736082 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8537a2b-f435-4672-9ed5-c46743079e11 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:04.815083 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9009e6-6e4a-4a26-ad9c-41c9bc118563 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:04.841119 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:04.860922 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8537a2b-f435-4672-9ed5-c46743079e11 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:04.897098 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1be6a2-6fa1-4276-a83e-ebcf48dd8419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:04.897741 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1be6a2-6fa1-4276-a83e-ebcf48dd8419 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:04.898056 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1be6a2-6fa1-4276-a83e-ebcf48dd8419 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:04.898347 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1be6a2-6fa1-4276-a83e-ebcf48dd8419 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:04.899304 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c030d045-2147-4b9a-90b9-7afde3409890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:04.900440 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c030d045-2147-4b9a-90b9-7afde3409890 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:04.900915 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c030d045-2147-4b9a-90b9-7afde3409890 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:04.901371 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c030d045-2147-4b9a-90b9-7afde3409890 None admin] PATH_INFO: `/v3/users/59bb0f609774438d83c9741c52519818` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:04.911604 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c030d045-2147-4b9a-90b9-7afde3409890 None admin] RBAC: Authorizing `identity:get_user(user_id=59bb0f609774438d83c9741c52519818)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:04.913367 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c030d045-2147-4b9a-90b9-7afde3409890 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:04.915323 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 91/172] 10.222.0.118 () {56 vars in 1182 bytes} [Thu Jul 14 15:23:04 2022] GET /identity/v3/users/59bb0f609774438d83c9741c52519818 => generated 276 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:04.916274 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c030d045-2147-4b9a-90b9-7afde3409890 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:04.976505 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1be6a2-6fa1-4276-a83e-ebcf48dd8419 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:04.978468 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1be6a2-6fa1-4276-a83e-ebcf48dd8419 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:05.001414 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:05.061636 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c030d045-2147-4b9a-90b9-7afde3409890 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:05.083092 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:05.100517 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fe6057-78b1-47f4-a621-920fddcd34d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:05.101617 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fe6057-78b1-47f4-a621-920fddcd34d9 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:05.102137 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fe6057-78b1-47f4-a621-920fddcd34d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:05.102570 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fe6057-78b1-47f4-a621-920fddcd34d9 None admin] PATH_INFO: `/v3/projects/a99d762a7cad4fc1ac87113f5b01b5b2` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:05.104159 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fe6057-78b1-47f4-a621-920fddcd34d9 None admin] RBAC: Authorizing `identity:get_project(project_id=a99d762a7cad4fc1ac87113f5b01b5b2)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:05.105752 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fe6057-78b1-47f4-a621-920fddcd34d9 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:05.107486 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 82/173] 10.222.0.118 () {58 vars in 1287 bytes} [Thu Jul 14 15:23:04 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 15:23:05.107789 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 92/174] 10.222.0.118 () {56 vars in 1191 bytes} [Thu Jul 14 15:23:04 2022] GET /identity/v3/projects/a99d762a7cad4fc1ac87113f5b01b5b2 => generated 299 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:05.108549 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1be6a2-6fa1-4276-a83e-ebcf48dd8419 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:05.109355 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8bffe0-5371-4e0d-aaf6-0b103e32ed19 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:05.109772 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8bffe0-5371-4e0d-aaf6-0b103e32ed19 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:05.110200 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8bffe0-5371-4e0d-aaf6-0b103e32ed19 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:05.111977 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 93/175] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:23:05 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:23:05.119516 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7495337e-d6da-4c75-9301-c0b1e411bc2a None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:05.120138 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7495337e-d6da-4c75-9301-c0b1e411bc2a None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:05.120606 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7495337e-d6da-4c75-9301-c0b1e411bc2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:05.138858 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-7495337e-d6da-4c75-9301-c0b1e411bc2a None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:05.140418 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-7495337e-d6da-4c75-9301-c0b1e411bc2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:05.226019 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1be6a2-6fa1-4276-a83e-ebcf48dd8419 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:05.228719 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 94/176] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:23:05 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:23:05.229783 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7495337e-d6da-4c75-9301-c0b1e411bc2a None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:05.264604 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b29385-ec09-406c-8676-e4d4c3d737a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:05.265635 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b29385-ec09-406c-8676-e4d4c3d737a0 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:05.266185 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b29385-ec09-406c-8676-e4d4c3d737a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:05.267033 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b29385-ec09-406c-8676-e4d4c3d737a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:05.327219 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:05.333976 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:05.347596 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b29385-ec09-406c-8676-e4d4c3d737a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:05.349468 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b29385-ec09-406c-8676-e4d4c3d737a0 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:05.422900 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7495337e-d6da-4c75-9301-c0b1e411bc2a None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:05.462042 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dc466e-e6c8-4344-ae84-fce24c1e9664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:05.463323 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dc466e-e6c8-4344-ae84-fce24c1e9664 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:05.463771 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dc466e-e6c8-4344-ae84-fce24c1e9664 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:05.464210 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dc466e-e6c8-4344-ae84-fce24c1e9664 None admin] PATH_INFO: `/v3/projects/a99d762a7cad4fc1ac87113f5b01b5b2` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:05.465616 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dc466e-e6c8-4344-ae84-fce24c1e9664 None admin] RBAC: Authorizing `identity:get_project(project_id=a99d762a7cad4fc1ac87113f5b01b5b2)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:05.467556 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dc466e-e6c8-4344-ae84-fce24c1e9664 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:05.469651 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 95/177] 10.222.0.118 () {56 vars in 1191 bytes} [Thu Jul 14 15:23:05 2022] GET /identity/v3/projects/a99d762a7cad4fc1ac87113f5b01b5b2 => generated 299 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:05.470662 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dc466e-e6c8-4344-ae84-fce24c1e9664 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:05.477816 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 83/178] 10.222.0.118 () {58 vars in 1287 bytes} [Thu Jul 14 15:23:05 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 15:23:05.482656 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b29385-ec09-406c-8676-e4d4c3d737a0 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:05.586143 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:05.587650 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dc466e-e6c8-4344-ae84-fce24c1e9664 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:05.604823 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:05.610316 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b29385-ec09-406c-8676-e4d4c3d737a0 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:05.633819 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e860913f-368c-48b9-8979-179f56991fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:05.635466 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e860913f-368c-48b9-8979-179f56991fc5 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:05.635945 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e860913f-368c-48b9-8979-179f56991fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:05.636668 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e860913f-368c-48b9-8979-179f56991fc5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:05.638004 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e860913f-368c-48b9-8979-179f56991fc5 None admin] RBAC: Adding query filter params (role.id=4abcf5e5e7cd4b53ae1828fec6550d53, scope.project.id=a99d762a7cad4fc1ac87113f5b01b5b2, user.id=59bb0f609774438d83c9741c52519818) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:05.638925 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e860913f-368c-48b9-8979-179f56991fc5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:05.642006 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e860913f-368c-48b9-8979-179f56991fc5 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:05.650179 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 96/179] 10.222.0.118 () {56 vars in 1379 bytes} [Thu Jul 14 15:23:05 2022] GET /identity/v3/role_assignments?user.id=59bb0f609774438d83c9741c52519818&scope.project.id=a99d762a7cad4fc1ac87113f5b01b5b2&role.id=4abcf5e5e7cd4b53ae1828fec6550d53 => generated 610 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:05.651724 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc9b8c4-f2ea-48d4-bca1-9b7d4c43f951 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:05.652203 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc9b8c4-f2ea-48d4-bca1-9b7d4c43f951 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:05.652687 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc9b8c4-f2ea-48d4-bca1-9b7d4c43f951 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:05.654215 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 97/180] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:23:05 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:23:05.655149 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc9b8c4-f2ea-48d4-bca1-9b7d4c43f951 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:05.655834 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47de7391-ee5c-4964-9b51-a633b62ae0d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:05.656713 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de7391-ee5c-4964-9b51-a633b62ae0d5 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:05.656994 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de7391-ee5c-4964-9b51-a633b62ae0d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:05.657265 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de7391-ee5c-4964-9b51-a633b62ae0d5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:05.686888 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47de7391-ee5c-4964-9b51-a633b62ae0d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:23:05.695907 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-47de7391-ee5c-4964-9b51-a633b62ae0d5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 15:23:05.695907 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:05.695907 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:05.695907 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:05.695907 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:05.695907 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:05.695907 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:05.695907 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:05.695907 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:05.695907 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:05.695907 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:05.695907 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:05.695907 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:23:05.695907 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:23:05.695907 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:23:05.695907 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:23:05.696855 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:23:05.696855 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:23:05.696855 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:23:05.696855 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:23:05.696855 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:05.696855 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:05.696855 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:05.696855 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:05.696855 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:05.696855 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:05.696855 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:05.696855 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:05.696855 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:05.696855 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:05.696855 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:05.696855 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:05.697610 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:05.697610 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:05.697610 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:05.697610 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:05.697610 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:23:05.697610 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:23:05.697610 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:23:05.697610 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:23:05.697610 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:23:05.697610 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:23:05.697610 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 15:23:05.697610 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:23:05.707056 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 84/181] 10.222.0.118 () {56 vars in 1104 bytes} [Thu Jul 14 15:23:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:05.708061 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47de7391-ee5c-4964-9b51-a633b62ae0d5 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:05.843607 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc9b8c4-f2ea-48d4-bca1-9b7d4c43f951 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:05.857180 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47de7391-ee5c-4964-9b51-a633b62ae0d5 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:05.889399 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2925dc2a-7093-445d-a594-4ea9478b2baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:05.890449 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2925dc2a-7093-445d-a594-4ea9478b2baa None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:05.890722 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2925dc2a-7093-445d-a594-4ea9478b2baa None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:05.891245 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2925dc2a-7093-445d-a594-4ea9478b2baa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:05.892523 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2925dc2a-7093-445d-a594-4ea9478b2baa None admin] RBAC: Adding query filter params (role.id=f4e85c621e6d4e749149099dd9303934, scope.project.id=a99d762a7cad4fc1ac87113f5b01b5b2, user.id=59bb0f609774438d83c9741c52519818) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:05.893102 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2925dc2a-7093-445d-a594-4ea9478b2baa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:05.894825 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2925dc2a-7093-445d-a594-4ea9478b2baa None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:05.897236 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8771d4e-46cd-426b-bcd4-2940b58680a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:05.898155 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8771d4e-46cd-426b-bcd4-2940b58680a0 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:05.898431 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8771d4e-46cd-426b-bcd4-2940b58680a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:05.898786 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8771d4e-46cd-426b-bcd4-2940b58680a0 None admin] PATH_INFO: `/v3/projects/2e878702c372449a92bd192b66f2b3a3` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:05.899976 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8771d4e-46cd-426b-bcd4-2940b58680a0 None admin] RBAC: Authorizing `identity:get_project(project_id=2e878702c372449a92bd192b66f2b3a3)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:05.901425 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8771d4e-46cd-426b-bcd4-2940b58680a0 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:05.902203 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 98/182] 10.222.0.118 () {56 vars in 1379 bytes} [Thu Jul 14 15:23:05 2022] GET /identity/v3/role_assignments?user.id=59bb0f609774438d83c9741c52519818&scope.project.id=a99d762a7cad4fc1ac87113f5b01b5b2&role.id=f4e85c621e6d4e749149099dd9303934 => generated 610 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:05.903453 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 85/183] 10.222.0.118 () {56 vars in 1191 bytes} [Thu Jul 14 15:23:05 2022] GET /identity/v3/projects/2e878702c372449a92bd192b66f2b3a3 => generated 313 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:05.903780 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cc39d2-d46a-4e55-9977-3f8e84e4f9b8 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:05.904071 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cc39d2-d46a-4e55-9977-3f8e84e4f9b8 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:05.904397 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cc39d2-d46a-4e55-9977-3f8e84e4f9b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:05.904665 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ac38d0-a0d4-4ac3-9004-64712a06436a None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:05.904946 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ac38d0-a0d4-4ac3-9004-64712a06436a None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:05.905218 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ac38d0-a0d4-4ac3-9004-64712a06436a None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:05.906669 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 86/184] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:23:05 2022] GET /identity => generated 271 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:23:05.907417 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ac38d0-a0d4-4ac3-9004-64712a06436a None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:05.926372 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:05.928060 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-72cc39d2-d46a-4e55-9977-3f8e84e4f9b8 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:05.928927 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-72cc39d2-d46a-4e55-9977-3f8e84e4f9b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:05.972487 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:06.010925 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 99/185] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:23:05 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:23:06.019670 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9429d21-f035-48da-9278-31c339c1fab3 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:06.020493 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9429d21-f035-48da-9278-31c339c1fab3 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:06.020755 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9429d21-f035-48da-9278-31c339c1fab3 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:06.022212 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 100/186] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:23:06 2022] GET /identity => generated 271 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:23:06.022943 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9429d21-f035-48da-9278-31c339c1fab3 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:06.046597 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ac38d0-a0d4-4ac3-9004-64712a06436a None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:06.086878 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecab49c-00a2-485b-b1bd-403e846479d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:06.087677 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecab49c-00a2-485b-b1bd-403e846479d3 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:06.087965 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecab49c-00a2-485b-b1bd-403e846479d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:06.088242 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecab49c-00a2-485b-b1bd-403e846479d3 None admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:06.089005 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecab49c-00a2-485b-b1bd-403e846479d3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:06.089315 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecab49c-00a2-485b-b1bd-403e846479d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:06.090855 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecab49c-00a2-485b-b1bd-403e846479d3 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:06.100891 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 87/187] 10.222.0.118 () {56 vars in 1106 bytes} [Thu Jul 14 15:23:05 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:06.102372 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99f3294-ea63-456f-b2f3-330a5db29ad0 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:06.102657 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99f3294-ea63-456f-b2f3-330a5db29ad0 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:06.102928 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99f3294-ea63-456f-b2f3-330a5db29ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:06.120824 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-c99f3294-ea63-456f-b2f3-330a5db29ad0 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:06.122164 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-c99f3294-ea63-456f-b2f3-330a5db29ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:06.143931 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9429d21-f035-48da-9278-31c339c1fab3 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:06.179622 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c2ec78-e404-4e77-a907-2d6464934f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:06.180337 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c2ec78-e404-4e77-a907-2d6464934f39 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:06.180611 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c2ec78-e404-4e77-a907-2d6464934f39 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:06.180881 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c2ec78-e404-4e77-a907-2d6464934f39 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:06.181712 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c2ec78-e404-4e77-a907-2d6464934f39 None admin] RBAC: Adding query filter params (role.id=4abcf5e5e7cd4b53ae1828fec6550d53, scope.project.id=2e878702c372449a92bd192b66f2b3a3, user.id=59bb0f609774438d83c9741c52519818) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:06.182061 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c2ec78-e404-4e77-a907-2d6464934f39 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:06.183616 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c2ec78-e404-4e77-a907-2d6464934f39 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:06.189727 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 101/188] 10.222.0.118 () {56 vars in 1379 bytes} [Thu Jul 14 15:23:06 2022] GET /identity/v3/role_assignments?user.id=59bb0f609774438d83c9741c52519818&scope.project.id=2e878702c372449a92bd192b66f2b3a3&role.id=4abcf5e5e7cd4b53ae1828fec6550d53 => generated 610 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:06.191164 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f08b4ad-dc7b-4780-8611-ab0af47adb79 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:06.191513 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f08b4ad-dc7b-4780-8611-ab0af47adb79 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:06.192448 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f08b4ad-dc7b-4780-8611-ab0af47adb79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:06.194026 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:06.206159 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 88/189] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:23:06 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:23:06.207855 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99f3294-ea63-456f-b2f3-330a5db29ad0 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:06.211321 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-5f08b4ad-dc7b-4780-8611-ab0af47adb79 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:06.213005 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-5f08b4ad-dc7b-4780-8611-ab0af47adb79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:06.247126 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:06.292080 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 102/190] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:23:06 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:23:06.293277 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f08b4ad-dc7b-4780-8611-ab0af47adb79 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:06.338215 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99f3294-ea63-456f-b2f3-330a5db29ad0 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:06.385263 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadb1ca4-1fc4-431e-b764-4e2b8d8ea774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:06.386173 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb1ca4-1fc4-431e-b764-4e2b8d8ea774 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:06.386454 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb1ca4-1fc4-431e-b764-4e2b8d8ea774 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:06.386894 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb1ca4-1fc4-431e-b764-4e2b8d8ea774 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:06.400318 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadb1ca4-1fc4-431e-b764-4e2b8d8ea774 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:23:06.406835 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f08b4ad-dc7b-4780-8611-ab0af47adb79 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:06.408832 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-fadb1ca4-1fc4-431e-b764-4e2b8d8ea774 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:23:06.408832 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:06.408832 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:06.408832 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:06.408832 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:06.408832 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:06.408832 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:06.408832 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:06.408832 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:06.408832 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:06.408832 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:06.408832 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:06.408832 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:23:06.408832 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:23:06.408832 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:23:06.408832 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:23:06.409723 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:23:06.409723 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:23:06.409723 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:23:06.409723 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:23:06.409723 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:06.409723 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:06.409723 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:06.409723 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:06.409723 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:06.409723 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:06.409723 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:06.409723 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:06.409723 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:06.409723 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:06.409723 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:06.409723 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:06.414838 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:06.414838 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:06.414838 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:06.414838 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:06.414838 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:23:06.414838 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:23:06.414838 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:23:06.414838 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:23:06.414838 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:23:06.414838 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:23:06.414838 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:23:06.414838 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:23:06.414838 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 89/191] 10.222.0.118 () {56 vars in 1101 bytes} [Thu Jul 14 15:23:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:06.414838 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadb1ca4-1fc4-431e-b764-4e2b8d8ea774 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:06.447599 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b4b412-05f9-4066-a558-ac2bfdd3a04c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:06.448477 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b4b412-05f9-4066-a558-ac2bfdd3a04c None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:06.448760 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b4b412-05f9-4066-a558-ac2bfdd3a04c None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:06.449032 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b4b412-05f9-4066-a558-ac2bfdd3a04c None admin] PATH_INFO: `/v3/users/345265699b4e46cfbcf188bfe47c22fa` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:06.450252 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b4b412-05f9-4066-a558-ac2bfdd3a04c None admin] RBAC: Authorizing `identity:get_user(user_id=345265699b4e46cfbcf188bfe47c22fa)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:06.451697 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b4b412-05f9-4066-a558-ac2bfdd3a04c None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:06.453496 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 103/192] 10.222.0.118 () {56 vars in 1182 bytes} [Thu Jul 14 15:23:06 2022] GET /identity/v3/users/345265699b4e46cfbcf188bfe47c22fa => generated 290 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:06.454205 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b4b412-05f9-4066-a558-ac2bfdd3a04c None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:06.475585 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:06.488701 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:06.519188 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadb1ca4-1fc4-431e-b764-4e2b8d8ea774 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:06.563921 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcc025d-d1dd-469f-97e3-00a476ec9a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:06.565177 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc025d-d1dd-469f-97e3-00a476ec9a01 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:06.565669 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc025d-d1dd-469f-97e3-00a476ec9a01 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:06.566150 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc025d-d1dd-469f-97e3-00a476ec9a01 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:06.567888 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcc025d-d1dd-469f-97e3-00a476ec9a01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:06.570476 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcc025d-d1dd-469f-97e3-00a476ec9a01 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:06.573308 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 90/193] 10.222.0.118 () {56 vars in 1113 bytes} [Thu Jul 14 15:23:06 2022] GET /identity/v3/domains/default => generated 200 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:06.574410 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcc025d-d1dd-469f-97e3-00a476ec9a01 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:06.584534 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b4b412-05f9-4066-a558-ac2bfdd3a04c None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:06.621067 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffe4b0f-44cb-49ab-9b48-d953cefba1d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:06.621872 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffe4b0f-44cb-49ab-9b48-d953cefba1d8 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:06.622176 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffe4b0f-44cb-49ab-9b48-d953cefba1d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:06.622448 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffe4b0f-44cb-49ab-9b48-d953cefba1d8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:06.633652 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffe4b0f-44cb-49ab-9b48-d953cefba1d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:23:06.642153 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-fffe4b0f-44cb-49ab-9b48-d953cefba1d8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 15:23:06.642153 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:06.642153 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:06.642153 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:06.642153 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:06.642153 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:06.642153 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:06.642153 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:06.642153 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:06.642153 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:06.642153 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:06.642153 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:06.642153 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:23:06.642153 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:23:06.642153 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:23:06.642153 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:23:06.642999 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:23:06.642999 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:23:06.642999 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:23:06.642999 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:23:06.642999 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:06.642999 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:06.642999 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:06.642999 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:06.642999 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:06.642999 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:06.642999 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:06.642999 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:06.642999 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:06.642999 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:06.642999 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:06.642999 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:06.643956 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:06.643956 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:06.643956 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:06.643956 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:06.643956 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:23:06.643956 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:23:06.643956 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:23:06.643956 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:23:06.643956 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:23:06.643956 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:23:06.643956 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 15:23:06.643956 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:23:06.643956 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 104/194] 10.222.0.118 () {56 vars in 1119 bytes} [Thu Jul 14 15:23:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:06.644953 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffe4b0f-44cb-49ab-9b48-d953cefba1d8 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:06.684257 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcc025d-d1dd-469f-97e3-00a476ec9a01 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:06.712391 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:06.720896 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198dc102-aed4-4570-9b52-9be6eb30c4cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:06.721573 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198dc102-aed4-4570-9b52-9be6eb30c4cd None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:06.721897 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198dc102-aed4-4570-9b52-9be6eb30c4cd None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:06.722316 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198dc102-aed4-4570-9b52-9be6eb30c4cd None admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:06.723566 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198dc102-aed4-4570-9b52-9be6eb30c4cd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:06.723881 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198dc102-aed4-4570-9b52-9be6eb30c4cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:06.725328 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198dc102-aed4-4570-9b52-9be6eb30c4cd None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:06.733768 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 91/195] 10.222.0.118 () {56 vars in 1104 bytes} [Thu Jul 14 15:23:06 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:06.734603 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198dc102-aed4-4570-9b52-9be6eb30c4cd None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:06.736612 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:06.743891 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffe4b0f-44cb-49ab-9b48-d953cefba1d8 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:06.778742 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f52f6d-595d-462d-b0fb-c0756c0aecd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:06.779384 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f52f6d-595d-462d-b0fb-c0756c0aecd6 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:06.779658 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f52f6d-595d-462d-b0fb-c0756c0aecd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:06.779927 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f52f6d-595d-462d-b0fb-c0756c0aecd6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:06.836739 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198dc102-aed4-4570-9b52-9be6eb30c4cd None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:06.845416 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f52f6d-595d-462d-b0fb-c0756c0aecd6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:06.846927 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f52f6d-595d-462d-b0fb-c0756c0aecd6 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:06.871256 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e387784-d3c0-420b-9535-08095e234485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:06.871929 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e387784-d3c0-420b-9535-08095e234485 None admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:06.872208 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e387784-d3c0-420b-9535-08095e234485 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:06.872492 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e387784-d3c0-420b-9535-08095e234485 None admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:06.873200 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e387784-d3c0-420b-9535-08095e234485 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:06.874685 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e387784-d3c0-420b-9535-08095e234485 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:06.912155 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 92/196] 10.222.0.118 () {60 vars in 1137 bytes} [Thu Jul 14 15:23:06 2022] POST /identity/v3/users => generated 298 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:23:06.913017 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e387784-d3c0-420b-9535-08095e234485 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:06.958280 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:06.966271 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 105/197] 10.222.0.118 () {58 vars in 1287 bytes} [Thu Jul 14 15:23:06 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 15:23:06.970224 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:06.972259 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f52f6d-595d-462d-b0fb-c0756c0aecd6 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:07.041363 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e387784-d3c0-420b-9535-08095e234485 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:07.086858 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4dbdca-5a37-4be6-ab8c-8049c342fedf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:07.087539 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4dbdca-5a37-4be6-ab8c-8049c342fedf None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:07.087819 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4dbdca-5a37-4be6-ab8c-8049c342fedf None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:07.088092 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4dbdca-5a37-4be6-ab8c-8049c342fedf None admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:07.088855 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4dbdca-5a37-4be6-ab8c-8049c342fedf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:07.089215 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4dbdca-5a37-4be6-ab8c-8049c342fedf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:07.090622 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4dbdca-5a37-4be6-ab8c-8049c342fedf None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:07.091051 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f52f6d-595d-462d-b0fb-c0756c0aecd6 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:07.100748 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 93/198] 10.222.0.118 () {56 vars in 1116 bytes} [Thu Jul 14 15:23:06 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:07.101619 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4dbdca-5a37-4be6-ab8c-8049c342fedf None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:07.132224 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aec65a0-96d9-440e-9fb4-ffbddf20a7a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:07.133103 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aec65a0-96d9-440e-9fb4-ffbddf20a7a7 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:07.133378 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aec65a0-96d9-440e-9fb4-ffbddf20a7a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:07.134455 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aec65a0-96d9-440e-9fb4-ffbddf20a7a7 None admin] PATH_INFO: `/v3/users/d7718e3f40714979a409bc48aa549c8a` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:07.149702 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aec65a0-96d9-440e-9fb4-ffbddf20a7a7 None admin] RBAC: Authorizing `identity:get_user(user_id=d7718e3f40714979a409bc48aa549c8a)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:07.152570 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aec65a0-96d9-440e-9fb4-ffbddf20a7a7 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:07.156240 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 106/199] 10.222.0.118 () {56 vars in 1182 bytes} [Thu Jul 14 15:23:06 2022] GET /identity/v3/users/d7718e3f40714979a409bc48aa549c8a => generated 284 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:07.156240 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aec65a0-96d9-440e-9fb4-ffbddf20a7a7 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:07.221714 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:07.234309 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4dbdca-5a37-4be6-ab8c-8049c342fedf None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:07.247856 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:07.279720 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b4a848-2b9a-413b-a58f-1cfceef2b162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:07.280590 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b4a848-2b9a-413b-a58f-1cfceef2b162 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:07.280872 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b4a848-2b9a-413b-a58f-1cfceef2b162 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:07.281146 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b4a848-2b9a-413b-a58f-1cfceef2b162 None admin] PATH_INFO: `/v3/projects/a99d762a7cad4fc1ac87113f5b01b5b2` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:07.282481 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b4a848-2b9a-413b-a58f-1cfceef2b162 None admin] RBAC: Authorizing `identity:get_project(project_id=a99d762a7cad4fc1ac87113f5b01b5b2)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:07.284061 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b4a848-2b9a-413b-a58f-1cfceef2b162 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:07.286455 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 94/200] 10.222.0.118 () {56 vars in 1191 bytes} [Thu Jul 14 15:23:07 2022] GET /identity/v3/projects/a99d762a7cad4fc1ac87113f5b01b5b2 => generated 299 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:07.287399 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b4a848-2b9a-413b-a58f-1cfceef2b162 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:07.290704 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aec65a0-96d9-440e-9fb4-ffbddf20a7a7 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:07.327873 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04025fab-e248-40c8-ba1b-c3a4e2b2b3ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:07.329198 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04025fab-e248-40c8-ba1b-c3a4e2b2b3ea None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:07.329771 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04025fab-e248-40c8-ba1b-c3a4e2b2b3ea None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:07.330261 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04025fab-e248-40c8-ba1b-c3a4e2b2b3ea None admin] PATH_INFO: `/v3/users/d7718e3f40714979a409bc48aa549c8a` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:07.332222 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04025fab-e248-40c8-ba1b-c3a4e2b2b3ea None admin] RBAC: Authorizing `identity:get_user(user_id=d7718e3f40714979a409bc48aa549c8a)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:07.334065 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04025fab-e248-40c8-ba1b-c3a4e2b2b3ea None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:07.336371 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 107/201] 10.222.0.118 () {56 vars in 1182 bytes} [Thu Jul 14 15:23:07 2022] GET /identity/v3/users/d7718e3f40714979a409bc48aa549c8a => generated 284 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:07.337440 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04025fab-e248-40c8-ba1b-c3a4e2b2b3ea None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:07.396914 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b4a848-2b9a-413b-a58f-1cfceef2b162 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:07.434275 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6802359-b0c5-453c-89ef-f9798f2d826d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:07.434938 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6802359-b0c5-453c-89ef-f9798f2d826d None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:07.435220 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6802359-b0c5-453c-89ef-f9798f2d826d None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:07.435491 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6802359-b0c5-453c-89ef-f9798f2d826d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:07.451021 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04025fab-e248-40c8-ba1b-c3a4e2b2b3ea None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:07.475906 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:07.486504 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:07.494523 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4547df-c9da-41b4-b3f9-4ca8acdd9099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:07.495487 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4547df-c9da-41b4-b3f9-4ca8acdd9099 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:07.495957 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4547df-c9da-41b4-b3f9-4ca8acdd9099 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:07.496438 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4547df-c9da-41b4-b3f9-4ca8acdd9099 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:07.497580 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4547df-c9da-41b4-b3f9-4ca8acdd9099 None admin] RBAC: Adding query filter params (role.id=63af4c63b0c343909af17164f6e26a71, scope.project.id=a99d762a7cad4fc1ac87113f5b01b5b2, user.id=345265699b4e46cfbcf188bfe47c22fa) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:07.498195 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4547df-c9da-41b4-b3f9-4ca8acdd9099 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:07.499950 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4547df-c9da-41b4-b3f9-4ca8acdd9099 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:07.507618 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 108/202] 10.222.0.118 () {56 vars in 1379 bytes} [Thu Jul 14 15:23:07 2022] GET /identity/v3/role_assignments?user.id=345265699b4e46cfbcf188bfe47c22fa&scope.project.id=a99d762a7cad4fc1ac87113f5b01b5b2&role.id=63af4c63b0c343909af17164f6e26a71 => generated 610 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:07.508837 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4547df-c9da-41b4-b3f9-4ca8acdd9099 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:07.511590 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6802359-b0c5-453c-89ef-f9798f2d826d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:07.513622 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6802359-b0c5-453c-89ef-f9798f2d826d None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:07.626297 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4547df-c9da-41b4-b3f9-4ca8acdd9099 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:07.626912 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 95/203] 10.222.0.118 () {58 vars in 1287 bytes} [Thu Jul 14 15:23:07 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 15:23:07.635479 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6802359-b0c5-453c-89ef-f9798f2d826d None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:07.670268 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07c1a72-92f3-4dbc-967b-cc81bd4401ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:07.672863 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07c1a72-92f3-4dbc-967b-cc81bd4401ee None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:07.673607 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07c1a72-92f3-4dbc-967b-cc81bd4401ee None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:07.674292 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07c1a72-92f3-4dbc-967b-cc81bd4401ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:07.755100 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:07.766729 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:07.777125 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07c1a72-92f3-4dbc-967b-cc81bd4401ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:07.778770 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07c1a72-92f3-4dbc-967b-cc81bd4401ee None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:07.799542 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6802359-b0c5-453c-89ef-f9798f2d826d None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:07.840080 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5076d832-a0de-4a58-91ed-939842ae281a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:07.841775 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5076d832-a0de-4a58-91ed-939842ae281a None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:07.842324 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5076d832-a0de-4a58-91ed-939842ae281a None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:07.842737 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5076d832-a0de-4a58-91ed-939842ae281a None admin] PATH_INFO: `/v3/projects/9d45367dfdd34d7ab5e0b055eda4e88e` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:07.844160 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5076d832-a0de-4a58-91ed-939842ae281a None admin] RBAC: Authorizing `identity:get_project(project_id=9d45367dfdd34d7ab5e0b055eda4e88e)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:07.845947 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5076d832-a0de-4a58-91ed-939842ae281a None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:07.847981 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 96/204] 10.222.0.118 () {56 vars in 1191 bytes} [Thu Jul 14 15:23:07 2022] GET /identity/v3/projects/9d45367dfdd34d7ab5e0b055eda4e88e => generated 303 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:07.856152 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5076d832-a0de-4a58-91ed-939842ae281a None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:07.892158 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 109/205] 10.222.0.118 () {58 vars in 1287 bytes} [Thu Jul 14 15:23:07 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 15:23:07.899472 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07c1a72-92f3-4dbc-967b-cc81bd4401ee None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:07.982839 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5076d832-a0de-4a58-91ed-939842ae281a None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:08.010338 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:08.025586 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e1ee7b-c5da-4a66-b36e-65a7c9186cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:08.025763 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07c1a72-92f3-4dbc-967b-cc81bd4401ee None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:08.026691 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e1ee7b-c5da-4a66-b36e-65a7c9186cb2 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:08.027182 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e1ee7b-c5da-4a66-b36e-65a7c9186cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:08.027660 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e1ee7b-c5da-4a66-b36e-65a7c9186cb2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:08.028691 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e1ee7b-c5da-4a66-b36e-65a7c9186cb2 None admin] RBAC: Adding query filter params (role.id=3b880cef7dcf4baf87b50f8610c0c56e, scope.project.id=9d45367dfdd34d7ab5e0b055eda4e88e, user.id=d7718e3f40714979a409bc48aa549c8a) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:08.029202 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e1ee7b-c5da-4a66-b36e-65a7c9186cb2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:08.030874 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e1ee7b-c5da-4a66-b36e-65a7c9186cb2 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:08.037600 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 97/206] 10.222.0.118 () {56 vars in 1379 bytes} [Thu Jul 14 15:23:07 2022] GET /identity/v3/role_assignments?user.id=d7718e3f40714979a409bc48aa549c8a&scope.project.id=9d45367dfdd34d7ab5e0b055eda4e88e&role.id=3b880cef7dcf4baf87b50f8610c0c56e => generated 260 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:23:08.063934 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8fd1f6-1650-46e7-b20b-edf6ed9488db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:08.064837 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8fd1f6-1650-46e7-b20b-edf6ed9488db None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:08.065118 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8fd1f6-1650-46e7-b20b-edf6ed9488db None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:08.065544 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8fd1f6-1650-46e7-b20b-edf6ed9488db None admin] PATH_INFO: `/v3/projects/9d45367dfdd34d7ab5e0b055eda4e88e` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:08.067375 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8fd1f6-1650-46e7-b20b-edf6ed9488db None admin] RBAC: Authorizing `identity:get_project(project_id=9d45367dfdd34d7ab5e0b055eda4e88e)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:08.068867 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8fd1f6-1650-46e7-b20b-edf6ed9488db None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:08.070999 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 110/207] 10.222.0.118 () {56 vars in 1191 bytes} [Thu Jul 14 15:23:07 2022] GET /identity/v3/projects/9d45367dfdd34d7ab5e0b055eda4e88e => generated 303 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:23:08.077021 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e1ee7b-c5da-4a66-b36e-65a7c9186cb2 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:08.089549 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:08.197035 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e1ee7b-c5da-4a66-b36e-65a7c9186cb2 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:08.233902 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c92878-04e1-47e1-9661-7079c779f64d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:08.234527 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c92878-04e1-47e1-9661-7079c779f64d None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:08.234809 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c92878-04e1-47e1-9661-7079c779f64d None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:08.235085 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c92878-04e1-47e1-9661-7079c779f64d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:08.235926 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c92878-04e1-47e1-9661-7079c779f64d None admin] RBAC: Adding query filter params (role.id=f4e85c621e6d4e749149099dd9303934, scope.project.id=9d45367dfdd34d7ab5e0b055eda4e88e, user.id=d7718e3f40714979a409bc48aa549c8a) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:08.236245 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c92878-04e1-47e1-9661-7079c779f64d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:08.237807 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c92878-04e1-47e1-9661-7079c779f64d None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:08.244465 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 98/208] 10.222.0.118 () {56 vars in 1379 bytes} [Thu Jul 14 15:23:08 2022] GET /identity/v3/role_assignments?user.id=d7718e3f40714979a409bc48aa549c8a&scope.project.id=9d45367dfdd34d7ab5e0b055eda4e88e&role.id=f4e85c621e6d4e749149099dd9303934 => generated 260 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:09.260297 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f41547-d227-43b8-b2b4-181cdc664c84 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:09.260842 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f41547-d227-43b8-b2b4-181cdc664c84 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:09.260842 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f41547-d227-43b8-b2b4-181cdc664c84 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:09.262526 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 111/209] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:23:09 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:23:09.267731 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca154b81-87f2-4463-95ac-6453239c2d50 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:09.268126 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca154b81-87f2-4463-95ac-6453239c2d50 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:09.268293 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca154b81-87f2-4463-95ac-6453239c2d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:09.282602 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73551a0b-78c0-42ac-8728-5fe4e5fad788 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:09.282877 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73551a0b-78c0-42ac-8728-5fe4e5fad788 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:09.283156 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73551a0b-78c0-42ac-8728-5fe4e5fad788 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:09.284605 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 112/210] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:23:09 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 14 15:23:09.287171 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-ca154b81-87f2-4463-95ac-6453239c2d50 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:09.288589 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-ca154b81-87f2-4463-95ac-6453239c2d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:09.290170 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f7f408-00e8-45cb-b281-136c86db1dde None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:09.290451 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f7f408-00e8-45cb-b281-136c86db1dde None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:09.290723 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f7f408-00e8-45cb-b281-136c86db1dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:09.307164 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-a7f7f408-00e8-45cb-b281-136c86db1dde None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:09.308472 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-a7f7f408-00e8-45cb-b281-136c86db1dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:09.367972 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 99/211] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:23:09 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 15:23:09.389828 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 113/212] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:23:09 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 15:23:09.395802 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca154b81-87f2-4463-95ac-6453239c2d50 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:09.398027 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:09.419459 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f7f408-00e8-45cb-b281-136c86db1dde None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:09.502422 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca154b81-87f2-4463-95ac-6453239c2d50 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:09.511586 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:09.532039 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f7f408-00e8-45cb-b281-136c86db1dde None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:09.544447 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae42e19-5284-4aac-9820-f62a72eb853c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:09.545265 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae42e19-5284-4aac-9820-f62a72eb853c None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:09.545586 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae42e19-5284-4aac-9820-f62a72eb853c None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:09.545936 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae42e19-5284-4aac-9820-f62a72eb853c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:09.557792 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae42e19-5284-4aac-9820-f62a72eb853c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:23:09.567228 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-fae42e19-5284-4aac-9820-f62a72eb853c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 15:23:09.567228 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:09.567228 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:09.567228 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:09.567228 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:09.567228 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:09.567228 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:09.567228 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:09.567228 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:09.567228 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:09.567228 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:09.567228 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:09.567228 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:23:09.567228 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:23:09.567228 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:23:09.567228 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:23:09.568125 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:23:09.568125 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:23:09.568125 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:23:09.568125 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:23:09.568125 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:09.568125 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:09.568125 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:09.568125 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:09.568125 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:09.568125 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:09.568125 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:09.568125 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:09.568125 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:09.568125 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:09.568125 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:09.568125 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:09.568897 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:09.568897 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:09.568897 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:09.568897 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:09.568897 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:23:09.568897 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:23:09.568897 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:23:09.568897 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:23:09.568897 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:23:09.568897 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:23:09.568897 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 15:23:09.568897 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:23:09.568897 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 100/213] 10.222.0.118 () {56 vars in 1104 bytes} [Thu Jul 14 15:23:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:09.573049 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607e3820-bc97-41d8-a424-9fd98c75260f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:09.573861 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e3820-bc97-41d8-a424-9fd98c75260f None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:09.574166 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e3820-bc97-41d8-a424-9fd98c75260f None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:09.574440 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e3820-bc97-41d8-a424-9fd98c75260f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:09.574778 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae42e19-5284-4aac-9820-f62a72eb853c None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:09.575646 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607e3820-bc97-41d8-a424-9fd98c75260f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:09.577107 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607e3820-bc97-41d8-a424-9fd98c75260f None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:09.583779 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 114/214] 10.222.0.118 () {56 vars in 1113 bytes} [Thu Jul 14 15:23:09 2022] GET /identity/v3/domains/default => generated 200 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:09.585351 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607e3820-bc97-41d8-a424-9fd98c75260f None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:09.645476 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:09.690080 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae42e19-5284-4aac-9820-f62a72eb853c None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:09.692658 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607e3820-bc97-41d8-a424-9fd98c75260f None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:09.727937 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345e9fc9-1029-44c4-8716-8083955dc500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:09.728601 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e9fc9-1029-44c4-8716-8083955dc500 None admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:09.728876 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e9fc9-1029-44c4-8716-8083955dc500 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:09.729147 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e9fc9-1029-44c4-8716-8083955dc500 None admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:09.729864 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345e9fc9-1029-44c4-8716-8083955dc500 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:09.731330 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345e9fc9-1029-44c4-8716-8083955dc500 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:09.744630 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e577416-5433-418d-95b3-e203ff3811c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:09.745718 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e577416-5433-418d-95b3-e203ff3811c2 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:09.746377 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e577416-5433-418d-95b3-e203ff3811c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:09.746963 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e577416-5433-418d-95b3-e203ff3811c2 None admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:09.748086 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e577416-5433-418d-95b3-e203ff3811c2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:09.748826 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e577416-5433-418d-95b3-e203ff3811c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:09.750923 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e577416-5433-418d-95b3-e203ff3811c2 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:09.756032 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 115/215] 10.222.0.118 () {60 vars in 1137 bytes} [Thu Jul 14 15:23:09 2022] POST /identity/v3/users => generated 298 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:23:09.762023 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 101/216] 10.222.0.118 () {56 vars in 1106 bytes} [Thu Jul 14 15:23:09 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:09.770675 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345e9fc9-1029-44c4-8716-8083955dc500 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:09.818372 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:09.891500 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345e9fc9-1029-44c4-8716-8083955dc500 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:09.929189 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89a2755-305a-4d29-aa6f-c05ddfa80f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:09.930114 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a2755-305a-4d29-aa6f-c05ddfa80f44 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:09.930394 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a2755-305a-4d29-aa6f-c05ddfa80f44 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:09.930667 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a2755-305a-4d29-aa6f-c05ddfa80f44 None admin] PATH_INFO: `/v3/users/4e63e348b2e347e3b2b8b76ad83ba9e9` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:09.945888 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89a2755-305a-4d29-aa6f-c05ddfa80f44 None admin] RBAC: Authorizing `identity:get_user(user_id=4e63e348b2e347e3b2b8b76ad83ba9e9)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:09.947395 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89a2755-305a-4d29-aa6f-c05ddfa80f44 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:09.949487 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 116/217] 10.222.0.118 () {56 vars in 1182 bytes} [Thu Jul 14 15:23:09 2022] GET /identity/v3/users/4e63e348b2e347e3b2b8b76ad83ba9e9 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:09.955021 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e577416-5433-418d-95b3-e203ff3811c2 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:10.072451 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e577416-5433-418d-95b3-e203ff3811c2 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:10.099257 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:10.111392 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3e1624-12d9-4a25-a94a-9316f6adeb70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:10.112055 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3e1624-12d9-4a25-a94a-9316f6adeb70 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:10.112336 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3e1624-12d9-4a25-a94a-9316f6adeb70 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:10.112607 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3e1624-12d9-4a25-a94a-9316f6adeb70 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:10.151727 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0eb160-c2b2-40b2-a851-977e35f1c66c None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:10.152029 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0eb160-c2b2-40b2-a851-977e35f1c66c None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:10.152278 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0eb160-c2b2-40b2-a851-977e35f1c66c None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:10.153832 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 117/218] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:23:10 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:23:10.159650 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea52ba-361c-4b6f-90b5-7d38b32a921d None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:10.159930 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea52ba-361c-4b6f-90b5-7d38b32a921d None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:10.160310 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea52ba-361c-4b6f-90b5-7d38b32a921d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:10.185606 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-5cea52ba-361c-4b6f-90b5-7d38b32a921d None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:10.187013 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-5cea52ba-361c-4b6f-90b5-7d38b32a921d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:10.189309 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3e1624-12d9-4a25-a94a-9316f6adeb70 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:10.190834 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3e1624-12d9-4a25-a94a-9316f6adeb70 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:10.266967 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:10.275831 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 118/219] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:23:10 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:23:10.298502 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cea52ba-361c-4b6f-90b5-7d38b32a921d None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:10.330363 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 102/220] 10.222.0.118 () {58 vars in 1287 bytes} [Thu Jul 14 15:23:09 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 15:23:10.334747 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3e1624-12d9-4a25-a94a-9316f6adeb70 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:10.376679 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:10.440463 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cea52ba-361c-4b6f-90b5-7d38b32a921d None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:10.487990 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3e1624-12d9-4a25-a94a-9316f6adeb70 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:10.496238 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdaddbd-2adf-41bf-a1a6-3f06e868529f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:10.497136 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdaddbd-2adf-41bf-a1a6-3f06e868529f None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:10.497481 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdaddbd-2adf-41bf-a1a6-3f06e868529f None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:10.497821 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdaddbd-2adf-41bf-a1a6-3f06e868529f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:10.509375 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdaddbd-2adf-41bf-a1a6-3f06e868529f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:23:10.517087 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-7cdaddbd-2adf-41bf-a1a6-3f06e868529f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:23:10.517087 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:10.517087 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:10.517087 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:10.517087 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:10.517087 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:10.517087 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:10.517087 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:10.517087 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:10.517087 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:10.517087 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:10.517087 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:10.517087 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:23:10.517087 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:23:10.517087 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:23:10.517087 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:23:10.517946 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:23:10.517946 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:23:10.517946 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:23:10.517946 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:23:10.517946 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:10.517946 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:10.517946 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:10.517946 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:10.517946 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:10.517946 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:10.517946 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:10.517946 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:10.517946 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:10.517946 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:10.517946 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:10.517946 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:10.519141 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:10.519141 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:10.519141 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:10.519141 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:10.519141 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:23:10.519141 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:23:10.519141 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:23:10.519141 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:23:10.519141 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:23:10.519141 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:23:10.519141 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:23:10.519141 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:23:10.519141 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 119/221] 10.222.0.118 () {56 vars in 1101 bytes} [Thu Jul 14 15:23:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:10.525647 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbbec22-ea7e-4c73-ac8b-07cc4c8809d4 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:10.525793 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbbec22-ea7e-4c73-ac8b-07cc4c8809d4 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:10.526130 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbbec22-ea7e-4c73-ac8b-07cc4c8809d4 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:10.527547 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 120/222] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:23:10 2022] GET /identity => generated 271 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:23:10.531806 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbbec22-ea7e-4c73-ac8b-07cc4c8809d4 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:10.540431 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1c763c-975e-45ef-80a7-d4a00432cafc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:10.541314 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1c763c-975e-45ef-80a7-d4a00432cafc None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:10.541602 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1c763c-975e-45ef-80a7-d4a00432cafc None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:10.541869 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1c763c-975e-45ef-80a7-d4a00432cafc None admin] PATH_INFO: `/v3/projects/9d45367dfdd34d7ab5e0b055eda4e88e` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:10.543184 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1c763c-975e-45ef-80a7-d4a00432cafc None admin] RBAC: Authorizing `identity:get_project(project_id=9d45367dfdd34d7ab5e0b055eda4e88e)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:10.544630 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1c763c-975e-45ef-80a7-d4a00432cafc None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:10.551150 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 103/223] 10.222.0.118 () {56 vars in 1191 bytes} [Thu Jul 14 15:23:10 2022] GET /identity/v3/projects/9d45367dfdd34d7ab5e0b055eda4e88e => generated 303 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:23:10.551150 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e48513c-55dd-42c4-9267-ef0e25f143de None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:10.551150 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e48513c-55dd-42c4-9267-ef0e25f143de None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:10.551150 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e48513c-55dd-42c4-9267-ef0e25f143de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:10.568199 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-6e48513c-55dd-42c4-9267-ef0e25f143de None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:10.569555 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-6e48513c-55dd-42c4-9267-ef0e25f143de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:10.607365 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:10.658328 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbbec22-ea7e-4c73-ac8b-07cc4c8809d4 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:10.671630 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 104/224] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:23:10 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:23:10.672806 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e48513c-55dd-42c4-9267-ef0e25f143de None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:10.700870 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:10.716376 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b042cc8-572b-43af-9b8e-01b827145318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:10.717882 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b042cc8-572b-43af-9b8e-01b827145318 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:10.717882 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b042cc8-572b-43af-9b8e-01b827145318 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:10.717882 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b042cc8-572b-43af-9b8e-01b827145318 None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:10.718733 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b042cc8-572b-43af-9b8e-01b827145318 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:10.719140 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b042cc8-572b-43af-9b8e-01b827145318 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:10.720766 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b042cc8-572b-43af-9b8e-01b827145318 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:10.731664 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 121/225] 10.222.0.118 () {56 vars in 1104 bytes} [Thu Jul 14 15:23:10 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:10.732745 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b042cc8-572b-43af-9b8e-01b827145318 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:10.804433 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e48513c-55dd-42c4-9267-ef0e25f143de None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:10.842297 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b042cc8-572b-43af-9b8e-01b827145318 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:10.850080 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4ef471-cdc9-46de-a9e3-3ecfd8cc02cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:10.850753 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4ef471-cdc9-46de-a9e3-3ecfd8cc02cd None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:10.851033 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4ef471-cdc9-46de-a9e3-3ecfd8cc02cd None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:10.851344 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4ef471-cdc9-46de-a9e3-3ecfd8cc02cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:10.852750 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4ef471-cdc9-46de-a9e3-3ecfd8cc02cd None admin] RBAC: Adding query filter params (role.id=4abcf5e5e7cd4b53ae1828fec6550d53, scope.project.id=9d45367dfdd34d7ab5e0b055eda4e88e, user.id=4e63e348b2e347e3b2b8b76ad83ba9e9) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:10.853064 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4ef471-cdc9-46de-a9e3-3ecfd8cc02cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:10.855048 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4ef471-cdc9-46de-a9e3-3ecfd8cc02cd None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:10.862434 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:10.864070 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 105/226] 10.222.0.118 () {56 vars in 1379 bytes} [Thu Jul 14 15:23:10 2022] GET /identity/v3/role_assignments?user.id=4e63e348b2e347e3b2b8b76ad83ba9e9&scope.project.id=9d45367dfdd34d7ab5e0b055eda4e88e&role.id=4abcf5e5e7cd4b53ae1828fec6550d53 => generated 260 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:10.870952 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4ef471-cdc9-46de-a9e3-3ecfd8cc02cd None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:10.900133 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ce1f07-1fd8-4b91-996a-becee2a01c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:10.901399 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ce1f07-1fd8-4b91-996a-becee2a01c70 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:10.901907 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ce1f07-1fd8-4b91-996a-becee2a01c70 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:10.902513 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ce1f07-1fd8-4b91-996a-becee2a01c70 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:10.923146 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ce1f07-1fd8-4b91-996a-becee2a01c70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:23:10.933151 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-a8ce1f07-1fd8-4b91-996a-becee2a01c70 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 15:23:10.933151 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:10.933151 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:10.933151 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:10.933151 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:10.933151 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:10.933151 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:10.933151 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:10.933151 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:10.933151 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:10.933151 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:10.933151 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:10.933151 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:23:10.933151 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:23:10.933151 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:23:10.933151 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:23:10.934135 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:23:10.934135 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:23:10.934135 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:23:10.934135 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:23:10.934135 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:10.934135 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:10.934135 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:10.934135 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:10.934135 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:10.934135 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:10.934135 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:10.934135 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:10.934135 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:10.934135 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:10.934135 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:10.934135 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:10.934938 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:10.934938 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:10.934938 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:10.934938 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:10.934938 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:23:10.934938 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:23:10.934938 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:23:10.934938 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:23:10.934938 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:23:10.934938 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:23:10.934938 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 15:23:10.934938 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:23:10.937612 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 122/227] 10.222.0.118 () {56 vars in 1119 bytes} [Thu Jul 14 15:23:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:10.945538 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ce1f07-1fd8-4b91-996a-becee2a01c70 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:11.072265 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:11.091648 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4ef471-cdc9-46de-a9e3-3ecfd8cc02cd None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:11.110160 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ce1f07-1fd8-4b91-996a-becee2a01c70 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:11.146714 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f534b06-8066-4714-aead-5c3b5e4dd888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:11.148230 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f534b06-8066-4714-aead-5c3b5e4dd888 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:11.150299 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f534b06-8066-4714-aead-5c3b5e4dd888 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:11.150782 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f534b06-8066-4714-aead-5c3b5e4dd888 None admin] PATH_INFO: `/v3/users/d7718e3f40714979a409bc48aa549c8a` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:11.153536 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f534b06-8066-4714-aead-5c3b5e4dd888 None admin] RBAC: Authorizing `identity:get_user(user_id=d7718e3f40714979a409bc48aa549c8a)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:11.157212 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f534b06-8066-4714-aead-5c3b5e4dd888 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:11.162474 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 106/228] 10.222.0.118 () {56 vars in 1182 bytes} [Thu Jul 14 15:23:10 2022] GET /identity/v3/users/d7718e3f40714979a409bc48aa549c8a => generated 284 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:11.170194 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79865f81-6030-4369-a97c-998f9a5dc8a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:11.170194 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79865f81-6030-4369-a97c-998f9a5dc8a8 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:11.170194 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79865f81-6030-4369-a97c-998f9a5dc8a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:11.170194 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79865f81-6030-4369-a97c-998f9a5dc8a8 None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:11.170533 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79865f81-6030-4369-a97c-998f9a5dc8a8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:11.170533 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79865f81-6030-4369-a97c-998f9a5dc8a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:11.170533 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79865f81-6030-4369-a97c-998f9a5dc8a8 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:11.172193 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f534b06-8066-4714-aead-5c3b5e4dd888 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:11.189362 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 123/229] 10.222.0.118 () {56 vars in 1116 bytes} [Thu Jul 14 15:23:10 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:23:11.195808 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79865f81-6030-4369-a97c-998f9a5dc8a8 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:11.303693 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f534b06-8066-4714-aead-5c3b5e4dd888 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:11.334953 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:11.350143 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ab7d8f-aea4-4187-a3ea-39e4198e3b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:11.353399 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ab7d8f-aea4-4187-a3ea-39e4198e3b7b None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:11.354417 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ab7d8f-aea4-4187-a3ea-39e4198e3b7b None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:11.355739 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ab7d8f-aea4-4187-a3ea-39e4198e3b7b None admin] PATH_INFO: `/v3/projects/9d45367dfdd34d7ab5e0b055eda4e88e` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:11.357438 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ab7d8f-aea4-4187-a3ea-39e4198e3b7b None admin] RBAC: Authorizing `identity:get_project(project_id=9d45367dfdd34d7ab5e0b055eda4e88e)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:11.363087 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ab7d8f-aea4-4187-a3ea-39e4198e3b7b None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:11.369468 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 107/230] 10.222.0.118 () {56 vars in 1191 bytes} [Thu Jul 14 15:23:11 2022] GET /identity/v3/projects/9d45367dfdd34d7ab5e0b055eda4e88e => generated 303 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:11.373744 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ab7d8f-aea4-4187-a3ea-39e4198e3b7b None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:11.432827 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:11.438169 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79865f81-6030-4369-a97c-998f9a5dc8a8 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:11.518936 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558cd756-2548-405e-a7bb-89378c7a0101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:11.520460 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558cd756-2548-405e-a7bb-89378c7a0101 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:11.520642 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558cd756-2548-405e-a7bb-89378c7a0101 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:11.520906 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558cd756-2548-405e-a7bb-89378c7a0101 None admin] PATH_INFO: `/v3/users/d7718e3f40714979a409bc48aa549c8a` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:11.526745 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558cd756-2548-405e-a7bb-89378c7a0101 None admin] RBAC: Authorizing `identity:get_user(user_id=d7718e3f40714979a409bc48aa549c8a)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:11.528219 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558cd756-2548-405e-a7bb-89378c7a0101 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:11.530222 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 124/231] 10.222.0.118 () {56 vars in 1182 bytes} [Thu Jul 14 15:23:11 2022] GET /identity/v3/users/d7718e3f40714979a409bc48aa549c8a => generated 284 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:11.533789 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ab7d8f-aea4-4187-a3ea-39e4198e3b7b None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:11.538923 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558cd756-2548-405e-a7bb-89378c7a0101 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:11.585408 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aa5f1b-1fda-4c85-a8cc-c51759330b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:11.586341 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aa5f1b-1fda-4c85-a8cc-c51759330b0e None admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:11.586627 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aa5f1b-1fda-4c85-a8cc-c51759330b0e None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:11.586905 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aa5f1b-1fda-4c85-a8cc-c51759330b0e None admin] PATH_INFO: `/v3/projects/9d45367dfdd34d7ab5e0b055eda4e88e/users/d7718e3f40714979a409bc48aa549c8a/roles/3b880cef7dcf4baf87b50f8610c0c56e` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:11.593776 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1aa5f1b-1fda-4c85-a8cc-c51759330b0e None admin] RBAC: Authorizing `identity:create_grant(project_id=9d45367dfdd34d7ab5e0b055eda4e88e, user_id=d7718e3f40714979a409bc48aa549c8a, role_id=3b880cef7dcf4baf87b50f8610c0c56e)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:11.595294 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1aa5f1b-1fda-4c85-a8cc-c51759330b0e None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:11.619836 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 108/232] 10.222.0.118 () {58 vars in 1444 bytes} [Thu Jul 14 15:23:11 2022] PUT /identity/v3/projects/9d45367dfdd34d7ab5e0b055eda4e88e/users/d7718e3f40714979a409bc48aa549c8a/roles/3b880cef7dcf4baf87b50f8610c0c56e => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:23:11.706278 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558cd756-2548-405e-a7bb-89378c7a0101 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:11.726346 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:11.768152 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e577c2-ea62-4d48-8da0-71f216ef833f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:11.769152 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e577c2-ea62-4d48-8da0-71f216ef833f None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:11.769433 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e577c2-ea62-4d48-8da0-71f216ef833f None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:11.769760 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e577c2-ea62-4d48-8da0-71f216ef833f None admin] PATH_INFO: `/v3/projects/9d45367dfdd34d7ab5e0b055eda4e88e` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:11.774780 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e577c2-ea62-4d48-8da0-71f216ef833f None admin] RBAC: Authorizing `identity:get_project(project_id=9d45367dfdd34d7ab5e0b055eda4e88e)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:11.776323 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e577c2-ea62-4d48-8da0-71f216ef833f None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:11.778365 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 125/233] 10.222.0.118 () {56 vars in 1191 bytes} [Thu Jul 14 15:23:11 2022] GET /identity/v3/projects/9d45367dfdd34d7ab5e0b055eda4e88e => generated 303 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:11.784038 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aa5f1b-1fda-4c85-a8cc-c51759330b0e None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:11.911880 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:11.936616 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aa5f1b-1fda-4c85-a8cc-c51759330b0e None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:11.977495 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17682410-9fce-4ef5-af97-d5ae7228b9ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:11.978361 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17682410-9fce-4ef5-af97-d5ae7228b9ee None admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:11.978635 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17682410-9fce-4ef5-af97-d5ae7228b9ee None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:11.978908 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17682410-9fce-4ef5-af97-d5ae7228b9ee None admin] PATH_INFO: `/v3/projects/9d45367dfdd34d7ab5e0b055eda4e88e/users/d7718e3f40714979a409bc48aa549c8a/roles/f4e85c621e6d4e749149099dd9303934` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:11.981171 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17682410-9fce-4ef5-af97-d5ae7228b9ee None admin] RBAC: Authorizing `identity:create_grant(project_id=9d45367dfdd34d7ab5e0b055eda4e88e, user_id=d7718e3f40714979a409bc48aa549c8a, role_id=f4e85c621e6d4e749149099dd9303934)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:11.982671 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17682410-9fce-4ef5-af97-d5ae7228b9ee None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:11.998254 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 109/234] 10.222.0.118 () {58 vars in 1444 bytes} [Thu Jul 14 15:23:11 2022] PUT /identity/v3/projects/9d45367dfdd34d7ab5e0b055eda4e88e/users/d7718e3f40714979a409bc48aa549c8a/roles/f4e85c621e6d4e749149099dd9303934 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:23:12.278609 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2171a8ea-791d-4b85-9a26-2ed36757d852 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:12.279225 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2171a8ea-791d-4b85-9a26-2ed36757d852 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:12.279705 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2171a8ea-791d-4b85-9a26-2ed36757d852 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:12.281712 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 126/235] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:23:12 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:23:12.287790 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7809e97c-9e8b-4ec3-88a1-08b51252aa61 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:12.288067 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7809e97c-9e8b-4ec3-88a1-08b51252aa61 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:12.288341 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7809e97c-9e8b-4ec3-88a1-08b51252aa61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:12.309322 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-7809e97c-9e8b-4ec3-88a1-08b51252aa61 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:12.310844 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-7809e97c-9e8b-4ec3-88a1-08b51252aa61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:12.385647 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 110/236] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:23:12 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:23:12.409954 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2171a8ea-791d-4b85-9a26-2ed36757d852 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:12.487922 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de7450e-4fce-4b03-8702-f443a0c1df6c None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:12.488238 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de7450e-4fce-4b03-8702-f443a0c1df6c None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:12.489095 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de7450e-4fce-4b03-8702-f443a0c1df6c None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:12.490533 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 111/237] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:23:12 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:23:12.507217 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b840dc7c-802e-4915-8908-16157a838e85 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:12.507569 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b840dc7c-802e-4915-8908-16157a838e85 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:12.507768 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b840dc7c-802e-4915-8908-16157a838e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:12.543201 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-b840dc7c-802e-4915-8908-16157a838e85 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:12.544454 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-b840dc7c-802e-4915-8908-16157a838e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:12.568555 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2171a8ea-791d-4b85-9a26-2ed36757d852 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:12.629186 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c31821f-3c53-467d-b84e-8b8e465cbf57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:12.629999 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c31821f-3c53-467d-b84e-8b8e465cbf57 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:12.630735 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c31821f-3c53-467d-b84e-8b8e465cbf57 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:12.631018 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c31821f-3c53-467d-b84e-8b8e465cbf57 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:12.651014 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c31821f-3c53-467d-b84e-8b8e465cbf57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:23:12.665930 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-0c31821f-3c53-467d-b84e-8b8e465cbf57 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 15:23:12.665930 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:12.665930 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:12.665930 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:12.665930 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:12.665930 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:12.665930 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:12.665930 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:12.665930 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:12.665930 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:12.665930 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:12.665930 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:12.665930 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:23:12.665930 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:23:12.665930 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:23:12.665930 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:23:12.668091 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:23:12.668091 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:23:12.668091 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:23:12.668091 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:23:12.668091 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:12.668091 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:12.668091 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:12.668091 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:12.668091 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:12.668091 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:12.668091 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:12.668091 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:12.668091 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:12.668091 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:12.668091 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:12.668091 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:12.670035 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:12.670035 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:12.670035 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:12.670035 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:12.670035 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:23:12.670035 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:23:12.670035 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:23:12.670035 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:23:12.670035 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:23:12.670035 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:23:12.670035 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 15:23:12.670035 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:23:12.671538 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 112/238] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:23:12 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 15:23:12.671687 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 127/239] 10.222.0.118 () {56 vars in 1104 bytes} [Thu Jul 14 15:23:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:12.679298 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b840dc7c-802e-4915-8908-16157a838e85 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:12.681669 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:12.698750 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c31821f-3c53-467d-b84e-8b8e465cbf57 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:12.792404 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:12.799276 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b840dc7c-802e-4915-8908-16157a838e85 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:12.836532 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fef4457-dc9b-4eab-a84c-a2558130bde3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:12.837879 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fef4457-dc9b-4eab-a84c-a2558130bde3 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:12.838329 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fef4457-dc9b-4eab-a84c-a2558130bde3 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:12.838750 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fef4457-dc9b-4eab-a84c-a2558130bde3 None admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:12.839655 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fef4457-dc9b-4eab-a84c-a2558130bde3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:12.840550 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fef4457-dc9b-4eab-a84c-a2558130bde3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:12.842170 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fef4457-dc9b-4eab-a84c-a2558130bde3 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:12.852477 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 113/240] 10.222.0.118 () {56 vars in 1106 bytes} [Thu Jul 14 15:23:12 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:23:12.864882 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fef4457-dc9b-4eab-a84c-a2558130bde3 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:12.909991 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c31821f-3c53-467d-b84e-8b8e465cbf57 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:12.946019 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0405221d-a6be-4bc9-b38a-2ffd7022941d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:12.946019 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0405221d-a6be-4bc9-b38a-2ffd7022941d None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:12.946019 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0405221d-a6be-4bc9-b38a-2ffd7022941d None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:12.946019 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0405221d-a6be-4bc9-b38a-2ffd7022941d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:12.949889 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0405221d-a6be-4bc9-b38a-2ffd7022941d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:12.951677 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0405221d-a6be-4bc9-b38a-2ffd7022941d None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:12.956400 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 128/241] 10.222.0.118 () {56 vars in 1113 bytes} [Thu Jul 14 15:23:12 2022] GET /identity/v3/domains/default => generated 200 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:12.962534 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0405221d-a6be-4bc9-b38a-2ffd7022941d None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:13.038347 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:13.067687 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0405221d-a6be-4bc9-b38a-2ffd7022941d None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:13.069814 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:13.104089 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4a965f-5ab5-4fc3-8811-362d77adf660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:13.105132 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a965f-5ab5-4fc3-8811-362d77adf660 None admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:13.105608 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a965f-5ab5-4fc3-8811-362d77adf660 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:13.106139 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a965f-5ab5-4fc3-8811-362d77adf660 None admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:13.107051 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4a965f-5ab5-4fc3-8811-362d77adf660 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:13.108695 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4a965f-5ab5-4fc3-8811-362d77adf660 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:13.137664 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 129/242] 10.222.0.118 () {60 vars in 1137 bytes} [Thu Jul 14 15:23:12 2022] POST /identity/v3/users => generated 294 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:23:13.141487 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fef4457-dc9b-4eab-a84c-a2558130bde3 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:13.181620 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5129f13a-7e2f-4838-85dd-9f7ee66ddda0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:13.182910 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5129f13a-7e2f-4838-85dd-9f7ee66ddda0 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:13.183413 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5129f13a-7e2f-4838-85dd-9f7ee66ddda0 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:13.183880 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5129f13a-7e2f-4838-85dd-9f7ee66ddda0 None admin] PATH_INFO: `/v3/users/b86ca1874b1848139592bd7dea67f846` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:13.200399 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5129f13a-7e2f-4838-85dd-9f7ee66ddda0 None admin] RBAC: Authorizing `identity:get_user(user_id=b86ca1874b1848139592bd7dea67f846)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:13.202401 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5129f13a-7e2f-4838-85dd-9f7ee66ddda0 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:13.204724 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 114/243] 10.222.0.118 () {56 vars in 1182 bytes} [Thu Jul 14 15:23:12 2022] GET /identity/v3/users/b86ca1874b1848139592bd7dea67f846 => generated 298 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:13.211075 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4a965f-5ab5-4fc3-8811-362d77adf660 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:13.324025 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4a965f-5ab5-4fc3-8811-362d77adf660 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:13.336908 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b186bf-d257-4332-8fb0-25ef723b5179 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:13.337529 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b186bf-d257-4332-8fb0-25ef723b5179 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:13.338043 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b186bf-d257-4332-8fb0-25ef723b5179 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:13.339696 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 115/244] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:23:13 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 14 15:23:13.355662 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312e3c17-1ebb-4edd-9232-43cee4791245 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:13.356275 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312e3c17-1ebb-4edd-9232-43cee4791245 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:13.356756 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312e3c17-1ebb-4edd-9232-43cee4791245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:13.386005 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-312e3c17-1ebb-4edd-9232-43cee4791245 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:13.389292 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-312e3c17-1ebb-4edd-9232-43cee4791245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:13.395391 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df79b8e5-7221-4ca1-a50f-d027aad8fcce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:13.398716 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df79b8e5-7221-4ca1-a50f-d027aad8fcce None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:13.399241 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df79b8e5-7221-4ca1-a50f-d027aad8fcce None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:13.404700 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df79b8e5-7221-4ca1-a50f-d027aad8fcce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:13.458446 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:13.486226 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 116/245] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:23:13 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 15:23:13.490342 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df79b8e5-7221-4ca1-a50f-d027aad8fcce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:13.492080 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df79b8e5-7221-4ca1-a50f-d027aad8fcce None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:13.511061 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312e3c17-1ebb-4edd-9232-43cee4791245 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:13.571464 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:13.619845 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 130/246] 10.222.0.118 () {58 vars in 1287 bytes} [Thu Jul 14 15:23:13 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 15:23:13.630065 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df79b8e5-7221-4ca1-a50f-d027aad8fcce None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:13.630245 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312e3c17-1ebb-4edd-9232-43cee4791245 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:13.678666 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ade3ad1-e410-4fb3-aebb-bdc05131a17b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:13.679481 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ade3ad1-e410-4fb3-aebb-bdc05131a17b None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:13.679759 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ade3ad1-e410-4fb3-aebb-bdc05131a17b None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:13.680034 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ade3ad1-e410-4fb3-aebb-bdc05131a17b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:13.698373 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ade3ad1-e410-4fb3-aebb-bdc05131a17b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:23:13.704739 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:13.714660 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-7ade3ad1-e410-4fb3-aebb-bdc05131a17b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 15:23:13.714660 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:13.714660 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:13.714660 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:13.714660 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:13.714660 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:13.714660 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:13.714660 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:13.714660 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:13.714660 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:13.714660 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:13.714660 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:13.714660 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:23:13.714660 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:23:13.714660 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:23:13.714660 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:23:13.715671 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:23:13.715671 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:23:13.715671 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:23:13.715671 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:23:13.715671 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:13.715671 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:13.715671 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:13.715671 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:13.715671 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:13.715671 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:13.715671 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:13.715671 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:13.715671 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:13.715671 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:13.715671 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:13.715671 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:13.716430 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:13.716430 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:13.716430 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:13.716430 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:13.716430 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:23:13.716430 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:23:13.716430 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:23:13.716430 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:23:13.716430 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:23:13.716430 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:23:13.716430 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 15:23:13.716430 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:23:13.716430 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 117/247] 10.222.0.118 () {56 vars in 1104 bytes} [Thu Jul 14 15:23:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:13.724749 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ade3ad1-e410-4fb3-aebb-bdc05131a17b None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:13.756984 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df79b8e5-7221-4ca1-a50f-d027aad8fcce None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:13.793012 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92995ff-fe63-475a-ac21-a28fbca8bed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:13.793865 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92995ff-fe63-475a-ac21-a28fbca8bed7 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:13.794179 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92995ff-fe63-475a-ac21-a28fbca8bed7 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:13.794451 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92995ff-fe63-475a-ac21-a28fbca8bed7 None admin] PATH_INFO: `/v3/projects/9d45367dfdd34d7ab5e0b055eda4e88e` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:13.795641 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92995ff-fe63-475a-ac21-a28fbca8bed7 None admin] RBAC: Authorizing `identity:get_project(project_id=9d45367dfdd34d7ab5e0b055eda4e88e)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:13.797102 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92995ff-fe63-475a-ac21-a28fbca8bed7 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:13.799016 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 131/248] 10.222.0.118 () {56 vars in 1191 bytes} [Thu Jul 14 15:23:13 2022] GET /identity/v3/projects/9d45367dfdd34d7ab5e0b055eda4e88e => generated 303 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:13.804633 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92995ff-fe63-475a-ac21-a28fbca8bed7 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:13.843400 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ade3ad1-e410-4fb3-aebb-bdc05131a17b None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:13.863518 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:13.889517 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca3e961-e7b8-4840-8365-37bec05df2eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:13.890350 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca3e961-e7b8-4840-8365-37bec05df2eb None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:13.890638 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca3e961-e7b8-4840-8365-37bec05df2eb None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:13.890927 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca3e961-e7b8-4840-8365-37bec05df2eb None admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:13.891823 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca3e961-e7b8-4840-8365-37bec05df2eb None admin] RBAC: Adding query filter params (name=member) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:13.892161 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca3e961-e7b8-4840-8365-37bec05df2eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:13.893884 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca3e961-e7b8-4840-8365-37bec05df2eb None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:13.906215 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 118/249] 10.222.0.118 () {56 vars in 1106 bytes} [Thu Jul 14 15:23:13 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:13.912692 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca3e961-e7b8-4840-8365-37bec05df2eb None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:13.916982 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92995ff-fe63-475a-ac21-a28fbca8bed7 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:13.945545 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:13.955876 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b299c87-75a5-45b7-9e01-f3f0584ee70d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:13.956553 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b299c87-75a5-45b7-9e01-f3f0584ee70d None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:13.956833 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b299c87-75a5-45b7-9e01-f3f0584ee70d None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:13.957162 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b299c87-75a5-45b7-9e01-f3f0584ee70d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:13.958538 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b299c87-75a5-45b7-9e01-f3f0584ee70d None admin] RBAC: Adding query filter params (role.id=63af4c63b0c343909af17164f6e26a71, scope.project.id=9d45367dfdd34d7ab5e0b055eda4e88e, user.id=b86ca1874b1848139592bd7dea67f846) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:13.958856 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b299c87-75a5-45b7-9e01-f3f0584ee70d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:13.960369 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b299c87-75a5-45b7-9e01-f3f0584ee70d None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:13.966584 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 132/250] 10.222.0.118 () {56 vars in 1379 bytes} [Thu Jul 14 15:23:13 2022] GET /identity/v3/role_assignments?user.id=b86ca1874b1848139592bd7dea67f846&scope.project.id=9d45367dfdd34d7ab5e0b055eda4e88e&role.id=63af4c63b0c343909af17164f6e26a71 => generated 260 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:14.056172 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca3e961-e7b8-4840-8365-37bec05df2eb None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:14.099419 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4926f00-3061-4c31-a414-c28cec3dab14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:14.100638 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4926f00-3061-4c31-a414-c28cec3dab14 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:14.101112 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4926f00-3061-4c31-a414-c28cec3dab14 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:14.101572 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4926f00-3061-4c31-a414-c28cec3dab14 None admin] PATH_INFO: `/v3/users/4e63e348b2e347e3b2b8b76ad83ba9e9` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:14.103014 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4926f00-3061-4c31-a414-c28cec3dab14 None admin] RBAC: Authorizing `identity:get_user(user_id=4e63e348b2e347e3b2b8b76ad83ba9e9)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:14.104680 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4926f00-3061-4c31-a414-c28cec3dab14 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:14.106923 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 119/251] 10.222.0.118 () {56 vars in 1182 bytes} [Thu Jul 14 15:23:13 2022] GET /identity/v3/users/4e63e348b2e347e3b2b8b76ad83ba9e9 => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:23:14.108441 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28c33a9-59e3-40e5-876f-508d9c15148f None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:14.108441 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28c33a9-59e3-40e5-876f-508d9c15148f None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:14.108613 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28c33a9-59e3-40e5-876f-508d9c15148f None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:14.111524 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 133/252] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:23:14 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:23:14.115319 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4926f00-3061-4c31-a414-c28cec3dab14 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:14.115862 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31789346-a481-41c2-a864-0c4c27276fbc None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:14.116191 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31789346-a481-41c2-a864-0c4c27276fbc None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:14.116419 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31789346-a481-41c2-a864-0c4c27276fbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:14.147141 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-31789346-a481-41c2-a864-0c4c27276fbc None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:14.148372 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-31789346-a481-41c2-a864-0c4c27276fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:14.219262 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:14.231526 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4926f00-3061-4c31-a414-c28cec3dab14 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:14.244923 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 134/253] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:23:14 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 14 15:23:14.269747 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31789346-a481-41c2-a864-0c4c27276fbc None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:14.270550 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98292a68-4891-4e87-8d00-4793372399d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:14.271713 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98292a68-4891-4e87-8d00-4793372399d4 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:14.272283 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98292a68-4891-4e87-8d00-4793372399d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:14.272766 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98292a68-4891-4e87-8d00-4793372399d4 None admin] PATH_INFO: `/v3/projects/9d45367dfdd34d7ab5e0b055eda4e88e` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:14.275513 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98292a68-4891-4e87-8d00-4793372399d4 None admin] RBAC: Authorizing `identity:get_project(project_id=9d45367dfdd34d7ab5e0b055eda4e88e)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:14.277214 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98292a68-4891-4e87-8d00-4793372399d4 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:14.279674 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 120/254] 10.222.0.118 () {56 vars in 1191 bytes} [Thu Jul 14 15:23:14 2022] GET /identity/v3/projects/9d45367dfdd34d7ab5e0b055eda4e88e => generated 303 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:14.287039 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98292a68-4891-4e87-8d00-4793372399d4 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:14.373532 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31789346-a481-41c2-a864-0c4c27276fbc None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:14.396530 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:14.421806 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a93ed7f-272b-4502-931d-9cc9c259a39d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:14.422742 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a93ed7f-272b-4502-931d-9cc9c259a39d None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:14.423038 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a93ed7f-272b-4502-931d-9cc9c259a39d None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:14.423319 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a93ed7f-272b-4502-931d-9cc9c259a39d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:14.444212 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a93ed7f-272b-4502-931d-9cc9c259a39d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:23:14.454336 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98292a68-4891-4e87-8d00-4793372399d4 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:14.459762 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-1a93ed7f-272b-4502-931d-9cc9c259a39d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:23:14.459762 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:14.459762 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:14.459762 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:14.459762 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:14.459762 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:14.459762 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:14.459762 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:14.459762 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:14.459762 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:14.459762 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:14.459762 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:14.459762 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:23:14.459762 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:23:14.459762 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:23:14.459762 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:23:14.460921 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:23:14.460921 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:23:14.460921 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:23:14.460921 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:23:14.460921 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:14.460921 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:14.460921 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:14.460921 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:14.460921 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:14.460921 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:14.460921 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:14.460921 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:14.460921 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:14.460921 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:14.460921 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:14.460921 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:14.461706 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:14.461706 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:14.461706 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:14.461706 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:14.461706 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:23:14.461706 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:23:14.461706 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:23:14.461706 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:23:14.461706 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:23:14.461706 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:23:14.461706 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:23:14.461706 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:23:14.461706 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 135/255] 10.222.0.118 () {56 vars in 1101 bytes} [Thu Jul 14 15:23:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:23:14.468740 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a93ed7f-272b-4502-931d-9cc9c259a39d None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:14.474143 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:14.531316 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1f6407-3fa8-46fb-8ad5-9e6d9f5518d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:14.532226 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1f6407-3fa8-46fb-8ad5-9e6d9f5518d0 None admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:14.532504 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1f6407-3fa8-46fb-8ad5-9e6d9f5518d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:14.532778 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1f6407-3fa8-46fb-8ad5-9e6d9f5518d0 None admin] PATH_INFO: `/v3/projects/9d45367dfdd34d7ab5e0b055eda4e88e/users/4e63e348b2e347e3b2b8b76ad83ba9e9/roles/4abcf5e5e7cd4b53ae1828fec6550d53` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:14.542865 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1f6407-3fa8-46fb-8ad5-9e6d9f5518d0 None admin] RBAC: Authorizing `identity:create_grant(project_id=9d45367dfdd34d7ab5e0b055eda4e88e, user_id=4e63e348b2e347e3b2b8b76ad83ba9e9, role_id=4abcf5e5e7cd4b53ae1828fec6550d53)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:14.544363 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1f6407-3fa8-46fb-8ad5-9e6d9f5518d0 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:14.572594 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 121/256] 10.222.0.118 () {58 vars in 1444 bytes} [Thu Jul 14 15:23:14 2022] PUT /identity/v3/projects/9d45367dfdd34d7ab5e0b055eda4e88e/users/4e63e348b2e347e3b2b8b76ad83ba9e9/roles/4abcf5e5e7cd4b53ae1828fec6550d53 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:23:14.666349 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a93ed7f-272b-4502-931d-9cc9c259a39d None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:14.706089 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c02369-deb6-4110-b2c4-790889991e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:14.712641 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c02369-deb6-4110-b2c4-790889991e64 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:14.713362 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c02369-deb6-4110-b2c4-790889991e64 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:14.713871 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c02369-deb6-4110-b2c4-790889991e64 None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:14.714893 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c02369-deb6-4110-b2c4-790889991e64 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:14.715404 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c02369-deb6-4110-b2c4-790889991e64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:14.717056 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c02369-deb6-4110-b2c4-790889991e64 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:14.735372 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 136/257] 10.222.0.118 () {56 vars in 1104 bytes} [Thu Jul 14 15:23:14 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:23:14.741780 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1f6407-3fa8-46fb-8ad5-9e6d9f5518d0 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:14.889056 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1f6407-3fa8-46fb-8ad5-9e6d9f5518d0 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:14.926866 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4926d1cf-afaa-47bf-ab5b-acbebcb297e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:14.927742 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4926d1cf-afaa-47bf-ab5b-acbebcb297e6 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:14.928013 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4926d1cf-afaa-47bf-ab5b-acbebcb297e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:14.928282 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4926d1cf-afaa-47bf-ab5b-acbebcb297e6 None admin] PATH_INFO: `/v3/users/d7718e3f40714979a409bc48aa549c8a` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:14.929501 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4926d1cf-afaa-47bf-ab5b-acbebcb297e6 None admin] RBAC: Authorizing `identity:get_user(user_id=d7718e3f40714979a409bc48aa549c8a)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:14.930996 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4926d1cf-afaa-47bf-ab5b-acbebcb297e6 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:14.932650 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 122/258] 10.222.0.118 () {56 vars in 1182 bytes} [Thu Jul 14 15:23:14 2022] GET /identity/v3/users/d7718e3f40714979a409bc48aa549c8a => generated 284 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:14.938899 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4926d1cf-afaa-47bf-ab5b-acbebcb297e6 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:14.940142 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c16fc-12dd-469a-a80b-0b761a485e81 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:14.940650 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c16fc-12dd-469a-a80b-0b761a485e81 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:14.941134 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c16fc-12dd-469a-a80b-0b761a485e81 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:14.943085 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 137/259] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:23:14 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:23:14.948647 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5367e28-7ee0-447b-83c1-ed1bd86d4a71 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:14.948930 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5367e28-7ee0-447b-83c1-ed1bd86d4a71 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:14.949208 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5367e28-7ee0-447b-83c1-ed1bd86d4a71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:14.978253 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-d5367e28-7ee0-447b-83c1-ed1bd86d4a71 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:14.979418 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-d5367e28-7ee0-447b-83c1-ed1bd86d4a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:14.990323 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:15.046344 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:15.052825 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4926d1cf-afaa-47bf-ab5b-acbebcb297e6 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:15.088005 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 138/260] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:23:14 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:23:15.088983 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1453fe-d4d4-4486-a6c4-5450bf6405a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:15.089704 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1453fe-d4d4-4486-a6c4-5450bf6405a2 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:15.089989 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1453fe-d4d4-4486-a6c4-5450bf6405a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:15.090280 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1453fe-d4d4-4486-a6c4-5450bf6405a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:15.140667 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5367e28-7ee0-447b-83c1-ed1bd86d4a71 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:15.161377 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1453fe-d4d4-4486-a6c4-5450bf6405a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:15.162901 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1453fe-d4d4-4486-a6c4-5450bf6405a2 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:15.210884 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:15.266286 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 123/261] 10.222.0.118 () {58 vars in 1287 bytes} [Thu Jul 14 15:23:14 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 15:23:15.276115 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1453fe-d4d4-4486-a6c4-5450bf6405a2 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:15.333357 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5367e28-7ee0-447b-83c1-ed1bd86d4a71 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:15.415295 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79e012e-6f36-499b-84c3-237bfc2de9d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:15.416111 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79e012e-6f36-499b-84c3-237bfc2de9d4 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:15.416385 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79e012e-6f36-499b-84c3-237bfc2de9d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:15.416654 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79e012e-6f36-499b-84c3-237bfc2de9d4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:15.439445 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79e012e-6f36-499b-84c3-237bfc2de9d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:23:15.449092 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-e79e012e-6f36-499b-84c3-237bfc2de9d4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 15:23:15.449092 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:15.449092 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:15.449092 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:15.449092 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:15.449092 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:15.449092 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:15.449092 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:15.449092 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:15.449092 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:15.449092 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:15.449092 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:15.449092 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:23:15.449092 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:23:15.449092 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:23:15.449092 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:23:15.450126 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:23:15.450126 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:23:15.450126 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:23:15.450126 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:23:15.450126 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:15.450126 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:15.450126 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:15.450126 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:15.450126 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:15.450126 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:15.450126 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:15.450126 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:15.450126 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:15.450126 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:15.450126 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:15.450126 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:15.450913 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:15.450913 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:15.450913 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:15.450913 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:15.450913 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:23:15.450913 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:23:15.450913 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:23:15.450913 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:23:15.450913 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:23:15.450913 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:23:15.450913 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 15:23:15.450913 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:23:15.450913 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 139/262] 10.222.0.118 () {56 vars in 1119 bytes} [Thu Jul 14 15:23:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:15.459306 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79e012e-6f36-499b-84c3-237bfc2de9d4 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:15.480500 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1453fe-d4d4-4486-a6c4-5450bf6405a2 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:15.530421 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:15.555575 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2167a845-64bd-485f-be8c-2886a3ff116c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:15.556647 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2167a845-64bd-485f-be8c-2886a3ff116c None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:15.556928 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2167a845-64bd-485f-be8c-2886a3ff116c None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:15.557206 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2167a845-64bd-485f-be8c-2886a3ff116c None admin] PATH_INFO: `/v3/projects/9d45367dfdd34d7ab5e0b055eda4e88e` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:15.559114 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2167a845-64bd-485f-be8c-2886a3ff116c None admin] RBAC: Authorizing `identity:get_project(project_id=9d45367dfdd34d7ab5e0b055eda4e88e)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:15.560602 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2167a845-64bd-485f-be8c-2886a3ff116c None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:15.566866 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 124/263] 10.222.0.118 () {56 vars in 1191 bytes} [Thu Jul 14 15:23:15 2022] GET /identity/v3/projects/9d45367dfdd34d7ab5e0b055eda4e88e => generated 303 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:15.572810 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2167a845-64bd-485f-be8c-2886a3ff116c None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:15.585274 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:15.672495 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79e012e-6f36-499b-84c3-237bfc2de9d4 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:15.751831 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae52202-c228-4f02-9114-acf2f4dd2340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:15.752505 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae52202-c228-4f02-9114-acf2f4dd2340 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:15.752779 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae52202-c228-4f02-9114-acf2f4dd2340 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:15.753050 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae52202-c228-4f02-9114-acf2f4dd2340 None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:15.753805 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae52202-c228-4f02-9114-acf2f4dd2340 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:15.754174 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae52202-c228-4f02-9114-acf2f4dd2340 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:15.756149 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae52202-c228-4f02-9114-acf2f4dd2340 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:15.771461 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 140/264] 10.222.0.118 () {56 vars in 1116 bytes} [Thu Jul 14 15:23:15 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:15.777044 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae52202-c228-4f02-9114-acf2f4dd2340 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:15.788699 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2167a845-64bd-485f-be8c-2886a3ff116c None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:15.894279 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb524d4-ee27-4214-b730-9478ac707e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:15.895501 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb524d4-ee27-4214-b730-9478ac707e19 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:15.895781 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb524d4-ee27-4214-b730-9478ac707e19 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:15.896056 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb524d4-ee27-4214-b730-9478ac707e19 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:15.896907 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb524d4-ee27-4214-b730-9478ac707e19 None admin] RBAC: Adding query filter params (role.id=3b880cef7dcf4baf87b50f8610c0c56e, scope.project.id=9d45367dfdd34d7ab5e0b055eda4e88e, user.id=d7718e3f40714979a409bc48aa549c8a) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:15.897220 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb524d4-ee27-4214-b730-9478ac707e19 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:15.898711 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb524d4-ee27-4214-b730-9478ac707e19 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:15.920001 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 125/265] 10.222.0.118 () {56 vars in 1379 bytes} [Thu Jul 14 15:23:15 2022] GET /identity/v3/role_assignments?user.id=d7718e3f40714979a409bc48aa549c8a&scope.project.id=9d45367dfdd34d7ab5e0b055eda4e88e&role.id=3b880cef7dcf4baf87b50f8610c0c56e => generated 610 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:15.946472 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:15.947637 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae52202-c228-4f02-9114-acf2f4dd2340 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:15.999030 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89454210-c510-4bbe-9768-ffd3ee6c5078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:15.999914 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89454210-c510-4bbe-9768-ffd3ee6c5078 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:16.000190 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89454210-c510-4bbe-9768-ffd3ee6c5078 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:16.000462 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89454210-c510-4bbe-9768-ffd3ee6c5078 None admin] PATH_INFO: `/v3/users/d7718e3f40714979a409bc48aa549c8a` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:16.006768 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89454210-c510-4bbe-9768-ffd3ee6c5078 None admin] RBAC: Authorizing `identity:get_user(user_id=d7718e3f40714979a409bc48aa549c8a)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:16.008326 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89454210-c510-4bbe-9768-ffd3ee6c5078 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:16.010463 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 141/266] 10.222.0.118 () {56 vars in 1182 bytes} [Thu Jul 14 15:23:15 2022] GET /identity/v3/users/d7718e3f40714979a409bc48aa549c8a => generated 284 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:16.016172 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb524d4-ee27-4214-b730-9478ac707e19 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:16.134351 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:16.175052 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb524d4-ee27-4214-b730-9478ac707e19 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:16.221421 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e6c080-4b14-4f92-ac83-781c6a5549a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:16.222100 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e6c080-4b14-4f92-ac83-781c6a5549a8 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:16.222379 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e6c080-4b14-4f92-ac83-781c6a5549a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:16.222683 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e6c080-4b14-4f92-ac83-781c6a5549a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:16.307580 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e6c080-4b14-4f92-ac83-781c6a5549a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:16.309052 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e6c080-4b14-4f92-ac83-781c6a5549a8 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:16.384753 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:16.428661 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 126/267] 10.222.0.118 () {58 vars in 1287 bytes} [Thu Jul 14 15:23:16 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 15:23:16.429654 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89454210-c510-4bbe-9768-ffd3ee6c5078 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:16.582389 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89454210-c510-4bbe-9768-ffd3ee6c5078 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:16.632775 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eece2b6-dfdf-436e-bf32-84958b4013c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:16.633682 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eece2b6-dfdf-436e-bf32-84958b4013c6 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:16.634008 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eece2b6-dfdf-436e-bf32-84958b4013c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:16.634264 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eece2b6-dfdf-436e-bf32-84958b4013c6 None admin] PATH_INFO: `/v3/projects/9d45367dfdd34d7ab5e0b055eda4e88e` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:16.635530 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eece2b6-dfdf-436e-bf32-84958b4013c6 None admin] RBAC: Authorizing `identity:get_project(project_id=9d45367dfdd34d7ab5e0b055eda4e88e)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:16.636926 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eece2b6-dfdf-436e-bf32-84958b4013c6 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:16.638673 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 142/268] 10.222.0.118 () {56 vars in 1191 bytes} [Thu Jul 14 15:23:16 2022] GET /identity/v3/projects/9d45367dfdd34d7ab5e0b055eda4e88e => generated 303 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:23:16.646857 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e6c080-4b14-4f92-ac83-781c6a5549a8 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:16.676386 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06816805-a85e-498d-a6a8-1e039eb0ccb8 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:16.676665 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06816805-a85e-498d-a6a8-1e039eb0ccb8 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:16.677204 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06816805-a85e-498d-a6a8-1e039eb0ccb8 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:16.679028 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 143/269] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:23:16 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 14 15:23:16.690397 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3d72f8-2fc7-42ff-9858-65a232b6cb57 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:16.691092 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3d72f8-2fc7-42ff-9858-65a232b6cb57 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:16.692130 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3d72f8-2fc7-42ff-9858-65a232b6cb57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:16.728959 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-0e3d72f8-2fc7-42ff-9858-65a232b6cb57 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:16.728959 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-0e3d72f8-2fc7-42ff-9858-65a232b6cb57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:16.774359 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:16.836375 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e6c080-4b14-4f92-ac83-781c6a5549a8 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:16.856417 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 144/270] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:23:16 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:23:16.883908 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a45e2c-22d7-424f-879a-2d10c21786a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:16.884578 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a45e2c-22d7-424f-879a-2d10c21786a1 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:16.884854 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a45e2c-22d7-424f-879a-2d10c21786a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:16.885188 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a45e2c-22d7-424f-879a-2d10c21786a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:16.886119 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a45e2c-22d7-424f-879a-2d10c21786a1 None admin] RBAC: Adding query filter params (role.id=f4e85c621e6d4e749149099dd9303934, scope.project.id=9d45367dfdd34d7ab5e0b055eda4e88e, user.id=d7718e3f40714979a409bc48aa549c8a) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:16.886379 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a45e2c-22d7-424f-879a-2d10c21786a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:16.887828 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a45e2c-22d7-424f-879a-2d10c21786a1 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:16.894660 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 127/271] 10.222.0.118 () {56 vars in 1379 bytes} [Thu Jul 14 15:23:16 2022] GET /identity/v3/role_assignments?user.id=d7718e3f40714979a409bc48aa549c8a&scope.project.id=9d45367dfdd34d7ab5e0b055eda4e88e&role.id=f4e85c621e6d4e749149099dd9303934 => generated 610 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:16.896438 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3d72f8-2fc7-42ff-9858-65a232b6cb57 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:17.037342 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3d72f8-2fc7-42ff-9858-65a232b6cb57 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:17.052403 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f219e8-7e00-4955-9c69-8a4eb63fd7c4 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:17.052753 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f219e8-7e00-4955-9c69-8a4eb63fd7c4 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:17.052949 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f219e8-7e00-4955-9c69-8a4eb63fd7c4 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:17.054477 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 128/272] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:23:17 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 14 15:23:17.068711 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a908431-81bc-4799-a6c3-97d91640c08e None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:17.069042 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a908431-81bc-4799-a6c3-97d91640c08e None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:17.069267 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a908431-81bc-4799-a6c3-97d91640c08e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:17.089216 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-2a908431-81bc-4799-a6c3-97d91640c08e None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:17.090821 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-2a908431-81bc-4799-a6c3-97d91640c08e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:17.101768 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59345501-b91e-4a49-b524-9e560604c0ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:17.103004 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59345501-b91e-4a49-b524-9e560604c0ad None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:17.103004 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59345501-b91e-4a49-b524-9e560604c0ad None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:17.103224 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59345501-b91e-4a49-b524-9e560604c0ad None admin] PATH_INFO: `/v3/roles/member` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:17.123832 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59345501-b91e-4a49-b524-9e560604c0ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:23:17.124313 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:17.139524 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-59345501-b91e-4a49-b524-9e560604c0ad None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 15:23:17.139524 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:17.139524 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:17.139524 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:17.139524 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:17.139524 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:17.139524 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:17.139524 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:17.139524 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:17.139524 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:17.139524 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:17.139524 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:17.139524 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:23:17.139524 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:23:17.139524 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:23:17.139524 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:23:17.140611 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:23:17.140611 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:23:17.140611 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:23:17.140611 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:23:17.140611 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:17.140611 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:17.140611 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:17.140611 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:17.140611 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:17.140611 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:17.140611 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:17.140611 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:17.140611 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:17.140611 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:17.140611 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:17.140611 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:17.141543 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:17.141543 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:17.141543 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:17.141543 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:17.141543 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:23:17.141543 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:23:17.141543 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:23:17.141543 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:23:17.141543 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:23:17.141543 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:23:17.141543 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 15:23:17.141543 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:23:17.143773 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 145/273] 10.222.0.118 () {56 vars in 1104 bytes} [Thu Jul 14 15:23:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:23:17.149816 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59345501-b91e-4a49-b524-9e560604c0ad None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:17.173393 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 129/274] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:23:17 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 15:23:17.196712 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:17.198852 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a908431-81bc-4799-a6c3-97d91640c08e None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:17.311497 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59345501-b91e-4a49-b524-9e560604c0ad None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:17.343431 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a908431-81bc-4799-a6c3-97d91640c08e None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:17.348669 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4b1395-3d93-4a1f-83df-b77ac0861e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:17.349347 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4b1395-3d93-4a1f-83df-b77ac0861e4b None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:17.349625 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4b1395-3d93-4a1f-83df-b77ac0861e4b None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:17.349899 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4b1395-3d93-4a1f-83df-b77ac0861e4b None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:17.350700 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4b1395-3d93-4a1f-83df-b77ac0861e4b None admin] RBAC: Adding query filter params (name=member) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:17.351006 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4b1395-3d93-4a1f-83df-b77ac0861e4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:17.352394 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4b1395-3d93-4a1f-83df-b77ac0861e4b None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:17.361275 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 146/275] 10.222.0.118 () {56 vars in 1106 bytes} [Thu Jul 14 15:23:17 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:17.366597 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3452e785-ed2f-45c1-8303-47693d5101a4 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:17.366886 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3452e785-ed2f-45c1-8303-47693d5101a4 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:17.367169 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3452e785-ed2f-45c1-8303-47693d5101a4 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:17.368627 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 147/276] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:23:17 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:23:17.370623 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3452e785-ed2f-45c1-8303-47693d5101a4 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:17.387764 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72c219d-201c-408d-962d-04d7acd2d550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:17.388575 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72c219d-201c-408d-962d-04d7acd2d550 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:17.388861 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72c219d-201c-408d-962d-04d7acd2d550 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:17.389137 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72c219d-201c-408d-962d-04d7acd2d550 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:17.390437 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72c219d-201c-408d-962d-04d7acd2d550 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:17.391846 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72c219d-201c-408d-962d-04d7acd2d550 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:17.393494 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 130/277] 10.222.0.118 () {56 vars in 1113 bytes} [Thu Jul 14 15:23:17 2022] GET /identity/v3/domains/default => generated 200 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:23:17.394733 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d70c7ab-8691-41ba-8afb-852188af5ef0 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:17.395017 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d70c7ab-8691-41ba-8afb-852188af5ef0 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:17.395295 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d70c7ab-8691-41ba-8afb-852188af5ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:17.413360 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-5d70c7ab-8691-41ba-8afb-852188af5ef0 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:17.414600 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-5d70c7ab-8691-41ba-8afb-852188af5ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:17.442881 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:17.464429 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:17.484961 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3452e785-ed2f-45c1-8303-47693d5101a4 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:17.486188 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 131/278] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:23:17 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:23:17.487182 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d70c7ab-8691-41ba-8afb-852188af5ef0 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:17.521938 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b65af9-b4d4-4b34-918e-4f5734abfe58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:17.522833 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b65af9-b4d4-4b34-918e-4f5734abfe58 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:17.523113 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b65af9-b4d4-4b34-918e-4f5734abfe58 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:17.523388 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b65af9-b4d4-4b34-918e-4f5734abfe58 None admin] PATH_INFO: `/v3/users/8c2b37bceec248408f2ec2dd3e9206fd` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:17.538624 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b65af9-b4d4-4b34-918e-4f5734abfe58 None admin] RBAC: Authorizing `identity:get_user(user_id=8c2b37bceec248408f2ec2dd3e9206fd)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:17.540096 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b65af9-b4d4-4b34-918e-4f5734abfe58 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:17.541786 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 148/279] 10.222.0.118 () {56 vars in 1182 bytes} [Thu Jul 14 15:23:17 2022] GET /identity/v3/users/8c2b37bceec248408f2ec2dd3e9206fd => generated 294 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:17.543047 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bbe5fb-a5d4-4387-8755-3e27051013b1 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:17.543336 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bbe5fb-a5d4-4387-8755-3e27051013b1 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:17.543616 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bbe5fb-a5d4-4387-8755-3e27051013b1 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:17.544851 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 149/280] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:23:17 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:23:17.545547 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bbe5fb-a5d4-4387-8755-3e27051013b1 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:17.594314 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d70c7ab-8691-41ba-8afb-852188af5ef0 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:17.629760 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b94bd60-e1a8-48be-9793-bf5f3b365521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:17.630469 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b94bd60-e1a8-48be-9793-bf5f3b365521 None admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:17.631003 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b94bd60-e1a8-48be-9793-bf5f3b365521 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:17.631279 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b94bd60-e1a8-48be-9793-bf5f3b365521 None admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:17.631986 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b94bd60-e1a8-48be-9793-bf5f3b365521 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:17.633515 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b94bd60-e1a8-48be-9793-bf5f3b365521 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:17.649650 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bbe5fb-a5d4-4387-8755-3e27051013b1 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:17.653291 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 132/281] 10.222.0.118 () {60 vars in 1137 bytes} [Thu Jul 14 15:23:17 2022] POST /identity/v3/users => generated 294 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:23:17.654150 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b94bd60-e1a8-48be-9793-bf5f3b365521 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:17.675570 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:17.693110 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea714cd8-18fa-4edd-ae37-a69c76879cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:17.694034 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea714cd8-18fa-4edd-ae37-a69c76879cd5 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:17.694396 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea714cd8-18fa-4edd-ae37-a69c76879cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:17.694735 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea714cd8-18fa-4edd-ae37-a69c76879cd5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:17.703470 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:17.709343 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea714cd8-18fa-4edd-ae37-a69c76879cd5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:23:17.716538 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-ea714cd8-18fa-4edd-ae37-a69c76879cd5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 15:23:17.716538 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:17.716538 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:17.716538 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:17.716538 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:17.716538 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:17.716538 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:17.716538 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:17.716538 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:17.716538 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:17.716538 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:17.716538 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:17.716538 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:23:17.716538 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:23:17.716538 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:23:17.716538 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:23:17.717732 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:23:17.717732 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:23:17.717732 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:23:17.717732 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:23:17.717732 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:17.717732 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:17.717732 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:17.717732 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:17.717732 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:17.717732 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:17.717732 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:17.717732 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:17.717732 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:17.717732 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:17.717732 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:17.717732 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:17.718741 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:17.718741 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:17.718741 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:17.718741 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:17.718741 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:23:17.718741 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:23:17.718741 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:23:17.718741 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:23:17.718741 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:23:17.718741 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:23:17.718741 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 15:23:17.718741 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:23:17.718741 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 150/282] 10.222.0.118 () {56 vars in 1104 bytes} [Thu Jul 14 15:23:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:17.719539 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e724a40a-0c23-4963-886f-2605c9764474 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:17.719539 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e724a40a-0c23-4963-886f-2605c9764474 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:17.719678 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e724a40a-0c23-4963-886f-2605c9764474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:17.743523 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-e724a40a-0c23-4963-886f-2605c9764474 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:17.744744 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-e724a40a-0c23-4963-886f-2605c9764474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:17.789904 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b94bd60-e1a8-48be-9793-bf5f3b365521 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:17.819189 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 151/283] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:23:17 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:23:17.820042 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e724a40a-0c23-4963-886f-2605c9764474 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:17.836621 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b067ad36-095e-4209-a1cf-1824ca1cfde4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:17.837888 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b067ad36-095e-4209-a1cf-1824ca1cfde4 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:17.838370 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b067ad36-095e-4209-a1cf-1824ca1cfde4 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:17.838918 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b067ad36-095e-4209-a1cf-1824ca1cfde4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:17.840211 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b067ad36-095e-4209-a1cf-1824ca1cfde4 None admin] RBAC: Adding query filter params (role.id=4abcf5e5e7cd4b53ae1828fec6550d53, user.id=8c2b37bceec248408f2ec2dd3e9206fd, scope.system=all) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:17.840677 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b067ad36-095e-4209-a1cf-1824ca1cfde4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:17.842714 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b067ad36-095e-4209-a1cf-1824ca1cfde4 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:17.853990 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 133/284] 10.222.0.118 () {56 vars in 1313 bytes} [Thu Jul 14 15:23:17 2022] GET /identity/v3/role_assignments?user.id=8c2b37bceec248408f2ec2dd3e9206fd&scope.system=all&role.id=4abcf5e5e7cd4b53ae1828fec6550d53 => generated 227 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:17.853990 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b067ad36-095e-4209-a1cf-1824ca1cfde4 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:17.963949 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e724a40a-0c23-4963-886f-2605c9764474 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:17.970086 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:17.995086 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b067ad36-095e-4209-a1cf-1824ca1cfde4 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:18.001651 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:18.013668 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa282da2-bb3d-48a7-85cb-a77799821697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:18.014598 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa282da2-bb3d-48a7-85cb-a77799821697 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:18.014882 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa282da2-bb3d-48a7-85cb-a77799821697 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:18.015155 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa282da2-bb3d-48a7-85cb-a77799821697 None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:18.015929 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa282da2-bb3d-48a7-85cb-a77799821697 None admin] RBAC: Adding query filter params (name=member) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:18.016239 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa282da2-bb3d-48a7-85cb-a77799821697 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:18.020003 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa282da2-bb3d-48a7-85cb-a77799821697 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:18.032966 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 152/285] 10.222.0.118 () {56 vars in 1106 bytes} [Thu Jul 14 15:23:17 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:18.039695 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa282da2-bb3d-48a7-85cb-a77799821697 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:18.049176 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d309fce-b973-4b36-a551-44f8b56bc8eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:18.050930 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d309fce-b973-4b36-a551-44f8b56bc8eb None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:18.051212 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d309fce-b973-4b36-a551-44f8b56bc8eb None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:18.051485 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d309fce-b973-4b36-a551-44f8b56bc8eb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:18.064840 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d309fce-b973-4b36-a551-44f8b56bc8eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:23:18.075360 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-9d309fce-b973-4b36-a551-44f8b56bc8eb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 15:23:18.075360 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:18.075360 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:18.075360 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:18.075360 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:18.075360 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:18.075360 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:18.075360 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:18.075360 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:18.075360 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:18.075360 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:18.075360 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:18.075360 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:23:18.075360 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:23:18.075360 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:23:18.075360 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:23:18.076304 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:23:18.076304 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:23:18.076304 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:23:18.076304 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:23:18.076304 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:18.076304 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:18.076304 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:18.076304 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:18.076304 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:18.076304 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:18.076304 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:18.076304 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:18.076304 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:18.076304 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:18.076304 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:18.076304 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:18.077057 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:18.077057 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:18.077057 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:18.077057 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:18.077057 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:23:18.077057 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:23:18.077057 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:23:18.077057 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:23:18.077057 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:23:18.077057 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:23:18.077057 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 15:23:18.077057 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:23:18.077057 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 134/286] 10.222.0.118 () {56 vars in 1104 bytes} [Thu Jul 14 15:23:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:18.083386 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d309fce-b973-4b36-a551-44f8b56bc8eb None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:18.162924 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa282da2-bb3d-48a7-85cb-a77799821697 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:18.195543 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d309fce-b973-4b36-a551-44f8b56bc8eb None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:18.199953 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae926cc3-331d-475d-be5d-0ccba199dd48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:18.200999 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae926cc3-331d-475d-be5d-0ccba199dd48 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:18.201448 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae926cc3-331d-475d-be5d-0ccba199dd48 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:18.201865 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae926cc3-331d-475d-be5d-0ccba199dd48 None admin] PATH_INFO: `/v3/users/4e63e348b2e347e3b2b8b76ad83ba9e9` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:18.203369 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae926cc3-331d-475d-be5d-0ccba199dd48 None admin] RBAC: Authorizing `identity:get_user(user_id=4e63e348b2e347e3b2b8b76ad83ba9e9)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:18.204979 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae926cc3-331d-475d-be5d-0ccba199dd48 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:18.207528 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 153/287] 10.222.0.118 () {56 vars in 1182 bytes} [Thu Jul 14 15:23:18 2022] GET /identity/v3/users/4e63e348b2e347e3b2b8b76ad83ba9e9 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:18.227491 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae926cc3-331d-475d-be5d-0ccba199dd48 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:18.241993 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc5a9ca-1ce2-400c-8add-6c322ee1391d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:18.241993 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc5a9ca-1ce2-400c-8add-6c322ee1391d None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:18.241993 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc5a9ca-1ce2-400c-8add-6c322ee1391d None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:18.241993 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc5a9ca-1ce2-400c-8add-6c322ee1391d None admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:18.242432 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc5a9ca-1ce2-400c-8add-6c322ee1391d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:18.242432 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc5a9ca-1ce2-400c-8add-6c322ee1391d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:18.242432 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc5a9ca-1ce2-400c-8add-6c322ee1391d None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:18.256390 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 135/288] 10.222.0.118 () {56 vars in 1106 bytes} [Thu Jul 14 15:23:18 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:18.258218 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc5a9ca-1ce2-400c-8add-6c322ee1391d None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:18.281429 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:18.322626 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:18.385277 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae926cc3-331d-475d-be5d-0ccba199dd48 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:18.440104 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc5a9ca-1ce2-400c-8add-6c322ee1391d None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:18.463773 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8358526c-8f7c-4aa4-b153-5c21ae592592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:18.464429 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8358526c-8f7c-4aa4-b153-5c21ae592592 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:18.464708 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8358526c-8f7c-4aa4-b153-5c21ae592592 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:18.464977 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8358526c-8f7c-4aa4-b153-5c21ae592592 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:18.504607 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb56269-7a23-4df5-bb75-166a86504493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:18.505408 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb56269-7a23-4df5-bb75-166a86504493 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:18.505944 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb56269-7a23-4df5-bb75-166a86504493 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:18.506249 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb56269-7a23-4df5-bb75-166a86504493 None admin] PATH_INFO: `/v3/users/b86ca1874b1848139592bd7dea67f846` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:18.508404 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb56269-7a23-4df5-bb75-166a86504493 None admin] RBAC: Authorizing `identity:get_user(user_id=b86ca1874b1848139592bd7dea67f846)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:18.509866 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb56269-7a23-4df5-bb75-166a86504493 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:18.511905 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 136/289] 10.222.0.118 () {56 vars in 1182 bytes} [Thu Jul 14 15:23:18 2022] GET /identity/v3/users/b86ca1874b1848139592bd7dea67f846 => generated 298 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:18.517219 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb56269-7a23-4df5-bb75-166a86504493 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:18.602249 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:18.626960 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8358526c-8f7c-4aa4-b153-5c21ae592592 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:18.628854 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8358526c-8f7c-4aa4-b153-5c21ae592592 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:18.678763 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb56269-7a23-4df5-bb75-166a86504493 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:18.732521 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:18.741859 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d61ad5a-d9e3-433a-ad10-ce3bf33e1187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:18.742759 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d61ad5a-d9e3-433a-ad10-ce3bf33e1187 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:18.743039 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d61ad5a-d9e3-433a-ad10-ce3bf33e1187 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:18.743313 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d61ad5a-d9e3-433a-ad10-ce3bf33e1187 None admin] PATH_INFO: `/v3/projects/9d45367dfdd34d7ab5e0b055eda4e88e` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:18.745512 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d61ad5a-d9e3-433a-ad10-ce3bf33e1187 None admin] RBAC: Authorizing `identity:get_project(project_id=9d45367dfdd34d7ab5e0b055eda4e88e)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:18.747206 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d61ad5a-d9e3-433a-ad10-ce3bf33e1187 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:18.750694 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 137/290] 10.222.0.118 () {56 vars in 1191 bytes} [Thu Jul 14 15:23:18 2022] GET /identity/v3/projects/9d45367dfdd34d7ab5e0b055eda4e88e => generated 303 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:23:18.759604 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d61ad5a-d9e3-433a-ad10-ce3bf33e1187 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:18.808628 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 154/291] 10.222.0.118 () {58 vars in 1287 bytes} [Thu Jul 14 15:23:18 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 582 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 15:23:18.815275 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8358526c-8f7c-4aa4-b153-5c21ae592592 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:18.931603 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d61ad5a-d9e3-433a-ad10-ce3bf33e1187 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:18.987553 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8358526c-8f7c-4aa4-b153-5c21ae592592 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:18.997428 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375f6330-9421-41de-8762-366f2343ca70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:18.998358 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f6330-9421-41de-8762-366f2343ca70 None admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:18.998636 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f6330-9421-41de-8762-366f2343ca70 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:18.998911 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f6330-9421-41de-8762-366f2343ca70 None admin] PATH_INFO: `/v3/projects/9d45367dfdd34d7ab5e0b055eda4e88e/users/b86ca1874b1848139592bd7dea67f846/roles/63af4c63b0c343909af17164f6e26a71` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:19.003820 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375f6330-9421-41de-8762-366f2343ca70 None admin] RBAC: Authorizing `identity:create_grant(project_id=9d45367dfdd34d7ab5e0b055eda4e88e, user_id=b86ca1874b1848139592bd7dea67f846, role_id=63af4c63b0c343909af17164f6e26a71)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:19.005291 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375f6330-9421-41de-8762-366f2343ca70 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:19.023018 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:19.027640 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 138/292] 10.222.0.118 () {58 vars in 1444 bytes} [Thu Jul 14 15:23:18 2022] PUT /identity/v3/projects/9d45367dfdd34d7ab5e0b055eda4e88e/users/b86ca1874b1848139592bd7dea67f846/roles/63af4c63b0c343909af17164f6e26a71 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:23:19.039481 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165b9f40-7fbb-4a2d-ae52-a0cc091fa782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:19.040368 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165b9f40-7fbb-4a2d-ae52-a0cc091fa782 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:19.040698 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165b9f40-7fbb-4a2d-ae52-a0cc091fa782 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:19.040972 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165b9f40-7fbb-4a2d-ae52-a0cc091fa782 None admin] PATH_INFO: `/v3/projects/9d45367dfdd34d7ab5e0b055eda4e88e` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:19.042268 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165b9f40-7fbb-4a2d-ae52-a0cc091fa782 None admin] RBAC: Authorizing `identity:get_project(project_id=9d45367dfdd34d7ab5e0b055eda4e88e)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:19.043790 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165b9f40-7fbb-4a2d-ae52-a0cc091fa782 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:19.046156 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 155/293] 10.222.0.118 () {56 vars in 1191 bytes} [Thu Jul 14 15:23:18 2022] GET /identity/v3/projects/9d45367dfdd34d7ab5e0b055eda4e88e => generated 303 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:23:19.052150 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375f6330-9421-41de-8762-366f2343ca70 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:19.211240 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375f6330-9421-41de-8762-366f2343ca70 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:19.261053 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcae2af-cd42-4c3f-90c3-e9947ff7cb01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:19.261721 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcae2af-cd42-4c3f-90c3-e9947ff7cb01 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:19.262029 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcae2af-cd42-4c3f-90c3-e9947ff7cb01 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:19.262441 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcae2af-cd42-4c3f-90c3-e9947ff7cb01 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:19.263295 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcae2af-cd42-4c3f-90c3-e9947ff7cb01 None admin] RBAC: Adding query filter params (role.id=4abcf5e5e7cd4b53ae1828fec6550d53, scope.project.id=9d45367dfdd34d7ab5e0b055eda4e88e, user.id=4e63e348b2e347e3b2b8b76ad83ba9e9) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:19.263606 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcae2af-cd42-4c3f-90c3-e9947ff7cb01 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:19.265075 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcae2af-cd42-4c3f-90c3-e9947ff7cb01 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:19.275619 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 139/294] 10.222.0.118 () {56 vars in 1379 bytes} [Thu Jul 14 15:23:19 2022] GET /identity/v3/role_assignments?user.id=4e63e348b2e347e3b2b8b76ad83ba9e9&scope.project.id=9d45367dfdd34d7ab5e0b055eda4e88e&role.id=4abcf5e5e7cd4b53ae1828fec6550d53 => generated 610 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:20.042188 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70058f8b-a8df-440a-a612-271444ef9a1c None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:20.042685 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70058f8b-a8df-440a-a612-271444ef9a1c None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:20.042685 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70058f8b-a8df-440a-a612-271444ef9a1c None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:20.044281 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 156/295] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:23:20 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:23:20.049479 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff700a7c-82be-4124-84c5-90e159efe21a None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:20.049888 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff700a7c-82be-4124-84c5-90e159efe21a None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:20.050072 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff700a7c-82be-4124-84c5-90e159efe21a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:20.067725 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-ff700a7c-82be-4124-84c5-90e159efe21a None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:20.068923 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-ff700a7c-82be-4124-84c5-90e159efe21a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:20.129836 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:20.147283 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 140/296] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:23:20 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:23:20.164681 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70058f8b-a8df-440a-a612-271444ef9a1c None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:20.193490 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:20.254469 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb10137-3a44-4b08-a829-83db15f8f118 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:20.255091 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb10137-3a44-4b08-a829-83db15f8f118 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:20.255460 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb10137-3a44-4b08-a829-83db15f8f118 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:20.257736 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 141/297] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:23:20 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:23:20.263548 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b0768d-6421-4b3b-8013-fc8685156321 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:20.263940 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b0768d-6421-4b3b-8013-fc8685156321 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:20.264362 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b0768d-6421-4b3b-8013-fc8685156321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:20.275703 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70058f8b-a8df-440a-a612-271444ef9a1c None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:20.289608 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-69b0768d-6421-4b3b-8013-fc8685156321 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:20.291249 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-69b0768d-6421-4b3b-8013-fc8685156321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:20.317165 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1418a78c-1893-4112-b0a6-2054b4d7f0af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:20.318332 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1418a78c-1893-4112-b0a6-2054b4d7f0af None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:20.318607 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1418a78c-1893-4112-b0a6-2054b4d7f0af None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:20.319032 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1418a78c-1893-4112-b0a6-2054b4d7f0af None admin] PATH_INFO: `/v3/roles/member` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:20.329014 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1418a78c-1893-4112-b0a6-2054b4d7f0af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:23:20.337233 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-1418a78c-1893-4112-b0a6-2054b4d7f0af None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 15:23:20.337233 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:20.337233 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:20.337233 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:20.337233 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:20.337233 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:20.337233 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:20.337233 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:20.337233 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:20.337233 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:20.337233 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:20.337233 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:20.337233 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:23:20.337233 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:23:20.337233 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:23:20.337233 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:23:20.338134 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:23:20.338134 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:23:20.338134 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:23:20.338134 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:23:20.338134 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:20.338134 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:20.338134 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:20.338134 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:20.338134 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:20.338134 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:20.338134 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:20.338134 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:20.338134 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:20.338134 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:20.338134 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:20.338134 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:20.338938 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:20.338938 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:20.338938 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:20.338938 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:20.338938 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:23:20.338938 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:23:20.338938 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:23:20.338938 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:23:20.338938 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:23:20.338938 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:23:20.338938 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 15:23:20.338938 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:23:20.342529 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 157/298] 10.222.0.118 () {56 vars in 1104 bytes} [Thu Jul 14 15:23:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:20.344676 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de6415-2abb-41d0-8043-36e6ed4264ba None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:20.345135 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de6415-2abb-41d0-8043-36e6ed4264ba None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:20.345415 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de6415-2abb-41d0-8043-36e6ed4264ba None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:20.346921 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 158/299] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:23:20 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:23:20.350367 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18de6415-2abb-41d0-8043-36e6ed4264ba None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:20.370786 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 142/300] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:23:20 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:23:20.376093 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f97187-ecc2-48b4-8e0d-50e860592ab3 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:20.376891 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f97187-ecc2-48b4-8e0d-50e860592ab3 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:20.377494 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f97187-ecc2-48b4-8e0d-50e860592ab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:20.401208 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-a0f97187-ecc2-48b4-8e0d-50e860592ab3 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:20.402664 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-a0f97187-ecc2-48b4-8e0d-50e860592ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:20.450546 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:20.466250 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18de6415-2abb-41d0-8043-36e6ed4264ba None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:20.487120 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 143/301] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:23:20 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:23:20.487777 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f97187-ecc2-48b4-8e0d-50e860592ab3 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:20.522711 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100a2134-0f4c-48bf-9745-515d63a7abe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:20.523358 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100a2134-0f4c-48bf-9745-515d63a7abe4 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:20.523633 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100a2134-0f4c-48bf-9745-515d63a7abe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:20.523902 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100a2134-0f4c-48bf-9745-515d63a7abe4 None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:20.524652 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100a2134-0f4c-48bf-9745-515d63a7abe4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:20.524948 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100a2134-0f4c-48bf-9745-515d63a7abe4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:20.526360 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100a2134-0f4c-48bf-9745-515d63a7abe4 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:20.535492 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 159/302] 10.222.0.118 () {56 vars in 1106 bytes} [Thu Jul 14 15:23:20 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:20.536110 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100a2134-0f4c-48bf-9745-515d63a7abe4 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:20.553726 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:20.610048 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f97187-ecc2-48b4-8e0d-50e860592ab3 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:20.635588 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100a2134-0f4c-48bf-9745-515d63a7abe4 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:20.654898 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bac1b1e-91c3-4a1d-8fdf-b6c27ce3f66c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:20.655688 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bac1b1e-91c3-4a1d-8fdf-b6c27ce3f66c None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:20.655966 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bac1b1e-91c3-4a1d-8fdf-b6c27ce3f66c None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:20.656233 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bac1b1e-91c3-4a1d-8fdf-b6c27ce3f66c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:20.657393 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bac1b1e-91c3-4a1d-8fdf-b6c27ce3f66c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:20.658856 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bac1b1e-91c3-4a1d-8fdf-b6c27ce3f66c None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:20.661022 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 144/303] 10.222.0.118 () {56 vars in 1113 bytes} [Thu Jul 14 15:23:20 2022] GET /identity/v3/domains/default => generated 200 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:20.662128 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bac1b1e-91c3-4a1d-8fdf-b6c27ce3f66c None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:20.679377 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c34abe-1f07-4bef-aa55-cdc6f99af88b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:20.680180 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c34abe-1f07-4bef-aa55-cdc6f99af88b None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:20.680460 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c34abe-1f07-4bef-aa55-cdc6f99af88b None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:20.680735 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c34abe-1f07-4bef-aa55-cdc6f99af88b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:20.691147 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c34abe-1f07-4bef-aa55-cdc6f99af88b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:23:20.698849 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-21c34abe-1f07-4bef-aa55-cdc6f99af88b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 15:23:20.698849 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:20.698849 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:20.698849 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:20.698849 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:20.698849 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:20.698849 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:20.698849 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:20.698849 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:20.698849 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:20.698849 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:20.698849 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:20.698849 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:23:20.698849 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:23:20.698849 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:23:20.698849 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:23:20.699711 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:23:20.699711 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:23:20.699711 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:23:20.699711 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:23:20.699711 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:20.699711 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:20.699711 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:20.699711 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:20.699711 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:20.699711 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:20.699711 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:20.699711 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:20.699711 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:20.699711 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:20.699711 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:20.699711 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:20.700473 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:20.700473 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:20.700473 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:20.700473 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:20.700473 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:23:20.700473 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:23:20.700473 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:23:20.700473 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:23:20.700473 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:23:20.700473 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:23:20.700473 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 15:23:20.700473 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:23:20.705165 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 160/304] 10.222.0.118 () {56 vars in 1104 bytes} [Thu Jul 14 15:23:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:20.705870 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c34abe-1f07-4bef-aa55-cdc6f99af88b None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:20.722308 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:20.769586 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bac1b1e-91c3-4a1d-8fdf-b6c27ce3f66c None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:20.795511 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:20.811031 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff2933c-4282-4644-a3be-28e13f30d555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:20.811898 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff2933c-4282-4644-a3be-28e13f30d555 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:20.812180 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff2933c-4282-4644-a3be-28e13f30d555 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:20.812443 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff2933c-4282-4644-a3be-28e13f30d555 None admin] PATH_INFO: `/v3/users/8c2b37bceec248408f2ec2dd3e9206fd` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:20.813638 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff2933c-4282-4644-a3be-28e13f30d555 None admin] RBAC: Authorizing `identity:get_user(user_id=8c2b37bceec248408f2ec2dd3e9206fd)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:20.815135 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff2933c-4282-4644-a3be-28e13f30d555 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:20.817252 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 145/305] 10.222.0.118 () {56 vars in 1182 bytes} [Thu Jul 14 15:23:20 2022] GET /identity/v3/users/8c2b37bceec248408f2ec2dd3e9206fd => generated 294 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:20.818027 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff2933c-4282-4644-a3be-28e13f30d555 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:20.823905 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c34abe-1f07-4bef-aa55-cdc6f99af88b None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:20.860164 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25532b1-64eb-4e26-8726-13ecbb604b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:20.861103 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25532b1-64eb-4e26-8726-13ecbb604b05 None admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:20.861449 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25532b1-64eb-4e26-8726-13ecbb604b05 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:20.861720 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25532b1-64eb-4e26-8726-13ecbb604b05 None admin] PATH_INFO: `/v3/groups` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:20.862448 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25532b1-64eb-4e26-8726-13ecbb604b05 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:20.864440 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25532b1-64eb-4e26-8726-13ecbb604b05 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:20.885991 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 161/306] 10.222.0.118 () {60 vars in 1139 bytes} [Thu Jul 14 15:23:20 2022] POST /identity/v3/groups => generated 230 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:23:20.885991 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25532b1-64eb-4e26-8726-13ecbb604b05 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:20.929610 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff2933c-4282-4644-a3be-28e13f30d555 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:20.974358 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15daa9e9-1500-461a-8a9c-5926b6be389a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:20.974799 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15daa9e9-1500-461a-8a9c-5926b6be389a None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:20.975105 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15daa9e9-1500-461a-8a9c-5926b6be389a None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:20.975388 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15daa9e9-1500-461a-8a9c-5926b6be389a None admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:20.976170 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15daa9e9-1500-461a-8a9c-5926b6be389a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:20.976571 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15daa9e9-1500-461a-8a9c-5926b6be389a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:20.977946 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15daa9e9-1500-461a-8a9c-5926b6be389a None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:20.987461 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 146/307] 10.222.0.118 () {56 vars in 1106 bytes} [Thu Jul 14 15:23:20 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:20.993590 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:20.997129 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15daa9e9-1500-461a-8a9c-5926b6be389a None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:21.040091 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25532b1-64eb-4e26-8726-13ecbb604b05 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:21.070595 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:21.092408 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b068ec-a692-47be-8702-bbda3289c126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:21.093871 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b068ec-a692-47be-8702-bbda3289c126 None admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:21.094323 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b068ec-a692-47be-8702-bbda3289c126 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:21.094595 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b068ec-a692-47be-8702-bbda3289c126 None admin] PATH_INFO: `/v3/system/users/8c2b37bceec248408f2ec2dd3e9206fd/roles/4abcf5e5e7cd4b53ae1828fec6550d53` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:21.096125 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b068ec-a692-47be-8702-bbda3289c126 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=8c2b37bceec248408f2ec2dd3e9206fd, role_id=4abcf5e5e7cd4b53ae1828fec6550d53)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:21.097610 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b068ec-a692-47be-8702-bbda3289c126 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:21.114142 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 162/308] 10.222.0.118 () {58 vars in 1339 bytes} [Thu Jul 14 15:23:20 2022] PUT /identity/v3/system/users/8c2b37bceec248408f2ec2dd3e9206fd/roles/4abcf5e5e7cd4b53ae1828fec6550d53 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:23:21.138159 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15daa9e9-1500-461a-8a9c-5926b6be389a None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:21.179180 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276ccc06-4b2b-435a-9b5b-008626fc3113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:21.180104 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276ccc06-4b2b-435a-9b5b-008626fc3113 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:21.180432 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276ccc06-4b2b-435a-9b5b-008626fc3113 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:21.180712 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276ccc06-4b2b-435a-9b5b-008626fc3113 None admin] PATH_INFO: `/v3/users/8be3e2c75b3e488fb5b5cd3c4ec3d266` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:21.197251 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276ccc06-4b2b-435a-9b5b-008626fc3113 None admin] RBAC: Authorizing `identity:get_user(user_id=8be3e2c75b3e488fb5b5cd3c4ec3d266)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:21.198772 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276ccc06-4b2b-435a-9b5b-008626fc3113 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:21.200970 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 147/309] 10.222.0.118 () {56 vars in 1182 bytes} [Thu Jul 14 15:23:20 2022] GET /identity/v3/users/8be3e2c75b3e488fb5b5cd3c4ec3d266 => generated 294 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:21.207131 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b068ec-a692-47be-8702-bbda3289c126 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:21.322861 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b068ec-a692-47be-8702-bbda3289c126 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:21.358748 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2647ebdf-1add-473f-ad08-5785b57ee6e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:21.359762 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2647ebdf-1add-473f-ad08-5785b57ee6e0 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:21.360246 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2647ebdf-1add-473f-ad08-5785b57ee6e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:21.360723 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2647ebdf-1add-473f-ad08-5785b57ee6e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:21.361788 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2647ebdf-1add-473f-ad08-5785b57ee6e0 None admin] RBAC: Adding query filter params (role.id=63af4c63b0c343909af17164f6e26a71, user.id=8be3e2c75b3e488fb5b5cd3c4ec3d266, scope.system=all) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:21.362352 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2647ebdf-1add-473f-ad08-5785b57ee6e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:21.364041 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2647ebdf-1add-473f-ad08-5785b57ee6e0 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:21.366027 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:21.372511 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 163/310] 10.222.0.118 () {56 vars in 1313 bytes} [Thu Jul 14 15:23:21 2022] GET /identity/v3/role_assignments?user.id=8be3e2c75b3e488fb5b5cd3c4ec3d266&scope.system=all&role.id=63af4c63b0c343909af17164f6e26a71 => generated 227 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:21.415504 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49be4bd-02ac-4f3f-a13f-7f2d67f5cb3d None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:21.415784 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49be4bd-02ac-4f3f-a13f-7f2d67f5cb3d None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:21.416061 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49be4bd-02ac-4f3f-a13f-7f2d67f5cb3d None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:21.417517 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 148/311] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:23:21 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:23:21.423250 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49afca42-32c3-4c02-bddb-a0f139d4fc01 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:21.423536 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49afca42-32c3-4c02-bddb-a0f139d4fc01 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:21.423814 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49afca42-32c3-4c02-bddb-a0f139d4fc01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:21.442665 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-49afca42-32c3-4c02-bddb-a0f139d4fc01 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:21.443900 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-49afca42-32c3-4c02-bddb-a0f139d4fc01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:21.522549 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 164/312] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:23:21 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:23:21.545314 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49be4bd-02ac-4f3f-a13f-7f2d67f5cb3d None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:21.656088 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49be4bd-02ac-4f3f-a13f-7f2d67f5cb3d None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:21.669795 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:21.694438 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19447cc6-6e3b-4db6-8d4a-64a5de3070c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:21.695241 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19447cc6-6e3b-4db6-8d4a-64a5de3070c7 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:21.695520 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19447cc6-6e3b-4db6-8d4a-64a5de3070c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:21.695793 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19447cc6-6e3b-4db6-8d4a-64a5de3070c7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:21.706950 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19447cc6-6e3b-4db6-8d4a-64a5de3070c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:23:21.715421 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-19447cc6-6e3b-4db6-8d4a-64a5de3070c7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 15:23:21.715421 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:21.715421 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:21.715421 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:21.715421 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:21.715421 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:21.715421 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:21.715421 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:21.715421 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:21.715421 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:21.715421 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:21.715421 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:21.715421 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:23:21.715421 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:23:21.715421 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:23:21.715421 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:23:21.716490 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:23:21.716490 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:23:21.716490 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:23:21.716490 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:23:21.716490 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:21.716490 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:21.716490 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:21.716490 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:21.716490 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:21.716490 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:21.716490 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:21.716490 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:21.716490 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:21.716490 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:21.716490 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:21.716490 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:21.717452 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:21.717452 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:21.717452 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:21.717452 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:21.717452 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:23:21.717452 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:23:21.717452 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:23:21.717452 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:23:21.717452 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:23:21.717452 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:23:21.717452 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 15:23:21.717452 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:23:21.717452 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 149/313] 10.222.0.118 () {56 vars in 1104 bytes} [Thu Jul 14 15:23:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:21.722729 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49afca42-32c3-4c02-bddb-a0f139d4fc01 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:21.826671 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49afca42-32c3-4c02-bddb-a0f139d4fc01 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:21.854374 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:21.863002 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fc6cfc-41d5-47c5-9acd-05759d86b13b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:21.864258 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc6cfc-41d5-47c5-9acd-05759d86b13b None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:21.864478 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc6cfc-41d5-47c5-9acd-05759d86b13b None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:21.864746 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc6cfc-41d5-47c5-9acd-05759d86b13b None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:21.865508 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fc6cfc-41d5-47c5-9acd-05759d86b13b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:21.865847 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fc6cfc-41d5-47c5-9acd-05759d86b13b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:21.867267 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fc6cfc-41d5-47c5-9acd-05759d86b13b None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:21.876809 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 165/314] 10.222.0.118 () {56 vars in 1106 bytes} [Thu Jul 14 15:23:21 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:21.883196 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19447cc6-6e3b-4db6-8d4a-64a5de3070c7 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:21.984971 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19447cc6-6e3b-4db6-8d4a-64a5de3070c7 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:22.021016 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2616df8-3ed2-41be-a8bc-3d6b988e2912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:22.021894 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2616df8-3ed2-41be-a8bc-3d6b988e2912 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:22.022198 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2616df8-3ed2-41be-a8bc-3d6b988e2912 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:22.022471 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2616df8-3ed2-41be-a8bc-3d6b988e2912 None admin] PATH_INFO: `/v3/users/b86ca1874b1848139592bd7dea67f846` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:22.023683 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2616df8-3ed2-41be-a8bc-3d6b988e2912 None admin] RBAC: Authorizing `identity:get_user(user_id=b86ca1874b1848139592bd7dea67f846)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:22.025130 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2616df8-3ed2-41be-a8bc-3d6b988e2912 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:22.027077 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 150/315] 10.222.0.118 () {56 vars in 1182 bytes} [Thu Jul 14 15:23:21 2022] GET /identity/v3/users/b86ca1874b1848139592bd7dea67f846 => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:22.032551 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fc6cfc-41d5-47c5-9acd-05759d86b13b None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:22.138496 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fc6cfc-41d5-47c5-9acd-05759d86b13b None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:22.174039 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363699c6-0754-4e6b-b824-a3424a256380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:22.174704 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363699c6-0754-4e6b-b824-a3424a256380 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:22.174985 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363699c6-0754-4e6b-b824-a3424a256380 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:22.175258 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363699c6-0754-4e6b-b824-a3424a256380 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:22.235747 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:22.246433 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363699c6-0754-4e6b-b824-a3424a256380 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:22.248348 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363699c6-0754-4e6b-b824-a3424a256380 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:22.350480 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 166/316] 10.222.0.118 () {58 vars in 1287 bytes} [Thu Jul 14 15:23:22 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 15:23:22.356119 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2616df8-3ed2-41be-a8bc-3d6b988e2912 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:22.397101 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:22.464057 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2616df8-3ed2-41be-a8bc-3d6b988e2912 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:22.498132 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a879ac08-6a01-4dc3-af11-c04b4c213980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:22.498908 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a879ac08-6a01-4dc3-af11-c04b4c213980 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:22.499185 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a879ac08-6a01-4dc3-af11-c04b4c213980 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:22.499457 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a879ac08-6a01-4dc3-af11-c04b4c213980 None admin] PATH_INFO: `/v3/projects/9d45367dfdd34d7ab5e0b055eda4e88e` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:22.500644 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a879ac08-6a01-4dc3-af11-c04b4c213980 None admin] RBAC: Authorizing `identity:get_project(project_id=9d45367dfdd34d7ab5e0b055eda4e88e)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:22.502131 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a879ac08-6a01-4dc3-af11-c04b4c213980 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:22.504706 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 151/317] 10.222.0.118 () {56 vars in 1191 bytes} [Thu Jul 14 15:23:22 2022] GET /identity/v3/projects/9d45367dfdd34d7ab5e0b055eda4e88e => generated 303 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:22.511284 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363699c6-0754-4e6b-b824-a3424a256380 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:22.615233 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:22.625615 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363699c6-0754-4e6b-b824-a3424a256380 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:22.661563 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf60d01-01e1-487d-b92f-8e56224284da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:22.662596 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf60d01-01e1-487d-b92f-8e56224284da None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:22.663069 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf60d01-01e1-487d-b92f-8e56224284da None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:22.663559 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf60d01-01e1-487d-b92f-8e56224284da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:22.664588 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf60d01-01e1-487d-b92f-8e56224284da None admin] RBAC: Adding query filter params (role.id=63af4c63b0c343909af17164f6e26a71, scope.project.id=9d45367dfdd34d7ab5e0b055eda4e88e, user.id=b86ca1874b1848139592bd7dea67f846) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:22.665088 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf60d01-01e1-487d-b92f-8e56224284da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:22.666738 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf60d01-01e1-487d-b92f-8e56224284da None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:22.673376 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 167/318] 10.222.0.118 () {56 vars in 1379 bytes} [Thu Jul 14 15:23:22 2022] GET /identity/v3/role_assignments?user.id=b86ca1874b1848139592bd7dea67f846&scope.project.id=9d45367dfdd34d7ab5e0b055eda4e88e&role.id=63af4c63b0c343909af17164f6e26a71 => generated 610 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:23.025806 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06239ec-23e8-4ff9-b284-36b4f1132a62 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:23.026223 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06239ec-23e8-4ff9-b284-36b4f1132a62 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:23.026396 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06239ec-23e8-4ff9-b284-36b4f1132a62 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:23.027801 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 152/319] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:23:23 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:23:23.032796 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc27673c-280e-4350-9192-40d90711fbdf None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:23.033082 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc27673c-280e-4350-9192-40d90711fbdf None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:23.033359 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc27673c-280e-4350-9192-40d90711fbdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:23.050509 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-fc27673c-280e-4350-9192-40d90711fbdf None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:23.052290 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-fc27673c-280e-4350-9192-40d90711fbdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:23.117728 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 168/320] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:23:23 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:23:23.140295 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06239ec-23e8-4ff9-b284-36b4f1132a62 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:23.247574 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06239ec-23e8-4ff9-b284-36b4f1132a62 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:23.255860 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:23.284772 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e125b9d0-f27b-45ad-80c0-dda768d85729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:23.286075 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e125b9d0-f27b-45ad-80c0-dda768d85729 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:23.286353 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e125b9d0-f27b-45ad-80c0-dda768d85729 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:23.286621 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e125b9d0-f27b-45ad-80c0-dda768d85729 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:23.287813 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e125b9d0-f27b-45ad-80c0-dda768d85729 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:23.289241 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e125b9d0-f27b-45ad-80c0-dda768d85729 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:23.291052 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 153/321] 10.222.0.118 () {56 vars in 1113 bytes} [Thu Jul 14 15:23:23 2022] GET /identity/v3/domains/default => generated 200 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:23.296366 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc27673c-280e-4350-9192-40d90711fbdf None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:23.357632 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f77ca4-cb45-4fe1-8fe3-792f564313fb None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:23.358172 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f77ca4-cb45-4fe1-8fe3-792f564313fb None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:23.358172 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f77ca4-cb45-4fe1-8fe3-792f564313fb None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:23.359817 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 154/322] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:23:23 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 14 15:23:23.367693 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958fc18a-14bb-4fac-8a5f-9680cbb9daee None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:23.367972 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958fc18a-14bb-4fac-8a5f-9680cbb9daee None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:23.368242 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958fc18a-14bb-4fac-8a5f-9680cbb9daee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:23.385010 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-958fc18a-14bb-4fac-8a5f-9680cbb9daee None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:23.386191 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-958fc18a-14bb-4fac-8a5f-9680cbb9daee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:23.386952 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:23.405581 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc27673c-280e-4350-9192-40d90711fbdf None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:23.443571 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83f7683-35ef-4a1c-949b-9d6b507a7ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:23.444267 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83f7683-35ef-4a1c-949b-9d6b507a7ee8 None admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:23.444544 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83f7683-35ef-4a1c-949b-9d6b507a7ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:23.444815 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83f7683-35ef-4a1c-949b-9d6b507a7ee8 None admin] PATH_INFO: `/v3/groups` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:23.445511 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83f7683-35ef-4a1c-949b-9d6b507a7ee8 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:23.446973 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83f7683-35ef-4a1c-949b-9d6b507a7ee8 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:23.462008 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 155/323] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:23:23 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 15:23:23.468629 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 169/324] 10.222.0.118 () {60 vars in 1139 bytes} [Thu Jul 14 15:23:23 2022] POST /identity/v3/groups => generated 227 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:23:23.482048 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958fc18a-14bb-4fac-8a5f-9680cbb9daee None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:23.539781 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7b3f76-d781-4e71-8f64-6b34e716d308 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:23.539959 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7b3f76-d781-4e71-8f64-6b34e716d308 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:23.540233 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7b3f76-d781-4e71-8f64-6b34e716d308 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:23.541625 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 170/325] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:23:23 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:23:23.547442 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7a7acd-99b9-431e-8d1c-d32b868812f6 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:23.547807 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7a7acd-99b9-431e-8d1c-d32b868812f6 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:23.548000 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7a7acd-99b9-431e-8d1c-d32b868812f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:23.566939 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-4a7a7acd-99b9-431e-8d1c-d32b868812f6 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:23.568153 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-4a7a7acd-99b9-431e-8d1c-d32b868812f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:23.604585 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958fc18a-14bb-4fac-8a5f-9680cbb9daee None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:23.608532 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:23.646482 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46706a1-ead5-43f0-b0c2-2f42d5a54edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:23.647864 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46706a1-ead5-43f0-b0c2-2f42d5a54edc None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:23.647864 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46706a1-ead5-43f0-b0c2-2f42d5a54edc None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:23.647864 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46706a1-ead5-43f0-b0c2-2f42d5a54edc None admin] PATH_INFO: `/v3/roles/member` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:23.655553 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 171/326] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:23:23 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 15:23:23.661497 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46706a1-ead5-43f0-b0c2-2f42d5a54edc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:23:23.669191 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-a46706a1-ead5-43f0-b0c2-2f42d5a54edc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 15:23:23.669191 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:23.669191 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:23.669191 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:23.669191 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:23.669191 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:23.669191 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:23.669191 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:23.669191 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:23.669191 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:23.669191 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:23.669191 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:23.669191 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:23:23.669191 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:23:23.669191 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:23:23.669191 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:23:23.670380 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:23:23.670380 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:23:23.670380 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:23:23.670380 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:23:23.670380 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:23.670380 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:23.670380 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:23.670380 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:23.670380 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:23.670380 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:23.670380 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:23.670380 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:23.670380 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:23.670380 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:23.670380 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:23.670380 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:23.671409 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:23.671409 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:23.671409 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:23.671409 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:23.671409 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:23:23.671409 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:23:23.671409 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:23:23.671409 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:23:23.671409 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:23:23.671409 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:23:23.671409 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 15:23:23.671409 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:23:23.671409 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 156/327] 10.222.0.118 () {56 vars in 1104 bytes} [Thu Jul 14 15:23:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:23.678432 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7a7acd-99b9-431e-8d1c-d32b868812f6 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:23.678610 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46706a1-ead5-43f0-b0c2-2f42d5a54edc None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:23.789130 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:23.814838 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46706a1-ead5-43f0-b0c2-2f42d5a54edc None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:23.822433 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7a7acd-99b9-431e-8d1c-d32b868812f6 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:23.862031 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd41a953-710e-483d-827f-8276d30768bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:23.862809 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd41a953-710e-483d-827f-8276d30768bc None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:23.863144 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd41a953-710e-483d-827f-8276d30768bc None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:23.863911 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd41a953-710e-483d-827f-8276d30768bc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:23.866940 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869f0fda-5b58-4951-8112-577955a9b4ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:23.867626 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869f0fda-5b58-4951-8112-577955a9b4ca None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:23.867907 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869f0fda-5b58-4951-8112-577955a9b4ca None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:23.868182 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869f0fda-5b58-4951-8112-577955a9b4ca None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:23.868941 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869f0fda-5b58-4951-8112-577955a9b4ca None admin] RBAC: Adding query filter params (name=member) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:23.869249 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869f0fda-5b58-4951-8112-577955a9b4ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:23.870681 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869f0fda-5b58-4951-8112-577955a9b4ca None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:23.877332 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd41a953-710e-483d-827f-8276d30768bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:23:23.881243 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 172/328] 10.222.0.118 () {56 vars in 1106 bytes} [Thu Jul 14 15:23:23 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:23:23.886587 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-cd41a953-710e-483d-827f-8276d30768bc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 15:23:23.886587 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:23.886587 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:23.886587 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:23.886587 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:23.886587 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:23.886587 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:23.886587 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:23.886587 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:23.886587 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:23.886587 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:23.886587 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:23.886587 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:23:23.886587 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:23:23.886587 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:23:23.886587 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:23:23.887510 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:23:23.887510 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:23:23.887510 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:23:23.887510 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:23:23.887510 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:23.887510 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:23.887510 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:23.887510 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:23.887510 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:23.887510 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:23.887510 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:23.887510 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:23.887510 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:23.887510 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:23.887510 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:23.887510 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:23.888285 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:23.888285 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:23.888285 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:23.888285 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:23.888285 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:23:23.888285 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:23:23.888285 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:23:23.888285 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:23:23.888285 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:23:23.888285 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:23:23.888285 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 15:23:23.888285 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:23:23.888866 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869f0fda-5b58-4951-8112-577955a9b4ca None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:23.888954 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 157/329] 10.222.0.118 () {56 vars in 1104 bytes} [Thu Jul 14 15:23:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:23:23.894393 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd41a953-710e-483d-827f-8276d30768bc None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:23.930178 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:24.023120 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869f0fda-5b58-4951-8112-577955a9b4ca None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:24.028074 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd41a953-710e-483d-827f-8276d30768bc None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:24.068003 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4925140-ad63-4587-a66e-7caebc008df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:24.069202 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4925140-ad63-4587-a66e-7caebc008df2 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:24.069802 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4925140-ad63-4587-a66e-7caebc008df2 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:24.070294 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4925140-ad63-4587-a66e-7caebc008df2 None admin] PATH_INFO: `/v3/users/8c2b37bceec248408f2ec2dd3e9206fd` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:24.072860 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4925140-ad63-4587-a66e-7caebc008df2 None admin] RBAC: Authorizing `identity:get_user(user_id=8c2b37bceec248408f2ec2dd3e9206fd)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:24.075085 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4925140-ad63-4587-a66e-7caebc008df2 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:24.077160 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 173/330] 10.222.0.118 () {56 vars in 1182 bytes} [Thu Jul 14 15:23:23 2022] GET /identity/v3/users/8c2b37bceec248408f2ec2dd3e9206fd => generated 294 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:24.077591 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11acb658-d46e-41a9-afc6-00f7c985dfe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:24.084784 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11acb658-d46e-41a9-afc6-00f7c985dfe8 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:24.084784 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11acb658-d46e-41a9-afc6-00f7c985dfe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:24.084784 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11acb658-d46e-41a9-afc6-00f7c985dfe8 None admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:24.084784 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11acb658-d46e-41a9-afc6-00f7c985dfe8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:24.084784 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11acb658-d46e-41a9-afc6-00f7c985dfe8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:24.084784 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11acb658-d46e-41a9-afc6-00f7c985dfe8 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:24.085231 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4925140-ad63-4587-a66e-7caebc008df2 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:24.090305 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:24.094875 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 158/331] 10.222.0.118 () {56 vars in 1106 bytes} [Thu Jul 14 15:23:23 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:23:24.100979 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11acb658-d46e-41a9-afc6-00f7c985dfe8 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:24.214344 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:24.217120 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4925140-ad63-4587-a66e-7caebc008df2 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:24.240627 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11acb658-d46e-41a9-afc6-00f7c985dfe8 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:24.263238 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3ff4a2-78f0-40fe-a41e-a4cca78e3769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:24.263894 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ff4a2-78f0-40fe-a41e-a4cca78e3769 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:24.264824 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ff4a2-78f0-40fe-a41e-a4cca78e3769 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:24.265195 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ff4a2-78f0-40fe-a41e-a4cca78e3769 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:24.266100 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3ff4a2-78f0-40fe-a41e-a4cca78e3769 None admin] RBAC: Adding query filter params (role.id=4abcf5e5e7cd4b53ae1828fec6550d53, user.id=8c2b37bceec248408f2ec2dd3e9206fd, scope.system=all) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:24.266414 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3ff4a2-78f0-40fe-a41e-a4cca78e3769 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:24.267856 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3ff4a2-78f0-40fe-a41e-a4cca78e3769 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:24.288438 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e44a3e-b371-4a50-bd90-706ae1c0ea6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:24.289350 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e44a3e-b371-4a50-bd90-706ae1c0ea6c None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:24.289614 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e44a3e-b371-4a50-bd90-706ae1c0ea6c None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:24.289809 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 174/332] 10.222.0.118 () {56 vars in 1313 bytes} [Thu Jul 14 15:23:24 2022] GET /identity/v3/role_assignments?user.id=8c2b37bceec248408f2ec2dd3e9206fd&scope.system=all&role.id=4abcf5e5e7cd4b53ae1828fec6550d53 => generated 512 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:24.289907 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e44a3e-b371-4a50-bd90-706ae1c0ea6c None admin] PATH_INFO: `/v3/users/8be3e2c75b3e488fb5b5cd3c4ec3d266` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:24.291229 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e44a3e-b371-4a50-bd90-706ae1c0ea6c None admin] RBAC: Authorizing `identity:get_user(user_id=8be3e2c75b3e488fb5b5cd3c4ec3d266)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:24.292819 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e44a3e-b371-4a50-bd90-706ae1c0ea6c None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:24.294883 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 159/333] 10.222.0.118 () {56 vars in 1182 bytes} [Thu Jul 14 15:23:24 2022] GET /identity/v3/users/8be3e2c75b3e488fb5b5cd3c4ec3d266 => generated 294 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:23:24.300491 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3ff4a2-78f0-40fe-a41e-a4cca78e3769 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:24.378478 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:24.423088 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3ff4a2-78f0-40fe-a41e-a4cca78e3769 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:24.461478 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2e0004-fe34-407e-bf80-31e528ad003c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:24.462373 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e0004-fe34-407e-bf80-31e528ad003c None admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:24.462652 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e0004-fe34-407e-bf80-31e528ad003c None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:24.462936 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e0004-fe34-407e-bf80-31e528ad003c None admin] PATH_INFO: `/v3/system/users/8be3e2c75b3e488fb5b5cd3c4ec3d266/roles/63af4c63b0c343909af17164f6e26a71` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:24.464469 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2e0004-fe34-407e-bf80-31e528ad003c None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=8be3e2c75b3e488fb5b5cd3c4ec3d266, role_id=63af4c63b0c343909af17164f6e26a71)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:24.465919 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2e0004-fe34-407e-bf80-31e528ad003c None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:24.475134 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 175/334] 10.222.0.118 () {58 vars in 1339 bytes} [Thu Jul 14 15:23:24 2022] PUT /identity/v3/system/users/8be3e2c75b3e488fb5b5cd3c4ec3d266/roles/63af4c63b0c343909af17164f6e26a71 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:23:26.069560 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42f9579-0b4e-48c6-a598-b86f808aa83b None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:26.070063 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42f9579-0b4e-48c6-a598-b86f808aa83b None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:26.070063 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42f9579-0b4e-48c6-a598-b86f808aa83b None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:26.071758 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 160/335] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:23:26 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:23:26.077111 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ef9f01-849f-444d-a131-9695ac0cb2f2 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:26.077678 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ef9f01-849f-444d-a131-9695ac0cb2f2 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:26.077678 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ef9f01-849f-444d-a131-9695ac0cb2f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:26.098974 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-09ef9f01-849f-444d-a131-9695ac0cb2f2 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:26.100172 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-09ef9f01-849f-444d-a131-9695ac0cb2f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:26.187505 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 176/336] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:23:26 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:23:26.231514 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42f9579-0b4e-48c6-a598-b86f808aa83b None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:26.259826 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961fe667-0329-4d10-9c47-069359a67392 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:26.260149 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961fe667-0329-4d10-9c47-069359a67392 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:26.260385 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961fe667-0329-4d10-9c47-069359a67392 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:26.262035 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 177/337] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:23:26 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 14 15:23:26.281183 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5646745b-b275-414e-a293-0776ef65c466 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:26.281662 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5646745b-b275-414e-a293-0776ef65c466 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:26.282065 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5646745b-b275-414e-a293-0776ef65c466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:26.310018 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-5646745b-b275-414e-a293-0776ef65c466 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:26.310018 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-5646745b-b275-414e-a293-0776ef65c466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:26.433502 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:26.438655 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42f9579-0b4e-48c6-a598-b86f808aa83b None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:26.467751 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 178/338] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:23:26 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:23:26.518927 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221a8079-9549-48b0-b3b1-3dd7ae2dffb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:26.519842 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221a8079-9549-48b0-b3b1-3dd7ae2dffb2 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:26.520119 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221a8079-9549-48b0-b3b1-3dd7ae2dffb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:26.520427 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221a8079-9549-48b0-b3b1-3dd7ae2dffb2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:26.529234 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5646745b-b275-414e-a293-0776ef65c466 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:26.533101 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221a8079-9549-48b0-b3b1-3dd7ae2dffb2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:23:26.541783 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-221a8079-9549-48b0-b3b1-3dd7ae2dffb2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 15:23:26.541783 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:26.541783 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:26.541783 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:26.541783 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:26.541783 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:26.541783 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:26.541783 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:26.541783 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:26.541783 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:26.541783 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:26.541783 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:26.541783 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:23:26.541783 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:23:26.541783 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:23:26.541783 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:23:26.542742 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:23:26.542742 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:23:26.542742 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:23:26.542742 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:23:26.542742 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:26.542742 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:26.542742 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:26.542742 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:26.542742 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:26.542742 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:26.542742 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:26.542742 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:26.542742 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:26.542742 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:26.542742 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:26.542742 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:26.543557 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:26.543557 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:26.543557 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:26.543557 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:26.543557 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:23:26.543557 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:23:26.543557 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:23:26.543557 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:23:26.543557 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:23:26.543557 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:23:26.543557 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 15:23:26.543557 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:23:26.549383 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 161/339] 10.222.0.118 () {56 vars in 1104 bytes} [Thu Jul 14 15:23:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:26.551442 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221a8079-9549-48b0-b3b1-3dd7ae2dffb2 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:26.579123 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:26.735097 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5646745b-b275-414e-a293-0776ef65c466 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:26.779241 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221a8079-9549-48b0-b3b1-3dd7ae2dffb2 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:26.798662 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdbf619-f63f-4255-820c-4d9ea2a1ca5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:26.799490 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdbf619-f63f-4255-820c-4d9ea2a1ca5b None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:26.799771 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdbf619-f63f-4255-820c-4d9ea2a1ca5b None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:26.800040 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdbf619-f63f-4255-820c-4d9ea2a1ca5b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:26.822924 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdbf619-f63f-4255-820c-4d9ea2a1ca5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:23:26.835135 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-0fdbf619-f63f-4255-820c-4d9ea2a1ca5b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 15:23:26.835135 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:26.835135 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:26.835135 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:26.835135 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:26.835135 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:26.835135 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:26.835135 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:26.835135 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:26.835135 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:26.835135 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:26.835135 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:26.835135 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:23:26.835135 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:23:26.835135 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:23:26.835135 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:23:26.836067 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:23:26.836067 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:23:26.836067 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:23:26.836067 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:23:26.836067 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:26.836067 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:26.836067 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:26.836067 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:26.836067 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:26.836067 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:26.836067 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:26.836067 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:26.836067 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:26.836067 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:26.836067 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:26.836067 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:26.836830 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:26.836830 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:26.836830 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:26.836830 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:26.836830 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:23:26.836830 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:23:26.836830 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:23:26.836830 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:23:26.836830 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:23:26.836830 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:23:26.836830 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 15:23:26.836830 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:23:26.836830 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 179/340] 10.222.0.118 () {56 vars in 1119 bytes} [Thu Jul 14 15:23:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:26.839026 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d21c38-f849-4340-b19d-b7e3ce312d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:26.839152 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d21c38-f849-4340-b19d-b7e3ce312d20 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:26.839326 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d21c38-f849-4340-b19d-b7e3ce312d20 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:26.839617 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d21c38-f849-4340-b19d-b7e3ce312d20 None admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:26.840362 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d21c38-f849-4340-b19d-b7e3ce312d20 None admin] RBAC: Adding query filter params (name=member) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:26.840669 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d21c38-f849-4340-b19d-b7e3ce312d20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:26.842895 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdbf619-f63f-4255-820c-4d9ea2a1ca5b None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:26.846457 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d21c38-f849-4340-b19d-b7e3ce312d20 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:26.860273 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 162/341] 10.222.0.118 () {56 vars in 1106 bytes} [Thu Jul 14 15:23:26 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:23:26.866639 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d21c38-f849-4340-b19d-b7e3ce312d20 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:26.918889 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:26.982469 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:26.991828 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdbf619-f63f-4255-820c-4d9ea2a1ca5b None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:27.019309 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d21c38-f849-4340-b19d-b7e3ce312d20 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:27.037543 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3de83ac-7ed1-4000-b23f-3ed6b82e984b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:27.038330 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3de83ac-7ed1-4000-b23f-3ed6b82e984b None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:27.038616 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3de83ac-7ed1-4000-b23f-3ed6b82e984b None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:27.038897 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3de83ac-7ed1-4000-b23f-3ed6b82e984b None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:27.039665 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3de83ac-7ed1-4000-b23f-3ed6b82e984b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:27.039974 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3de83ac-7ed1-4000-b23f-3ed6b82e984b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:27.041362 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3de83ac-7ed1-4000-b23f-3ed6b82e984b None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:27.061363 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 180/342] 10.222.0.118 () {56 vars in 1116 bytes} [Thu Jul 14 15:23:26 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:23:27.062738 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50c5dfb-9920-428d-8f42-85b5b9cff6f5 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:27.063023 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50c5dfb-9920-428d-8f42-85b5b9cff6f5 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:27.063324 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50c5dfb-9920-428d-8f42-85b5b9cff6f5 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:27.064904 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 181/343] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:23:27 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:23:27.077115 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcd1478-59ff-4952-8fd3-3398dc751e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:27.077612 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50c5dfb-9920-428d-8f42-85b5b9cff6f5 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:27.077947 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcd1478-59ff-4952-8fd3-3398dc751e5c None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:27.078198 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcd1478-59ff-4952-8fd3-3398dc751e5c None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:27.078375 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcd1478-59ff-4952-8fd3-3398dc751e5c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:27.149672 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcd1478-59ff-4952-8fd3-3398dc751e5c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:27.151242 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcd1478-59ff-4952-8fd3-3398dc751e5c None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:27.275900 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50c5dfb-9920-428d-8f42-85b5b9cff6f5 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:27.293300 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:27.320930 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:27.355629 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8511d9-b16e-49f9-8337-39d00715297c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:27.356280 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8511d9-b16e-49f9-8337-39d00715297c None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:27.356555 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8511d9-b16e-49f9-8337-39d00715297c None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:27.356823 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8511d9-b16e-49f9-8337-39d00715297c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:27.396894 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 163/344] 10.222.0.118 () {58 vars in 1287 bytes} [Thu Jul 14 15:23:26 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 15:23:27.402253 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784148fc-f6b5-43a0-a28a-4a3a3713df63 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:27.402780 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784148fc-f6b5-43a0-a28a-4a3a3713df63 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:27.403258 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784148fc-f6b5-43a0-a28a-4a3a3713df63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:27.439564 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-784148fc-f6b5-43a0-a28a-4a3a3713df63 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:27.441209 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-784148fc-f6b5-43a0-a28a-4a3a3713df63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:27.451654 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8511d9-b16e-49f9-8337-39d00715297c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:27.453122 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8511d9-b16e-49f9-8337-39d00715297c None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:27.572755 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 164/345] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:23:27 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:23:27.575007 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784148fc-f6b5-43a0-a28a-4a3a3713df63 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:27.619859 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 182/346] 10.222.0.118 () {58 vars in 1287 bytes} [Thu Jul 14 15:23:27 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 543 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 15:23:27.622490 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e00f66-799e-46e1-b465-16304df03487 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:27.622992 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e00f66-799e-46e1-b465-16304df03487 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:27.623468 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e00f66-799e-46e1-b465-16304df03487 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:27.625237 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 183/347] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:23:27 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:23:27.631050 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e00f66-799e-46e1-b465-16304df03487 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:27.645028 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:27.727531 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784148fc-f6b5-43a0-a28a-4a3a3713df63 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:27.739682 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:27.771869 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1a5d70-0c4e-4cdc-95c8-2260486d2109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:27.773104 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1a5d70-0c4e-4cdc-95c8-2260486d2109 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:27.773617 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1a5d70-0c4e-4cdc-95c8-2260486d2109 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:27.774124 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1a5d70-0c4e-4cdc-95c8-2260486d2109 None admin] PATH_INFO: `/v3/projects/a99d762a7cad4fc1ac87113f5b01b5b2` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:27.776893 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1a5d70-0c4e-4cdc-95c8-2260486d2109 None admin] RBAC: Authorizing `identity:get_project(project_id=a99d762a7cad4fc1ac87113f5b01b5b2)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:27.778901 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1a5d70-0c4e-4cdc-95c8-2260486d2109 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:27.779887 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 165/348] 10.222.0.118 () {56 vars in 1191 bytes} [Thu Jul 14 15:23:27 2022] GET /identity/v3/projects/a99d762a7cad4fc1ac87113f5b01b5b2 => generated 299 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:27.785561 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1a5d70-0c4e-4cdc-95c8-2260486d2109 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:27.786530 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e00f66-799e-46e1-b465-16304df03487 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:27.823329 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e650f4e-6892-4b74-8232-70cfbef03e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:27.824054 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e650f4e-6892-4b74-8232-70cfbef03e54 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:27.824334 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e650f4e-6892-4b74-8232-70cfbef03e54 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:27.824610 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e650f4e-6892-4b74-8232-70cfbef03e54 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:27.840411 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e650f4e-6892-4b74-8232-70cfbef03e54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:23:27.849286 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-5e650f4e-6892-4b74-8232-70cfbef03e54 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 15:23:27.849286 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:27.849286 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:27.849286 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:27.849286 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:27.849286 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:27.849286 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:27.849286 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:27.849286 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:27.849286 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:27.849286 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:27.849286 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:27.849286 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:23:27.849286 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:23:27.849286 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:23:27.849286 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:23:27.850320 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:23:27.850320 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:23:27.850320 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:23:27.850320 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:23:27.850320 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:27.850320 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:27.850320 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:27.850320 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:27.850320 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:27.850320 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:27.850320 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:27.850320 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:27.850320 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:27.850320 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:27.850320 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:27.850320 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:27.851131 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:27.851131 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:27.851131 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:27.851131 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:27.851131 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:23:27.851131 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:23:27.851131 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:23:27.851131 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:23:27.851131 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:23:27.851131 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:23:27.851131 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 15:23:27.851131 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:23:27.851131 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 184/349] 10.222.0.118 () {56 vars in 1104 bytes} [Thu Jul 14 15:23:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:27.851854 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0cc832-d516-49e6-acd3-66684289dea9 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:27.852289 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0cc832-d516-49e6-acd3-66684289dea9 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:27.852710 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0cc832-d516-49e6-acd3-66684289dea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:27.872543 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-3b0cc832-d516-49e6-acd3-66684289dea9 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:27.874300 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-3b0cc832-d516-49e6-acd3-66684289dea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:27.919086 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1a5d70-0c4e-4cdc-95c8-2260486d2109 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:27.958421 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:27.965116 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 185/350] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:23:27 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:23:27.966952 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c61b3c8-9bcd-4e32-9cc4-f70dcf76206c None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:27.967446 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c61b3c8-9bcd-4e32-9cc4-f70dcf76206c None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:27.967936 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c61b3c8-9bcd-4e32-9cc4-f70dcf76206c None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:27.969494 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 186/351] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:23:27 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:23:27.970411 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c61b3c8-9bcd-4e32-9cc4-f70dcf76206c None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:27.975529 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d2e8ca-9ab3-4824-9c99-aa1013b852f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:27.976394 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d2e8ca-9ab3-4824-9c99-aa1013b852f7 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:27.976667 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d2e8ca-9ab3-4824-9c99-aa1013b852f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:27.976933 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d2e8ca-9ab3-4824-9c99-aa1013b852f7 None admin] PATH_INFO: `/v3/projects/a99d762a7cad4fc1ac87113f5b01b5b2` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:27.978168 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d2e8ca-9ab3-4824-9c99-aa1013b852f7 None admin] RBAC: Authorizing `identity:get_project(project_id=a99d762a7cad4fc1ac87113f5b01b5b2)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:27.979615 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d2e8ca-9ab3-4824-9c99-aa1013b852f7 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:27.986122 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 166/352] 10.222.0.118 () {56 vars in 1191 bytes} [Thu Jul 14 15:23:27 2022] GET /identity/v3/projects/a99d762a7cad4fc1ac87113f5b01b5b2 => generated 299 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:27.987017 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d2e8ca-9ab3-4824-9c99-aa1013b852f7 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:28.042871 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:28.109134 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c61b3c8-9bcd-4e32-9cc4-f70dcf76206c None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:28.126953 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d2e8ca-9ab3-4824-9c99-aa1013b852f7 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:28.156666 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f0a3d3-2c56-4820-a504-2c8b9eec1291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:28.157524 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f0a3d3-2c56-4820-a504-2c8b9eec1291 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:28.157799 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f0a3d3-2c56-4820-a504-2c8b9eec1291 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:28.158104 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f0a3d3-2c56-4820-a504-2c8b9eec1291 None admin] PATH_INFO: `/v3/groups/ed444eb022114f4baa24a7f20c25306f` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:28.166495 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f0a3d3-2c56-4820-a504-2c8b9eec1291 None admin] RBAC: Authorizing `identity:get_group(group_id=ed444eb022114f4baa24a7f20c25306f)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:28.168125 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f0a3d3-2c56-4820-a504-2c8b9eec1291 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:28.170039 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 187/353] 10.222.0.118 () {56 vars in 1185 bytes} [Thu Jul 14 15:23:27 2022] GET /identity/v3/groups/ed444eb022114f4baa24a7f20c25306f => generated 227 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:28.171324 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acade5e3-4417-4e2d-9acb-38c078d5ffc0 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:28.171608 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acade5e3-4417-4e2d-9acb-38c078d5ffc0 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:28.171881 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acade5e3-4417-4e2d-9acb-38c078d5ffc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:28.176268 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ce4155-12cf-4315-8e3b-ec3ce2f71ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:28.176949 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ce4155-12cf-4315-8e3b-ec3ce2f71ea8 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:28.177226 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ce4155-12cf-4315-8e3b-ec3ce2f71ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:28.177853 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ce4155-12cf-4315-8e3b-ec3ce2f71ea8 None admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:28.179770 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ce4155-12cf-4315-8e3b-ec3ce2f71ea8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:28.180080 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ce4155-12cf-4315-8e3b-ec3ce2f71ea8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:28.181482 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ce4155-12cf-4315-8e3b-ec3ce2f71ea8 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:28.192680 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-acade5e3-4417-4e2d-9acb-38c078d5ffc0 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:28.193217 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 167/354] 10.222.0.118 () {56 vars in 1106 bytes} [Thu Jul 14 15:23:27 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:28.196701 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ce4155-12cf-4315-8e3b-ec3ce2f71ea8 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:28.198288 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-acade5e3-4417-4e2d-9acb-38c078d5ffc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:28.271460 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:28.288957 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 188/355] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:23:28 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:23:28.288957 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acade5e3-4417-4e2d-9acb-38c078d5ffc0 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:28.338674 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ce4155-12cf-4315-8e3b-ec3ce2f71ea8 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:28.341269 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:28.385937 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309ac47b-fe68-4d04-a917-ba20cfa852c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:28.387443 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ac47b-fe68-4d04-a917-ba20cfa852c2 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:28.387443 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ac47b-fe68-4d04-a917-ba20cfa852c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:28.387605 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ac47b-fe68-4d04-a917-ba20cfa852c2 None admin] PATH_INFO: `/v3/groups/ed444eb022114f4baa24a7f20c25306f` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:28.388701 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309ac47b-fe68-4d04-a917-ba20cfa852c2 None admin] RBAC: Authorizing `identity:get_group(group_id=ed444eb022114f4baa24a7f20c25306f)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:28.390212 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309ac47b-fe68-4d04-a917-ba20cfa852c2 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:28.392086 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 168/356] 10.222.0.118 () {56 vars in 1185 bytes} [Thu Jul 14 15:23:28 2022] GET /identity/v3/groups/ed444eb022114f4baa24a7f20c25306f => generated 227 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:28.393729 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309ac47b-fe68-4d04-a917-ba20cfa852c2 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:28.410023 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acade5e3-4417-4e2d-9acb-38c078d5ffc0 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:28.447403 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c11224-33bc-4ad1-be84-29a6dc85fc71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:28.448202 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c11224-33bc-4ad1-be84-29a6dc85fc71 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:28.448486 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c11224-33bc-4ad1-be84-29a6dc85fc71 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:28.448760 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c11224-33bc-4ad1-be84-29a6dc85fc71 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:28.459433 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c11224-33bc-4ad1-be84-29a6dc85fc71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:23:28.467190 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-24c11224-33bc-4ad1-be84-29a6dc85fc71 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 15:23:28.467190 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:28.467190 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:28.467190 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:28.467190 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:28.467190 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:28.467190 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:28.467190 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:28.467190 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:28.467190 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:28.467190 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:28.467190 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:28.467190 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:23:28.467190 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:23:28.467190 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:23:28.467190 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:23:28.468051 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:23:28.468051 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:23:28.468051 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:23:28.468051 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:23:28.468051 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:28.468051 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:28.468051 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:28.468051 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:28.468051 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:28.468051 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:28.468051 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:28.468051 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:28.468051 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:28.468051 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:28.468051 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:28.468051 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:28.469217 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:28.469217 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:28.469217 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:28.469217 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:28.469217 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:23:28.469217 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:23:28.469217 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:23:28.469217 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:23:28.469217 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:23:28.469217 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:23:28.469217 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 15:23:28.469217 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:23:28.469217 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 189/357] 10.222.0.118 () {56 vars in 1104 bytes} [Thu Jul 14 15:23:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:28.469217 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c11224-33bc-4ad1-be84-29a6dc85fc71 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:28.521645 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309ac47b-fe68-4d04-a917-ba20cfa852c2 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:28.530233 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:28.565312 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bd5d7d-2fcd-4207-97ed-a06cd60dc58b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:28.566216 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bd5d7d-2fcd-4207-97ed-a06cd60dc58b None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:28.566944 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bd5d7d-2fcd-4207-97ed-a06cd60dc58b None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:28.567242 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bd5d7d-2fcd-4207-97ed-a06cd60dc58b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:28.568166 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bd5d7d-2fcd-4207-97ed-a06cd60dc58b None admin] RBAC: Adding query filter params (group.id=ed444eb022114f4baa24a7f20c25306f, role.id=4abcf5e5e7cd4b53ae1828fec6550d53, scope.project.id=a99d762a7cad4fc1ac87113f5b01b5b2) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:28.568399 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bd5d7d-2fcd-4207-97ed-a06cd60dc58b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:28.569845 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bd5d7d-2fcd-4207-97ed-a06cd60dc58b None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:28.575898 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 169/358] 10.222.0.118 () {56 vars in 1381 bytes} [Thu Jul 14 15:23:28 2022] GET /identity/v3/role_assignments?group.id=ed444eb022114f4baa24a7f20c25306f&scope.project.id=a99d762a7cad4fc1ac87113f5b01b5b2&role.id=4abcf5e5e7cd4b53ae1828fec6550d53 => generated 261 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:28.576707 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bd5d7d-2fcd-4207-97ed-a06cd60dc58b None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:28.587920 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c11224-33bc-4ad1-be84-29a6dc85fc71 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:28.629299 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:28.638711 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9612eb8-fd7c-4736-b6b1-b82e6ca73fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:28.639300 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9612eb8-fd7c-4736-b6b1-b82e6ca73fca None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:28.639586 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9612eb8-fd7c-4736-b6b1-b82e6ca73fca None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:28.639865 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9612eb8-fd7c-4736-b6b1-b82e6ca73fca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:28.720781 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bd5d7d-2fcd-4207-97ed-a06cd60dc58b None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:28.739832 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9612eb8-fd7c-4736-b6b1-b82e6ca73fca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:28.741191 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9612eb8-fd7c-4736-b6b1-b82e6ca73fca None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:28.770821 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad69434e-f112-4680-b762-e978e0b3afa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:28.772538 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad69434e-f112-4680-b762-e978e0b3afa2 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:28.773026 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad69434e-f112-4680-b762-e978e0b3afa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:28.773668 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad69434e-f112-4680-b762-e978e0b3afa2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:28.791005 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad69434e-f112-4680-b762-e978e0b3afa2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:23:28.798665 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-ad69434e-f112-4680-b762-e978e0b3afa2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 15:23:28.798665 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:28.798665 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:28.798665 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:28.798665 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:28.798665 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:28.798665 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:28.798665 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:28.798665 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:28.798665 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:28.798665 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:28.798665 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:28.798665 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:23:28.798665 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:23:28.798665 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:23:28.798665 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:23:28.799816 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:23:28.799816 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:23:28.799816 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:23:28.799816 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:23:28.799816 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:28.799816 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:28.799816 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:28.799816 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:28.799816 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:28.799816 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:28.799816 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:28.799816 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:28.799816 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:28.799816 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:28.799816 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:28.799816 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:28.801276 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:28.801276 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:28.801276 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:28.801276 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:28.801276 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:23:28.801276 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:23:28.801276 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:23:28.801276 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:23:28.801276 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:23:28.801276 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:23:28.801276 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 15:23:28.801276 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:23:28.801276 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 170/359] 10.222.0.118 () {56 vars in 1119 bytes} [Thu Jul 14 15:23:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:28.801948 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eab721-c6fd-42b2-b518-7ae8ac3623b3 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:28.803278 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eab721-c6fd-42b2-b518-7ae8ac3623b3 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:28.803560 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eab721-c6fd-42b2-b518-7ae8ac3623b3 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:28.806025 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 171/360] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:23:28 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:23:28.806025 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eab721-c6fd-42b2-b518-7ae8ac3623b3 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:28.820811 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:28.888489 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 190/361] 10.222.0.118 () {58 vars in 1287 bytes} [Thu Jul 14 15:23:28 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 15:23:28.889406 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9612eb8-fd7c-4736-b6b1-b82e6ca73fca None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:28.930509 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:28.944606 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eab721-c6fd-42b2-b518-7ae8ac3623b3 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:28.993105 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dadc604-dd52-4510-83c1-16aecc5d5a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:28.994549 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dadc604-dd52-4510-83c1-16aecc5d5a8e None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:28.994979 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dadc604-dd52-4510-83c1-16aecc5d5a8e None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:28.995246 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dadc604-dd52-4510-83c1-16aecc5d5a8e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:28.996124 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dadc604-dd52-4510-83c1-16aecc5d5a8e None admin] RBAC: Adding query filter params (group.id=ed444eb022114f4baa24a7f20c25306f, role.id=f4e85c621e6d4e749149099dd9303934, scope.project.id=a99d762a7cad4fc1ac87113f5b01b5b2) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:28.996394 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dadc604-dd52-4510-83c1-16aecc5d5a8e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:28.997874 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dadc604-dd52-4510-83c1-16aecc5d5a8e None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:29.003785 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 172/362] 10.222.0.118 () {56 vars in 1381 bytes} [Thu Jul 14 15:23:28 2022] GET /identity/v3/role_assignments?group.id=ed444eb022114f4baa24a7f20c25306f&scope.project.id=a99d762a7cad4fc1ac87113f5b01b5b2&role.id=f4e85c621e6d4e749149099dd9303934 => generated 261 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:29.004596 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dadc604-dd52-4510-83c1-16aecc5d5a8e None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:29.027388 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9612eb8-fd7c-4736-b6b1-b82e6ca73fca None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:29.082354 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307eb940-4b1e-4883-b2d4-4b13be88df8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:29.083740 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307eb940-4b1e-4883-b2d4-4b13be88df8b None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:29.084304 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307eb940-4b1e-4883-b2d4-4b13be88df8b None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:29.084596 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307eb940-4b1e-4883-b2d4-4b13be88df8b None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:29.085502 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307eb940-4b1e-4883-b2d4-4b13be88df8b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:29.086107 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307eb940-4b1e-4883-b2d4-4b13be88df8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:29.088350 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307eb940-4b1e-4883-b2d4-4b13be88df8b None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:29.102623 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 191/363] 10.222.0.118 () {56 vars in 1106 bytes} [Thu Jul 14 15:23:28 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:29.105029 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb66fda0-d28b-43cc-aeb7-5f62950fbc9c None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:29.105318 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb66fda0-d28b-43cc-aeb7-5f62950fbc9c None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:29.105595 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb66fda0-d28b-43cc-aeb7-5f62950fbc9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:29.130111 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-cb66fda0-d28b-43cc-aeb7-5f62950fbc9c None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:29.131644 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-cb66fda0-d28b-43cc-aeb7-5f62950fbc9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:29.146403 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:29.149837 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dadc604-dd52-4510-83c1-16aecc5d5a8e None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:29.198347 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16c4807-e2e4-4178-9968-0a4a7274c95b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:29.199328 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16c4807-e2e4-4178-9968-0a4a7274c95b None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:29.199610 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16c4807-e2e4-4178-9968-0a4a7274c95b None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:29.200379 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16c4807-e2e4-4178-9968-0a4a7274c95b None admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:29.201244 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16c4807-e2e4-4178-9968-0a4a7274c95b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:29.201555 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16c4807-e2e4-4178-9968-0a4a7274c95b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:29.203099 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16c4807-e2e4-4178-9968-0a4a7274c95b None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:29.217897 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 173/364] 10.222.0.118 () {56 vars in 1116 bytes} [Thu Jul 14 15:23:29 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:29.217897 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16c4807-e2e4-4178-9968-0a4a7274c95b None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:29.231679 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 192/365] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:23:29 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:23:29.232682 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb66fda0-d28b-43cc-aeb7-5f62950fbc9c None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:29.257316 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:29.353793 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb66fda0-d28b-43cc-aeb7-5f62950fbc9c None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:29.354466 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16c4807-e2e4-4178-9968-0a4a7274c95b None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:29.396062 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c43dac-c7f0-4bb4-a282-48b6e01791d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:29.397323 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c43dac-c7f0-4bb4-a282-48b6e01791d1 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:29.397782 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c43dac-c7f0-4bb4-a282-48b6e01791d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:29.398254 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c43dac-c7f0-4bb4-a282-48b6e01791d1 None admin] PATH_INFO: `/v3/users/8be3e2c75b3e488fb5b5cd3c4ec3d266` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:29.399668 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c43dac-c7f0-4bb4-a282-48b6e01791d1 None admin] RBAC: Authorizing `identity:get_user(user_id=8be3e2c75b3e488fb5b5cd3c4ec3d266)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:29.401352 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c43dac-c7f0-4bb4-a282-48b6e01791d1 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:29.403579 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 193/366] 10.222.0.118 () {56 vars in 1182 bytes} [Thu Jul 14 15:23:29 2022] GET /identity/v3/users/8be3e2c75b3e488fb5b5cd3c4ec3d266 => generated 294 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:29.403738 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e55bac-1474-44f5-965b-235f66700f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:29.404683 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c43dac-c7f0-4bb4-a282-48b6e01791d1 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:29.404811 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e55bac-1474-44f5-965b-235f66700f24 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:29.405049 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e55bac-1474-44f5-965b-235f66700f24 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:29.405421 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e55bac-1474-44f5-965b-235f66700f24 None admin] PATH_INFO: `/v3/projects/9d45367dfdd34d7ab5e0b055eda4e88e` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:29.410014 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e55bac-1474-44f5-965b-235f66700f24 None admin] RBAC: Authorizing `identity:get_project(project_id=9d45367dfdd34d7ab5e0b055eda4e88e)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:29.411584 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e55bac-1474-44f5-965b-235f66700f24 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:29.414385 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 174/367] 10.222.0.118 () {56 vars in 1191 bytes} [Thu Jul 14 15:23:29 2022] GET /identity/v3/projects/9d45367dfdd34d7ab5e0b055eda4e88e => generated 303 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:29.414513 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e55bac-1474-44f5-965b-235f66700f24 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:29.432106 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:29.549406 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:29.555048 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e55bac-1474-44f5-965b-235f66700f24 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:29.567432 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c43dac-c7f0-4bb4-a282-48b6e01791d1 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:29.615305 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8580af6-4e92-409e-8d4c-829ce0ac59ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:29.616479 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8580af6-4e92-409e-8d4c-829ce0ac59ba None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:29.616843 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8580af6-4e92-409e-8d4c-829ce0ac59ba None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:29.617214 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8580af6-4e92-409e-8d4c-829ce0ac59ba None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:29.621424 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5665c5a4-4018-40cd-9604-67388b64d041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:29.622111 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5665c5a4-4018-40cd-9604-67388b64d041 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:29.622397 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5665c5a4-4018-40cd-9604-67388b64d041 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:29.622672 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5665c5a4-4018-40cd-9604-67388b64d041 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:29.630156 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8580af6-4e92-409e-8d4c-829ce0ac59ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:23:29.640133 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-e8580af6-4e92-409e-8d4c-829ce0ac59ba None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:23:29.640133 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:29.640133 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:29.640133 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:29.640133 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:29.640133 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:29.640133 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:29.640133 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:29.640133 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:29.640133 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:29.640133 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:29.640133 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:29.640133 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:23:29.640133 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:23:29.640133 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:23:29.640133 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:23:29.641047 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:23:29.641047 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:23:29.641047 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:23:29.641047 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:23:29.641047 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:29.641047 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:29.641047 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:29.641047 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:29.641047 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:29.641047 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:29.641047 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:29.641047 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:29.641047 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:29.641047 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:29.641047 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:29.641047 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:29.641824 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:29.641824 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:29.641824 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:29.641824 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:29.641824 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:23:29.641824 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:23:29.641824 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:23:29.641824 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:23:29.641824 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:23:29.641824 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:23:29.641824 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:23:29.641824 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:23:29.642450 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 175/368] 10.222.0.118 () {56 vars in 1101 bytes} [Thu Jul 14 15:23:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:29.644068 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8580af6-4e92-409e-8d4c-829ce0ac59ba None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:29.720733 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5665c5a4-4018-40cd-9604-67388b64d041 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:29.722229 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5665c5a4-4018-40cd-9604-67388b64d041 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:29.737563 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:29.777975 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8580af6-4e92-409e-8d4c-829ce0ac59ba None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:29.815888 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e21512-a8de-4976-b3be-440ca344fbdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:29.816807 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e21512-a8de-4976-b3be-440ca344fbdc None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:29.817089 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e21512-a8de-4976-b3be-440ca344fbdc None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:29.817362 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e21512-a8de-4976-b3be-440ca344fbdc None admin] PATH_INFO: `/v3/groups/ed444eb022114f4baa24a7f20c25306f` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:29.820721 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e21512-a8de-4976-b3be-440ca344fbdc None admin] RBAC: Authorizing `identity:get_group(group_id=ed444eb022114f4baa24a7f20c25306f)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:29.822248 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e21512-a8de-4976-b3be-440ca344fbdc None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:29.824349 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 176/369] 10.222.0.118 () {56 vars in 1185 bytes} [Thu Jul 14 15:23:29 2022] GET /identity/v3/groups/ed444eb022114f4baa24a7f20c25306f => generated 227 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:29.825320 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e21512-a8de-4976-b3be-440ca344fbdc None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:29.833449 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 194/370] 10.222.0.118 () {58 vars in 1287 bytes} [Thu Jul 14 15:23:29 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 15:23:29.834387 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5665c5a4-4018-40cd-9604-67388b64d041 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:29.861078 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:29.955088 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e21512-a8de-4976-b3be-440ca344fbdc None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:29.967682 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5665c5a4-4018-40cd-9604-67388b64d041 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:29.985780 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:29.995588 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536dcc44-9483-4866-a61d-bf1f9bedbefb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:29.996249 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536dcc44-9483-4866-a61d-bf1f9bedbefb None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:29.996528 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536dcc44-9483-4866-a61d-bf1f9bedbefb None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:29.996802 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536dcc44-9483-4866-a61d-bf1f9bedbefb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:29.997636 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536dcc44-9483-4866-a61d-bf1f9bedbefb None admin] RBAC: Adding query filter params (role.id=63af4c63b0c343909af17164f6e26a71, user.id=8be3e2c75b3e488fb5b5cd3c4ec3d266, scope.system=all) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:29.997947 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536dcc44-9483-4866-a61d-bf1f9bedbefb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:30.001214 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536dcc44-9483-4866-a61d-bf1f9bedbefb None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:30.013729 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca029e3-1079-4d55-b8c8-2efeb5d7c0fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:30.014716 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca029e3-1079-4d55-b8c8-2efeb5d7c0fd None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:30.014999 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca029e3-1079-4d55-b8c8-2efeb5d7c0fd None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:30.015277 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca029e3-1079-4d55-b8c8-2efeb5d7c0fd None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:30.016034 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca029e3-1079-4d55-b8c8-2efeb5d7c0fd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:30.016348 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca029e3-1079-4d55-b8c8-2efeb5d7c0fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:30.016660 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 177/371] 10.222.0.118 () {56 vars in 1313 bytes} [Thu Jul 14 15:23:29 2022] GET /identity/v3/role_assignments?user.id=8be3e2c75b3e488fb5b5cd3c4ec3d266&scope.system=all&role.id=63af4c63b0c343909af17164f6e26a71 => generated 512 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:30.017489 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536dcc44-9483-4866-a61d-bf1f9bedbefb None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:30.017742 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca029e3-1079-4d55-b8c8-2efeb5d7c0fd None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:30.031225 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 195/372] 10.222.0.118 () {56 vars in 1104 bytes} [Thu Jul 14 15:23:29 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:30.032093 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca029e3-1079-4d55-b8c8-2efeb5d7c0fd None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:30.195111 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:30.202484 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca029e3-1079-4d55-b8c8-2efeb5d7c0fd None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:30.238960 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536dcc44-9483-4866-a61d-bf1f9bedbefb None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:30.244826 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7256606-31f3-4328-b961-19b2027a4588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:30.246074 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7256606-31f3-4328-b961-19b2027a4588 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:30.246558 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7256606-31f3-4328-b961-19b2027a4588 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:30.247048 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7256606-31f3-4328-b961-19b2027a4588 None admin] PATH_INFO: `/v3/projects/9d45367dfdd34d7ab5e0b055eda4e88e` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:30.248645 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7256606-31f3-4328-b961-19b2027a4588 None admin] RBAC: Authorizing `identity:get_project(project_id=9d45367dfdd34d7ab5e0b055eda4e88e)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:30.252239 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7256606-31f3-4328-b961-19b2027a4588 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:30.254840 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 196/373] 10.222.0.118 () {56 vars in 1191 bytes} [Thu Jul 14 15:23:30 2022] GET /identity/v3/projects/9d45367dfdd34d7ab5e0b055eda4e88e => generated 303 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:30.256091 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7256606-31f3-4328-b961-19b2027a4588 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:30.283233 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d8f518-bd98-4ce0-aed0-4afbb69b194c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:30.283233 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d8f518-bd98-4ce0-aed0-4afbb69b194c None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:30.283533 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d8f518-bd98-4ce0-aed0-4afbb69b194c None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:30.283600 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d8f518-bd98-4ce0-aed0-4afbb69b194c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:30.284418 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d8f518-bd98-4ce0-aed0-4afbb69b194c None admin] RBAC: Adding query filter params (group.id=ed444eb022114f4baa24a7f20c25306f, role.id=4abcf5e5e7cd4b53ae1828fec6550d53, scope.project.id=9d45367dfdd34d7ab5e0b055eda4e88e) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:30.284766 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d8f518-bd98-4ce0-aed0-4afbb69b194c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:30.286247 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d8f518-bd98-4ce0-aed0-4afbb69b194c None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:30.293646 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 178/374] 10.222.0.118 () {56 vars in 1381 bytes} [Thu Jul 14 15:23:30 2022] GET /identity/v3/role_assignments?group.id=ed444eb022114f4baa24a7f20c25306f&scope.project.id=9d45367dfdd34d7ab5e0b055eda4e88e&role.id=4abcf5e5e7cd4b53ae1828fec6550d53 => generated 261 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:30.294506 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d8f518-bd98-4ce0-aed0-4afbb69b194c None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:30.326364 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:30.382197 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7256606-31f3-4328-b961-19b2027a4588 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:30.437853 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96671b90-6f48-4f06-91f0-5ccc5943ddcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:30.438947 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96671b90-6f48-4f06-91f0-5ccc5943ddcd None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:30.439857 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96671b90-6f48-4f06-91f0-5ccc5943ddcd None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:30.440342 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96671b90-6f48-4f06-91f0-5ccc5943ddcd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:30.462133 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d8f518-bd98-4ce0-aed0-4afbb69b194c None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:30.535743 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964c7d73-f368-49fd-9a93-943271631a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:30.536546 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c7d73-f368-49fd-9a93-943271631a2e None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:30.536825 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c7d73-f368-49fd-9a93-943271631a2e None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:30.537099 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c7d73-f368-49fd-9a93-943271631a2e None admin] PATH_INFO: `/v3/groups/ed444eb022114f4baa24a7f20c25306f` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:30.539422 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964c7d73-f368-49fd-9a93-943271631a2e None admin] RBAC: Authorizing `identity:get_group(group_id=ed444eb022114f4baa24a7f20c25306f)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:30.540904 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964c7d73-f368-49fd-9a93-943271631a2e None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:30.542658 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 179/375] 10.222.0.118 () {56 vars in 1185 bytes} [Thu Jul 14 15:23:30 2022] GET /identity/v3/groups/ed444eb022114f4baa24a7f20c25306f => generated 227 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:30.548731 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964c7d73-f368-49fd-9a93-943271631a2e None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:30.567734 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:30.580576 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96671b90-6f48-4f06-91f0-5ccc5943ddcd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:30.582731 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96671b90-6f48-4f06-91f0-5ccc5943ddcd None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:30.637910 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:30.757740 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 197/376] 10.222.0.118 () {58 vars in 1287 bytes} [Thu Jul 14 15:23:30 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 15:23:30.759644 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964c7d73-f368-49fd-9a93-943271631a2e None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:30.764406 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96671b90-6f48-4f06-91f0-5ccc5943ddcd None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:30.815345 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deed7e4-c957-43e3-ae5f-f321621953e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:30.816461 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deed7e4-c957-43e3-ae5f-f321621953e1 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:30.816759 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deed7e4-c957-43e3-ae5f-f321621953e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:30.817037 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deed7e4-c957-43e3-ae5f-f321621953e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:30.817886 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8deed7e4-c957-43e3-ae5f-f321621953e1 None admin] RBAC: Adding query filter params (group.id=ed444eb022114f4baa24a7f20c25306f, role.id=f4e85c621e6d4e749149099dd9303934, scope.project.id=9d45367dfdd34d7ab5e0b055eda4e88e) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:30.818228 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8deed7e4-c957-43e3-ae5f-f321621953e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:30.819679 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8deed7e4-c957-43e3-ae5f-f321621953e1 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:30.826143 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 180/377] 10.222.0.118 () {56 vars in 1381 bytes} [Thu Jul 14 15:23:30 2022] GET /identity/v3/role_assignments?group.id=ed444eb022114f4baa24a7f20c25306f&scope.project.id=9d45367dfdd34d7ab5e0b055eda4e88e&role.id=f4e85c621e6d4e749149099dd9303934 => generated 261 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:23:30.922470 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96671b90-6f48-4f06-91f0-5ccc5943ddcd None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:30.971359 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b80cd71-cc37-4497-a287-65794f8a46fe None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:30.971669 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b80cd71-cc37-4497-a287-65794f8a46fe None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:30.971984 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b80cd71-cc37-4497-a287-65794f8a46fe None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:30.973615 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 181/378] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:23:30 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:23:30.976763 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edec0e4-e798-4f1e-99c6-053658138be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:30.978159 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edec0e4-e798-4f1e-99c6-053658138be0 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:30.978650 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edec0e4-e798-4f1e-99c6-053658138be0 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:30.979139 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edec0e4-e798-4f1e-99c6-053658138be0 None admin] PATH_INFO: `/v3/projects/e864e571207e4b019bbf56cc1f0bce35` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:30.979308 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fe1fab-978c-4461-a140-ba343ff9852d None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:30.979577 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fe1fab-978c-4461-a140-ba343ff9852d None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:30.979856 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fe1fab-978c-4461-a140-ba343ff9852d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:30.984124 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edec0e4-e798-4f1e-99c6-053658138be0 None admin] RBAC: Authorizing `identity:get_project(project_id=e864e571207e4b019bbf56cc1f0bce35)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:30.985622 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edec0e4-e798-4f1e-99c6-053658138be0 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:30.990639 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 198/379] 10.222.0.118 () {56 vars in 1191 bytes} [Thu Jul 14 15:23:30 2022] GET /identity/v3/projects/e864e571207e4b019bbf56cc1f0bce35 => generated 345 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:31.002380 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edec0e4-e798-4f1e-99c6-053658138be0 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:31.017054 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-d3fe1fab-978c-4461-a140-ba343ff9852d None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:31.018329 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-d3fe1fab-978c-4461-a140-ba343ff9852d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:31.028274 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:31.132925 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edec0e4-e798-4f1e-99c6-053658138be0 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:31.170845 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cbc8a1-3b4e-44e2-a858-1d2baaf46d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:31.172064 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cbc8a1-3b4e-44e2-a858-1d2baaf46d72 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:31.172549 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cbc8a1-3b4e-44e2-a858-1d2baaf46d72 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:31.173029 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cbc8a1-3b4e-44e2-a858-1d2baaf46d72 None admin] PATH_INFO: `/v3/groups/05b51acbe4844816865b6e5d5581230e` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:31.183617 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cbc8a1-3b4e-44e2-a858-1d2baaf46d72 None admin] RBAC: Authorizing `identity:get_group(group_id=05b51acbe4844816865b6e5d5581230e)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:31.185540 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cbc8a1-3b4e-44e2-a858-1d2baaf46d72 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:31.187640 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 199/380] 10.222.0.118 () {56 vars in 1185 bytes} [Thu Jul 14 15:23:31 2022] GET /identity/v3/groups/05b51acbe4844816865b6e5d5581230e => generated 230 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:31.194197 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cbc8a1-3b4e-44e2-a858-1d2baaf46d72 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:31.203886 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 182/381] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:23:30 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 15:23:31.243665 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fe1fab-978c-4461-a140-ba343ff9852d None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:31.246728 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:31.294427 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:31.335763 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cbc8a1-3b4e-44e2-a858-1d2baaf46d72 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:31.413936 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a153c59-63ae-4121-baaa-48fe106e66be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:31.414625 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a153c59-63ae-4121-baaa-48fe106e66be None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:31.414909 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a153c59-63ae-4121-baaa-48fe106e66be None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:31.415183 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a153c59-63ae-4121-baaa-48fe106e66be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:31.416023 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a153c59-63ae-4121-baaa-48fe106e66be None admin] RBAC: Adding query filter params (group.id=05b51acbe4844816865b6e5d5581230e, role.id=3b880cef7dcf4baf87b50f8610c0c56e, scope.project.id=e864e571207e4b019bbf56cc1f0bce35) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:31.416337 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a153c59-63ae-4121-baaa-48fe106e66be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:31.420379 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a153c59-63ae-4121-baaa-48fe106e66be None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:31.435664 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 200/382] 10.222.0.118 () {56 vars in 1381 bytes} [Thu Jul 14 15:23:31 2022] GET /identity/v3/role_assignments?group.id=05b51acbe4844816865b6e5d5581230e&scope.project.id=e864e571207e4b019bbf56cc1f0bce35&role.id=3b880cef7dcf4baf87b50f8610c0c56e => generated 261 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:23:31.457338 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fe1fab-978c-4461-a140-ba343ff9852d None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:31.502553 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e628eb9-c6d3-48f1-b4cb-0ac1b18c1e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:31.503365 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e628eb9-c6d3-48f1-b4cb-0ac1b18c1e67 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:31.504218 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e628eb9-c6d3-48f1-b4cb-0ac1b18c1e67 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:31.504494 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e628eb9-c6d3-48f1-b4cb-0ac1b18c1e67 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:31.516803 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e628eb9-c6d3-48f1-b4cb-0ac1b18c1e67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:23:31.525180 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-6e628eb9-c6d3-48f1-b4cb-0ac1b18c1e67 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 15:23:31.525180 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:31.525180 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:31.525180 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:31.525180 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:31.525180 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:31.525180 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:31.525180 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:31.525180 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:31.525180 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:31.525180 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:31.525180 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:31.525180 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:23:31.525180 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:23:31.525180 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:23:31.525180 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:23:31.526193 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:23:31.526193 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:23:31.526193 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:23:31.526193 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:23:31.526193 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:31.526193 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:31.526193 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:31.526193 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:31.526193 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:31.526193 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:31.526193 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:31.526193 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:31.526193 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:31.526193 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:31.526193 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:31.526193 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:31.527454 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:31.527454 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:31.527454 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:31.527454 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:31.527454 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:23:31.527454 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:23:31.527454 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:23:31.527454 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:23:31.527454 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:23:31.527454 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:23:31.527454 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 15:23:31.527454 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:23:31.527454 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 183/383] 10.222.0.118 () {56 vars in 1104 bytes} [Thu Jul 14 15:23:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:23:31.532530 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a153c59-63ae-4121-baaa-48fe106e66be None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:31.661439 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a801658-6fac-4642-b7af-d0918276692b None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:31.661779 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a801658-6fac-4642-b7af-d0918276692b None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:31.663513 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a801658-6fac-4642-b7af-d0918276692b None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:31.664983 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 184/384] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:23:31 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 14 15:23:31.668900 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a153c59-63ae-4121-baaa-48fe106e66be None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:31.671118 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4415cc9-531b-4e7c-bb0a-93cc20a1d96e None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:31.671411 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4415cc9-531b-4e7c-bb0a-93cc20a1d96e None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:31.671693 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4415cc9-531b-4e7c-bb0a-93cc20a1d96e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:31.695987 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-d4415cc9-531b-4e7c-bb0a-93cc20a1d96e None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:31.697202 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-d4415cc9-531b-4e7c-bb0a-93cc20a1d96e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:31.708902 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b9dd9a-fe96-4ad2-b019-5b63aa5effd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:31.709587 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b9dd9a-fe96-4ad2-b019-5b63aa5effd9 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:31.709868 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b9dd9a-fe96-4ad2-b019-5b63aa5effd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:31.710162 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b9dd9a-fe96-4ad2-b019-5b63aa5effd9 None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:31.710939 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b9dd9a-fe96-4ad2-b019-5b63aa5effd9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:31.711249 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b9dd9a-fe96-4ad2-b019-5b63aa5effd9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:31.712653 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b9dd9a-fe96-4ad2-b019-5b63aa5effd9 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:31.722089 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 201/385] 10.222.0.118 () {56 vars in 1106 bytes} [Thu Jul 14 15:23:31 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:31.723272 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:31.730997 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b9dd9a-fe96-4ad2-b019-5b63aa5effd9 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:31.849528 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:31.869083 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 185/386] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:23:31 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:23:31.889648 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4415cc9-531b-4e7c-bb0a-93cc20a1d96e None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:31.909173 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b9dd9a-fe96-4ad2-b019-5b63aa5effd9 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:31.975016 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65ec543-93be-4c50-8a62-f336b40f1961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:31.975783 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65ec543-93be-4c50-8a62-f336b40f1961 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:31.976061 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65ec543-93be-4c50-8a62-f336b40f1961 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:31.976331 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65ec543-93be-4c50-8a62-f336b40f1961 None admin] PATH_INFO: `/v3/groups/ed444eb022114f4baa24a7f20c25306f` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:31.982764 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65ec543-93be-4c50-8a62-f336b40f1961 None admin] RBAC: Authorizing `identity:get_group(group_id=ed444eb022114f4baa24a7f20c25306f)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:31.984329 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65ec543-93be-4c50-8a62-f336b40f1961 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:31.986472 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 202/387] 10.222.0.118 () {56 vars in 1185 bytes} [Thu Jul 14 15:23:31 2022] GET /identity/v3/groups/ed444eb022114f4baa24a7f20c25306f => generated 227 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:23:31.991446 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65ec543-93be-4c50-8a62-f336b40f1961 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:32.009656 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4415cc9-531b-4e7c-bb0a-93cc20a1d96e None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:32.049573 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4199aaea-291c-4241-87da-2438b9588b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:32.050445 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4199aaea-291c-4241-87da-2438b9588b44 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:32.050727 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4199aaea-291c-4241-87da-2438b9588b44 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:32.051428 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4199aaea-291c-4241-87da-2438b9588b44 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:32.062747 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4199aaea-291c-4241-87da-2438b9588b44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:23:32.072213 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-4199aaea-291c-4241-87da-2438b9588b44 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 15:23:32.072213 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:32.072213 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:32.072213 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:32.072213 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:32.072213 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:32.072213 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:32.072213 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:32.072213 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:32.072213 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:32.072213 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:32.072213 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:32.072213 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:23:32.072213 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:23:32.072213 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:23:32.072213 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:23:32.073111 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:23:32.073111 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:23:32.073111 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:23:32.073111 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:23:32.073111 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:32.073111 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:32.073111 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:32.073111 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:32.073111 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:32.073111 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:32.073111 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:32.073111 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:32.073111 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:32.073111 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:32.073111 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:32.073111 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:32.073881 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:32.073881 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:32.073881 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:32.073881 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:32.073881 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:23:32.073881 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:23:32.073881 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:23:32.073881 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:23:32.073881 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:23:32.073881 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:23:32.073881 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 15:23:32.073881 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:23:32.073881 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 186/388] 10.222.0.118 () {56 vars in 1119 bytes} [Thu Jul 14 15:23:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:23:32.080209 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4199aaea-291c-4241-87da-2438b9588b44 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:32.150147 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:32.190728 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65ec543-93be-4c50-8a62-f336b40f1961 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:32.210329 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:32.229534 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09722d8b-157b-4b01-a509-06f13d483344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:32.230352 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09722d8b-157b-4b01-a509-06f13d483344 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:32.230635 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09722d8b-157b-4b01-a509-06f13d483344 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:32.230907 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09722d8b-157b-4b01-a509-06f13d483344 None admin] PATH_INFO: `/v3/projects/a99d762a7cad4fc1ac87113f5b01b5b2` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:32.232668 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09722d8b-157b-4b01-a509-06f13d483344 None admin] RBAC: Authorizing `identity:get_project(project_id=a99d762a7cad4fc1ac87113f5b01b5b2)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:32.234232 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09722d8b-157b-4b01-a509-06f13d483344 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:32.236307 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 203/389] 10.222.0.118 () {56 vars in 1191 bytes} [Thu Jul 14 15:23:31 2022] GET /identity/v3/projects/a99d762a7cad4fc1ac87113f5b01b5b2 => generated 299 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:32.242385 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09722d8b-157b-4b01-a509-06f13d483344 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:32.360472 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09722d8b-157b-4b01-a509-06f13d483344 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:32.363199 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4199aaea-291c-4241-87da-2438b9588b44 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:32.405987 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115fc5ea-b810-4c3e-a563-451db3975cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:32.405987 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115fc5ea-b810-4c3e-a563-451db3975cf5 None admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:32.405987 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115fc5ea-b810-4c3e-a563-451db3975cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:32.405987 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115fc5ea-b810-4c3e-a563-451db3975cf5 None admin] PATH_INFO: `/v3/projects/a99d762a7cad4fc1ac87113f5b01b5b2/groups/ed444eb022114f4baa24a7f20c25306f/roles/4abcf5e5e7cd4b53ae1828fec6550d53` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:32.406413 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115fc5ea-b810-4c3e-a563-451db3975cf5 None admin] RBAC: Authorizing `identity:create_grant(project_id=a99d762a7cad4fc1ac87113f5b01b5b2, group_id=ed444eb022114f4baa24a7f20c25306f, role_id=4abcf5e5e7cd4b53ae1828fec6550d53)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:32.406413 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115fc5ea-b810-4c3e-a563-451db3975cf5 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:32.408851 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:32.430196 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98ca4d4-5eda-46b2-947d-4e1188b6de13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:32.431045 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98ca4d4-5eda-46b2-947d-4e1188b6de13 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:32.431394 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98ca4d4-5eda-46b2-947d-4e1188b6de13 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:32.431735 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98ca4d4-5eda-46b2-947d-4e1188b6de13 None admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:32.432636 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98ca4d4-5eda-46b2-947d-4e1188b6de13 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:32.433038 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98ca4d4-5eda-46b2-947d-4e1188b6de13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:32.433236 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 204/390] 10.222.0.118 () {58 vars in 1447 bytes} [Thu Jul 14 15:23:32 2022] PUT /identity/v3/projects/a99d762a7cad4fc1ac87113f5b01b5b2/groups/ed444eb022114f4baa24a7f20c25306f/roles/4abcf5e5e7cd4b53ae1828fec6550d53 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:23:32.438041 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98ca4d4-5eda-46b2-947d-4e1188b6de13 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:32.445690 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 187/391] 10.222.0.118 () {56 vars in 1116 bytes} [Thu Jul 14 15:23:32 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:32.452345 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115fc5ea-b810-4c3e-a563-451db3975cf5 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:32.604533 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115fc5ea-b810-4c3e-a563-451db3975cf5 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:32.639031 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2118619-a15a-40fc-a74f-ef667ec2edd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:32.640156 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2118619-a15a-40fc-a74f-ef667ec2edd6 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:32.640592 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2118619-a15a-40fc-a74f-ef667ec2edd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:32.641008 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2118619-a15a-40fc-a74f-ef667ec2edd6 None admin] PATH_INFO: `/v3/groups/ed444eb022114f4baa24a7f20c25306f` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:32.642344 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2118619-a15a-40fc-a74f-ef667ec2edd6 None admin] RBAC: Authorizing `identity:get_group(group_id=ed444eb022114f4baa24a7f20c25306f)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:32.643933 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2118619-a15a-40fc-a74f-ef667ec2edd6 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:32.646085 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 205/392] 10.222.0.118 () {56 vars in 1185 bytes} [Thu Jul 14 15:23:32 2022] GET /identity/v3/groups/ed444eb022114f4baa24a7f20c25306f => generated 227 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:32.651858 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98ca4d4-5eda-46b2-947d-4e1188b6de13 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:32.773347 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98ca4d4-5eda-46b2-947d-4e1188b6de13 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:32.788190 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:32.809795 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd5511c-e52b-4fc7-a2d3-5f38eeb61a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:32.810695 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd5511c-e52b-4fc7-a2d3-5f38eeb61a2d None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:32.810971 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd5511c-e52b-4fc7-a2d3-5f38eeb61a2d None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:32.811304 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd5511c-e52b-4fc7-a2d3-5f38eeb61a2d None admin] PATH_INFO: `/v3/projects/a99d762a7cad4fc1ac87113f5b01b5b2` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:32.812637 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd5511c-e52b-4fc7-a2d3-5f38eeb61a2d None admin] RBAC: Authorizing `identity:get_project(project_id=a99d762a7cad4fc1ac87113f5b01b5b2)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:32.814113 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd5511c-e52b-4fc7-a2d3-5f38eeb61a2d None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:32.816174 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 188/393] 10.222.0.118 () {56 vars in 1191 bytes} [Thu Jul 14 15:23:32 2022] GET /identity/v3/projects/a99d762a7cad4fc1ac87113f5b01b5b2 => generated 299 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:32.823025 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2118619-a15a-40fc-a74f-ef667ec2edd6 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:32.931564 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:32.978797 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2118619-a15a-40fc-a74f-ef667ec2edd6 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:32.991408 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79884e36-f23e-4a33-a837-e124fbf3797e None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:32.991739 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79884e36-f23e-4a33-a837-e124fbf3797e None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:32.991944 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79884e36-f23e-4a33-a837-e124fbf3797e None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:32.993380 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 189/394] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:23:32 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:23:33.029264 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567101d1-1fdc-4e3b-aae3-70f486696db4 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:33.029594 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567101d1-1fdc-4e3b-aae3-70f486696db4 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:33.029936 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567101d1-1fdc-4e3b-aae3-70f486696db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:33.030378 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71345557-fd9f-4377-837e-03f125626795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:33.031265 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71345557-fd9f-4377-837e-03f125626795 None admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:33.031538 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71345557-fd9f-4377-837e-03f125626795 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:33.031809 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71345557-fd9f-4377-837e-03f125626795 None admin] PATH_INFO: `/v3/projects/a99d762a7cad4fc1ac87113f5b01b5b2/groups/ed444eb022114f4baa24a7f20c25306f/roles/f4e85c621e6d4e749149099dd9303934` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:33.034415 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71345557-fd9f-4377-837e-03f125626795 None admin] RBAC: Authorizing `identity:create_grant(project_id=a99d762a7cad4fc1ac87113f5b01b5b2, group_id=ed444eb022114f4baa24a7f20c25306f, role_id=f4e85c621e6d4e749149099dd9303934)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:33.036642 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71345557-fd9f-4377-837e-03f125626795 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:33.059809 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 206/395] 10.222.0.118 () {58 vars in 1447 bytes} [Thu Jul 14 15:23:32 2022] PUT /identity/v3/projects/a99d762a7cad4fc1ac87113f5b01b5b2/groups/ed444eb022114f4baa24a7f20c25306f/roles/f4e85c621e6d4e749149099dd9303934 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:23:33.062414 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-567101d1-1fdc-4e3b-aae3-70f486696db4 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:33.063618 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-567101d1-1fdc-4e3b-aae3-70f486696db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:33.141829 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 190/396] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:23:33 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:23:33.165547 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71345557-fd9f-4377-837e-03f125626795 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:33.292803 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71345557-fd9f-4377-837e-03f125626795 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:33.318153 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:33.329981 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495b473f-48c9-4b00-abde-bd60cd4c0f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:33.331000 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495b473f-48c9-4b00-abde-bd60cd4c0f68 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:33.331699 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495b473f-48c9-4b00-abde-bd60cd4c0f68 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:33.331977 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495b473f-48c9-4b00-abde-bd60cd4c0f68 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:33.343907 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495b473f-48c9-4b00-abde-bd60cd4c0f68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:23:33.352794 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-495b473f-48c9-4b00-abde-bd60cd4c0f68 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 15:23:33.352794 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:33.352794 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:33.352794 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:33.352794 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:33.352794 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:33.352794 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:33.352794 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:33.352794 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:33.352794 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:33.352794 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:33.352794 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:33.352794 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:23:33.352794 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:23:33.352794 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:23:33.352794 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:23:33.353737 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:23:33.353737 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:23:33.353737 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:23:33.353737 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:23:33.353737 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:33.353737 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:33.353737 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:33.353737 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:33.353737 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:33.353737 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:33.353737 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:33.353737 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:33.353737 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:33.353737 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:33.353737 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:33.353737 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:33.354992 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:33.354992 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:33.354992 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:33.354992 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:33.354992 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:23:33.354992 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:23:33.354992 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:23:33.354992 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:23:33.354992 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:23:33.354992 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:23:33.354992 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 15:23:33.354992 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:23:33.354992 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 207/397] 10.222.0.118 () {56 vars in 1104 bytes} [Thu Jul 14 15:23:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:33.360431 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567101d1-1fdc-4e3b-aae3-70f486696db4 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:33.466882 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567101d1-1fdc-4e3b-aae3-70f486696db4 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:33.482019 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:33.496448 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f168b4c7-7079-486f-b95f-670a1dc722f4 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:33.496948 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f168b4c7-7079-486f-b95f-670a1dc722f4 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:33.497050 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f168b4c7-7079-486f-b95f-670a1dc722f4 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:33.498742 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 208/398] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:23:33 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:23:33.504449 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4035185-3201-4719-9e39-37e18b934552 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:33.504738 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4035185-3201-4719-9e39-37e18b934552 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:33.505131 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4035185-3201-4719-9e39-37e18b934552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:33.515182 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759a761a-105a-4049-a0e1-ccce90f4539e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:33.516221 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759a761a-105a-4049-a0e1-ccce90f4539e None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:33.516706 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759a761a-105a-4049-a0e1-ccce90f4539e None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:33.517177 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759a761a-105a-4049-a0e1-ccce90f4539e None admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:33.518167 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759a761a-105a-4049-a0e1-ccce90f4539e None admin] RBAC: Adding query filter params (name=member) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:33.518698 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759a761a-105a-4049-a0e1-ccce90f4539e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:33.520847 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759a761a-105a-4049-a0e1-ccce90f4539e None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:33.524532 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-e4035185-3201-4719-9e39-37e18b934552 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:33.525570 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-e4035185-3201-4719-9e39-37e18b934552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:33.541581 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 191/399] 10.222.0.118 () {56 vars in 1106 bytes} [Thu Jul 14 15:23:33 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:33.550127 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759a761a-105a-4049-a0e1-ccce90f4539e None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:33.608657 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 209/400] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:23:33 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:23:33.633826 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4035185-3201-4719-9e39-37e18b934552 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:33.755142 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4035185-3201-4719-9e39-37e18b934552 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:33.764367 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759a761a-105a-4049-a0e1-ccce90f4539e None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:33.774741 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:33.795310 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31f0d2b-7f94-4c20-8b9e-e916ddf070a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:33.796229 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31f0d2b-7f94-4c20-8b9e-e916ddf070a1 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:33.796666 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31f0d2b-7f94-4c20-8b9e-e916ddf070a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:33.796942 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31f0d2b-7f94-4c20-8b9e-e916ddf070a1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:33.808732 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31f0d2b-7f94-4c20-8b9e-e916ddf070a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:23:33.818498 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-f31f0d2b-7f94-4c20-8b9e-e916ddf070a1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 15:23:33.818498 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:33.818498 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:33.818498 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:33.818498 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:33.818498 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:33.818498 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:33.818498 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:33.818498 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:33.818498 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:33.818498 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:33.818498 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:33.818498 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:23:33.818498 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:23:33.818498 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:23:33.818498 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:23:33.819444 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:23:33.819444 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:23:33.819444 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:23:33.819444 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:23:33.819444 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:33.819444 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:33.819444 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:33.819444 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:33.819444 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:33.819444 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:33.819444 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:33.819444 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:33.819444 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:33.819444 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:33.819444 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:33.819444 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:33.820253 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:33.820253 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:33.820253 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:33.820253 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:33.820253 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:23:33.820253 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:23:33.820253 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:23:33.820253 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:23:33.820253 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:23:33.820253 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:23:33.820253 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 15:23:33.820253 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:23:33.820253 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 210/401] 10.222.0.118 () {56 vars in 1119 bytes} [Thu Jul 14 15:23:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:23:33.821360 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc2ed77-6356-49ec-9f7b-9efb425a3f0b None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:33.821461 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc2ed77-6356-49ec-9f7b-9efb425a3f0b None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:33.821696 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc2ed77-6356-49ec-9f7b-9efb425a3f0b None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:33.827178 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 211/402] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:23:33 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:23:33.828291 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc2ed77-6356-49ec-9f7b-9efb425a3f0b None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:33.846058 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fd99f7-1375-4aa1-b7e7-48ce23f046a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:33.847367 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fd99f7-1375-4aa1-b7e7-48ce23f046a5 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:33.847901 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fd99f7-1375-4aa1-b7e7-48ce23f046a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:33.848384 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fd99f7-1375-4aa1-b7e7-48ce23f046a5 None admin] PATH_INFO: `/v3/groups/ed444eb022114f4baa24a7f20c25306f` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:33.849780 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fd99f7-1375-4aa1-b7e7-48ce23f046a5 None admin] RBAC: Authorizing `identity:get_group(group_id=ed444eb022114f4baa24a7f20c25306f)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:33.851648 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fd99f7-1375-4aa1-b7e7-48ce23f046a5 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:33.853921 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 192/403] 10.222.0.118 () {56 vars in 1185 bytes} [Thu Jul 14 15:23:33 2022] GET /identity/v3/groups/ed444eb022114f4baa24a7f20c25306f => generated 227 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:23:33.855317 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01991ed5-5589-47bd-afbe-9a99a5bb896d None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:33.855805 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01991ed5-5589-47bd-afbe-9a99a5bb896d None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:33.856277 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01991ed5-5589-47bd-afbe-9a99a5bb896d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:33.874151 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-01991ed5-5589-47bd-afbe-9a99a5bb896d None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:33.875807 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-01991ed5-5589-47bd-afbe-9a99a5bb896d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:33.916293 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:33.953536 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 193/404] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:23:33 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:23:33.954813 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01991ed5-5589-47bd-afbe-9a99a5bb896d None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:33.964909 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc2ed77-6356-49ec-9f7b-9efb425a3f0b None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:34.017001 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adb788d-5101-4734-b8e4-4d6f786ae575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:34.017666 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adb788d-5101-4734-b8e4-4d6f786ae575 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:34.018138 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adb788d-5101-4734-b8e4-4d6f786ae575 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:34.018611 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adb788d-5101-4734-b8e4-4d6f786ae575 None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:34.020130 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adb788d-5101-4734-b8e4-4d6f786ae575 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:34.020648 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adb788d-5101-4734-b8e4-4d6f786ae575 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:34.022342 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adb788d-5101-4734-b8e4-4d6f786ae575 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:34.035739 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 212/405] 10.222.0.118 () {56 vars in 1116 bytes} [Thu Jul 14 15:23:33 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:34.036867 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adb788d-5101-4734-b8e4-4d6f786ae575 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:34.067668 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01991ed5-5589-47bd-afbe-9a99a5bb896d None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:34.076223 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:34.108121 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982659ca-22b2-4355-a3f3-846336e761d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:34.109234 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982659ca-22b2-4355-a3f3-846336e761d0 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:34.109657 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982659ca-22b2-4355-a3f3-846336e761d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:34.110116 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982659ca-22b2-4355-a3f3-846336e761d0 None admin] PATH_INFO: `/v3/projects/9d45367dfdd34d7ab5e0b055eda4e88e` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:34.111701 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982659ca-22b2-4355-a3f3-846336e761d0 None admin] RBAC: Authorizing `identity:get_project(project_id=9d45367dfdd34d7ab5e0b055eda4e88e)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:34.113475 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982659ca-22b2-4355-a3f3-846336e761d0 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:34.115480 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 194/406] 10.222.0.118 () {56 vars in 1191 bytes} [Thu Jul 14 15:23:33 2022] GET /identity/v3/projects/9d45367dfdd34d7ab5e0b055eda4e88e => generated 303 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:34.116493 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982659ca-22b2-4355-a3f3-846336e761d0 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:34.157022 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adb788d-5101-4734-b8e4-4d6f786ae575 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:34.163364 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:34.196647 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6795db17-3deb-4764-a0fc-5cda5dcd6aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:34.197438 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6795db17-3deb-4764-a0fc-5cda5dcd6aef None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:34.197714 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6795db17-3deb-4764-a0fc-5cda5dcd6aef None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:34.198066 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6795db17-3deb-4764-a0fc-5cda5dcd6aef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:34.210062 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6795db17-3deb-4764-a0fc-5cda5dcd6aef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:23:34.219202 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-6795db17-3deb-4764-a0fc-5cda5dcd6aef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:23:34.219202 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:34.219202 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:34.219202 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:34.219202 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:34.219202 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:34.219202 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:34.219202 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:34.219202 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:34.219202 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:34.219202 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:34.219202 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:34.219202 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:23:34.219202 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:23:34.219202 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:23:34.219202 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:23:34.220087 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:23:34.220087 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:23:34.220087 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:23:34.220087 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:23:34.220087 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:34.220087 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:34.220087 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:34.220087 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:34.220087 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:34.220087 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:34.220087 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:34.220087 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:34.220087 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:34.220087 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:34.220087 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:34.220087 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:34.220979 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:34.220979 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:34.220979 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:34.220979 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:34.220979 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:23:34.220979 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:23:34.220979 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:23:34.220979 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:23:34.220979 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:23:34.220979 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:23:34.220979 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:23:34.220979 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:23:34.225589 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 213/407] 10.222.0.118 () {56 vars in 1101 bytes} [Thu Jul 14 15:23:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:34.226584 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6795db17-3deb-4764-a0fc-5cda5dcd6aef None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:34.232356 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982659ca-22b2-4355-a3f3-846336e761d0 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:34.270399 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe4e7bd-dde5-403a-ae29-11b51933fe6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:34.271738 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe4e7bd-dde5-403a-ae29-11b51933fe6e None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:34.272233 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe4e7bd-dde5-403a-ae29-11b51933fe6e None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:34.272704 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe4e7bd-dde5-403a-ae29-11b51933fe6e None admin] PATH_INFO: `/v3/groups/ed444eb022114f4baa24a7f20c25306f` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:34.274263 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe4e7bd-dde5-403a-ae29-11b51933fe6e None admin] RBAC: Authorizing `identity:get_group(group_id=ed444eb022114f4baa24a7f20c25306f)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:34.276043 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe4e7bd-dde5-403a-ae29-11b51933fe6e None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:34.278007 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 195/408] 10.222.0.118 () {56 vars in 1185 bytes} [Thu Jul 14 15:23:34 2022] GET /identity/v3/groups/ed444eb022114f4baa24a7f20c25306f => generated 227 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:34.279061 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe4e7bd-dde5-403a-ae29-11b51933fe6e None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:34.335002 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:34.341573 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6795db17-3deb-4764-a0fc-5cda5dcd6aef None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:34.382904 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03044834-184c-4a8b-a997-1e9b44234a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:34.384149 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03044834-184c-4a8b-a997-1e9b44234a66 None admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:34.384685 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03044834-184c-4a8b-a997-1e9b44234a66 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:34.385111 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03044834-184c-4a8b-a997-1e9b44234a66 None admin] PATH_INFO: `/v3/projects/9d45367dfdd34d7ab5e0b055eda4e88e/groups/ed444eb022114f4baa24a7f20c25306f/roles/4abcf5e5e7cd4b53ae1828fec6550d53` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:34.388248 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03044834-184c-4a8b-a997-1e9b44234a66 None admin] RBAC: Authorizing `identity:create_grant(project_id=9d45367dfdd34d7ab5e0b055eda4e88e, group_id=ed444eb022114f4baa24a7f20c25306f, role_id=4abcf5e5e7cd4b53ae1828fec6550d53)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:34.389907 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03044834-184c-4a8b-a997-1e9b44234a66 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:34.393827 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe4e7bd-dde5-403a-ae29-11b51933fe6e None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:34.405442 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:34.406844 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 214/409] 10.222.0.118 () {58 vars in 1447 bytes} [Thu Jul 14 15:23:34 2022] PUT /identity/v3/projects/9d45367dfdd34d7ab5e0b055eda4e88e/groups/ed444eb022114f4baa24a7f20c25306f/roles/4abcf5e5e7cd4b53ae1828fec6550d53 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:23:34.411434 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03044834-184c-4a8b-a997-1e9b44234a66 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:34.435008 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2531f9-6d9a-43de-be17-545ade6dd673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:34.436131 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2531f9-6d9a-43de-be17-545ade6dd673 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:34.436616 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2531f9-6d9a-43de-be17-545ade6dd673 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:34.437092 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2531f9-6d9a-43de-be17-545ade6dd673 None admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:34.438087 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2531f9-6d9a-43de-be17-545ade6dd673 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:34.438617 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2531f9-6d9a-43de-be17-545ade6dd673 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:34.440223 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2531f9-6d9a-43de-be17-545ade6dd673 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:34.450683 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 196/410] 10.222.0.118 () {56 vars in 1104 bytes} [Thu Jul 14 15:23:34 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:34.461167 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2531f9-6d9a-43de-be17-545ade6dd673 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:34.586558 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2531f9-6d9a-43de-be17-545ade6dd673 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:34.630901 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dc4fd4-6925-4290-8401-ff2a373176e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:34.632415 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc4fd4-6925-4290-8401-ff2a373176e4 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:34.632898 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc4fd4-6925-4290-8401-ff2a373176e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:34.633372 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc4fd4-6925-4290-8401-ff2a373176e4 None admin] PATH_INFO: `/v3/groups/05b51acbe4844816865b6e5d5581230e` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:34.635452 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dc4fd4-6925-4290-8401-ff2a373176e4 None admin] RBAC: Authorizing `identity:get_group(group_id=05b51acbe4844816865b6e5d5581230e)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:34.637356 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dc4fd4-6925-4290-8401-ff2a373176e4 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:34.640101 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 197/411] 10.222.0.118 () {56 vars in 1185 bytes} [Thu Jul 14 15:23:34 2022] GET /identity/v3/groups/05b51acbe4844816865b6e5d5581230e => generated 230 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:34.645806 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dc4fd4-6925-4290-8401-ff2a373176e4 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:34.653341 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03044834-184c-4a8b-a997-1e9b44234a66 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:34.692387 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d3be10-f118-467f-a61f-f0685ad7a2ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:34.693253 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d3be10-f118-467f-a61f-f0685ad7a2ab None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:34.693531 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d3be10-f118-467f-a61f-f0685ad7a2ab None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:34.693796 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d3be10-f118-467f-a61f-f0685ad7a2ab None admin] PATH_INFO: `/v3/projects/9d45367dfdd34d7ab5e0b055eda4e88e` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:34.696060 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d3be10-f118-467f-a61f-f0685ad7a2ab None admin] RBAC: Authorizing `identity:get_project(project_id=9d45367dfdd34d7ab5e0b055eda4e88e)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:34.697079 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d3be10-f118-467f-a61f-f0685ad7a2ab None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:34.699136 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 215/412] 10.222.0.118 () {56 vars in 1191 bytes} [Thu Jul 14 15:23:34 2022] GET /identity/v3/projects/9d45367dfdd34d7ab5e0b055eda4e88e => generated 303 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:34.703895 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:34.705846 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d3be10-f118-467f-a61f-f0685ad7a2ab None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:34.735459 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:34.781219 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dc4fd4-6925-4290-8401-ff2a373176e4 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:34.820289 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa8b3b1-2ebc-4e17-bac4-d4b526201eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:34.821158 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa8b3b1-2ebc-4e17-bac4-d4b526201eba None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:34.821438 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa8b3b1-2ebc-4e17-bac4-d4b526201eba None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:34.821715 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa8b3b1-2ebc-4e17-bac4-d4b526201eba None admin] PATH_INFO: `/v3/projects/e864e571207e4b019bbf56cc1f0bce35` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:34.823979 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa8b3b1-2ebc-4e17-bac4-d4b526201eba None admin] RBAC: Authorizing `identity:get_project(project_id=e864e571207e4b019bbf56cc1f0bce35)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:34.825465 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa8b3b1-2ebc-4e17-bac4-d4b526201eba None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:34.827711 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 198/413] 10.222.0.118 () {56 vars in 1191 bytes} [Thu Jul 14 15:23:34 2022] GET /identity/v3/projects/e864e571207e4b019bbf56cc1f0bce35 => generated 345 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:23:34.836552 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa8b3b1-2ebc-4e17-bac4-d4b526201eba None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:34.891403 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d3be10-f118-467f-a61f-f0685ad7a2ab None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:34.941269 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc132a7c-e399-4686-b777-52dd87c60619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:34.942309 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc132a7c-e399-4686-b777-52dd87c60619 None admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:34.942591 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc132a7c-e399-4686-b777-52dd87c60619 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:34.942866 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc132a7c-e399-4686-b777-52dd87c60619 None admin] PATH_INFO: `/v3/projects/9d45367dfdd34d7ab5e0b055eda4e88e/groups/ed444eb022114f4baa24a7f20c25306f/roles/f4e85c621e6d4e749149099dd9303934` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:34.945292 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc132a7c-e399-4686-b777-52dd87c60619 None admin] RBAC: Authorizing `identity:create_grant(project_id=9d45367dfdd34d7ab5e0b055eda4e88e, group_id=ed444eb022114f4baa24a7f20c25306f, role_id=f4e85c621e6d4e749149099dd9303934)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:34.947329 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc132a7c-e399-4686-b777-52dd87c60619 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:34.968649 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 216/414] 10.222.0.118 () {58 vars in 1447 bytes} [Thu Jul 14 15:23:34 2022] PUT /identity/v3/projects/9d45367dfdd34d7ab5e0b055eda4e88e/groups/ed444eb022114f4baa24a7f20c25306f/roles/f4e85c621e6d4e749149099dd9303934 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:23:34.970601 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419f5f7b-abb6-4cb2-8191-7fba78b30c7f None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:34.970908 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419f5f7b-abb6-4cb2-8191-7fba78b30c7f None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:34.971210 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419f5f7b-abb6-4cb2-8191-7fba78b30c7f None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:34.977681 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 217/415] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:23:34 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:23:34.979471 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11431f8-511d-4711-b3ba-9b7f12c3ebc8 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:34.979769 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11431f8-511d-4711-b3ba-9b7f12c3ebc8 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:34.980045 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11431f8-511d-4711-b3ba-9b7f12c3ebc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:34.998207 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa8b3b1-2ebc-4e17-bac4-d4b526201eba None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:35.007615 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:35.010403 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-a11431f8-511d-4711-b3ba-9b7f12c3ebc8 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:35.013518 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-a11431f8-511d-4711-b3ba-9b7f12c3ebc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:35.050059 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1621016-40a2-406d-a203-2fbea7c04448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:35.051525 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1621016-40a2-406d-a203-2fbea7c04448 None admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:35.051987 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1621016-40a2-406d-a203-2fbea7c04448 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:35.052454 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1621016-40a2-406d-a203-2fbea7c04448 None admin] PATH_INFO: `/v3/projects/e864e571207e4b019bbf56cc1f0bce35/groups/05b51acbe4844816865b6e5d5581230e/roles/3b880cef7dcf4baf87b50f8610c0c56e` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:35.054951 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1621016-40a2-406d-a203-2fbea7c04448 None admin] RBAC: Authorizing `identity:create_grant(project_id=e864e571207e4b019bbf56cc1f0bce35, group_id=05b51acbe4844816865b6e5d5581230e, role_id=3b880cef7dcf4baf87b50f8610c0c56e)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:35.056715 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1621016-40a2-406d-a203-2fbea7c04448 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:35.082986 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 199/416] 10.222.0.118 () {58 vars in 1447 bytes} [Thu Jul 14 15:23:34 2022] PUT /identity/v3/projects/e864e571207e4b019bbf56cc1f0bce35/groups/05b51acbe4844816865b6e5d5581230e/roles/3b880cef7dcf4baf87b50f8610c0c56e => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:23:35.092299 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 218/417] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:23:34 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:23:35.120664 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1621016-40a2-406d-a203-2fbea7c04448 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:35.260044 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1621016-40a2-406d-a203-2fbea7c04448 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:35.296494 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd365a49-44f5-4ea5-832f-45d95e708588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:35.297569 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd365a49-44f5-4ea5-832f-45d95e708588 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:35.298018 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd365a49-44f5-4ea5-832f-45d95e708588 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:35.298456 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd365a49-44f5-4ea5-832f-45d95e708588 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:35.309861 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd365a49-44f5-4ea5-832f-45d95e708588 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:23:35.318687 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-bd365a49-44f5-4ea5-832f-45d95e708588 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 15:23:35.318687 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:35.318687 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:35.318687 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:35.318687 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:35.318687 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:35.318687 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:35.318687 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:35.318687 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:35.318687 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:35.318687 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:35.318687 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:35.318687 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:23:35.318687 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:23:35.318687 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:23:35.318687 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:23:35.319790 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:23:35.319790 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:23:35.319790 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:23:35.319790 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:23:35.319790 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:35.319790 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:35.319790 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:35.319790 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:35.319790 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:35.319790 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:35.319790 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:35.319790 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:35.319790 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:35.319790 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:35.319790 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:35.319790 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:35.320763 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:35.320763 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:35.320763 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:35.320763 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:35.320763 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:23:35.320763 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:23:35.320763 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:23:35.320763 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:23:35.320763 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:23:35.320763 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:23:35.320763 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 15:23:35.320763 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:23:35.323287 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 200/418] 10.222.0.118 () {56 vars in 1104 bytes} [Thu Jul 14 15:23:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:35.329604 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11431f8-511d-4711-b3ba-9b7f12c3ebc8 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:35.349935 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:35.452537 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11431f8-511d-4711-b3ba-9b7f12c3ebc8 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:35.493526 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37ab3d3-784e-41ce-b85a-5fdcbf1f4c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:35.494232 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ab3d3-784e-41ce-b85a-5fdcbf1f4c4d None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:35.494514 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ab3d3-784e-41ce-b85a-5fdcbf1f4c4d None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:35.494789 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ab3d3-784e-41ce-b85a-5fdcbf1f4c4d None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:35.495553 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37ab3d3-784e-41ce-b85a-5fdcbf1f4c4d None admin] RBAC: Adding query filter params (name=member) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:35.495862 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37ab3d3-784e-41ce-b85a-5fdcbf1f4c4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:35.497244 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37ab3d3-784e-41ce-b85a-5fdcbf1f4c4d None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:35.507287 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 219/419] 10.222.0.118 () {56 vars in 1106 bytes} [Thu Jul 14 15:23:35 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:35.512825 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd365a49-44f5-4ea5-832f-45d95e708588 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:35.553946 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24bc3b3-49bf-4904-90b2-e69b5b88649e None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:35.554312 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24bc3b3-49bf-4904-90b2-e69b5b88649e None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:35.554549 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24bc3b3-49bf-4904-90b2-e69b5b88649e None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:35.555951 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 220/420] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:23:35 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 14 15:23:35.560847 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:35.571132 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eec9ad7-2217-4775-adee-8c4ab7359e79 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:35.571417 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eec9ad7-2217-4775-adee-8c4ab7359e79 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:35.571693 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eec9ad7-2217-4775-adee-8c4ab7359e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:35.611566 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-2eec9ad7-2217-4775-adee-8c4ab7359e79 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:35.613000 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-2eec9ad7-2217-4775-adee-8c4ab7359e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:35.667679 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd365a49-44f5-4ea5-832f-45d95e708588 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:35.716024 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a9fe71-fe2a-44c2-a7be-8cb1e6f90be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:35.717199 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a9fe71-fe2a-44c2-a7be-8cb1e6f90be1 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:35.718876 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a9fe71-fe2a-44c2-a7be-8cb1e6f90be1 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:35.719470 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a9fe71-fe2a-44c2-a7be-8cb1e6f90be1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:35.753061 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 221/421] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:23:35 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:23:35.782476 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eec9ad7-2217-4775-adee-8c4ab7359e79 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:35.794700 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:35.821344 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a9fe71-fe2a-44c2-a7be-8cb1e6f90be1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:35.822848 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a9fe71-fe2a-44c2-a7be-8cb1e6f90be1 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:35.869385 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:35.934806 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eec9ad7-2217-4775-adee-8c4ab7359e79 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:35.995923 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 201/422] 10.222.0.118 () {58 vars in 1287 bytes} [Thu Jul 14 15:23:35 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 15:23:36.001682 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a9fe71-fe2a-44c2-a7be-8cb1e6f90be1 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:36.004939 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e299a2-d9aa-4af7-befb-e0a8a924bcbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:36.007369 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e299a2-d9aa-4af7-befb-e0a8a924bcbe None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:36.007930 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e299a2-d9aa-4af7-befb-e0a8a924bcbe None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:36.013433 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e299a2-d9aa-4af7-befb-e0a8a924bcbe None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:36.026074 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e299a2-d9aa-4af7-befb-e0a8a924bcbe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:23:36.036278 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-96e299a2-d9aa-4af7-befb-e0a8a924bcbe None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 15:23:36.036278 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:36.036278 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:36.036278 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:36.036278 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:36.036278 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:36.036278 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:36.036278 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:36.036278 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:36.036278 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:36.036278 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:36.036278 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:36.036278 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:23:36.036278 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:23:36.036278 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:23:36.036278 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:23:36.037125 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:23:36.037125 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:23:36.037125 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:23:36.037125 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:23:36.037125 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:36.037125 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:36.037125 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:36.037125 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:36.037125 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:36.037125 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:36.037125 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:36.037125 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:36.037125 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:36.037125 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:36.037125 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:36.037125 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:36.037903 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:36.037903 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:36.037903 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:36.037903 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:36.037903 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:23:36.037903 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:23:36.037903 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:23:36.037903 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:23:36.037903 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:23:36.037903 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:23:36.037903 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 15:23:36.037903 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:23:36.040536 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 222/423] 10.222.0.118 () {56 vars in 1119 bytes} [Thu Jul 14 15:23:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:23:36.047557 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e299a2-d9aa-4af7-befb-e0a8a924bcbe None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:36.128003 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a9fe71-fe2a-44c2-a7be-8cb1e6f90be1 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:36.154325 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:36.167406 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed6a2b1-f45d-4baf-be16-bca2b399aef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:36.168261 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed6a2b1-f45d-4baf-be16-bca2b399aef8 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:36.168526 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed6a2b1-f45d-4baf-be16-bca2b399aef8 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:36.168784 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed6a2b1-f45d-4baf-be16-bca2b399aef8 None admin] PATH_INFO: `/v3/projects/a99d762a7cad4fc1ac87113f5b01b5b2` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:36.170139 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed6a2b1-f45d-4baf-be16-bca2b399aef8 None admin] RBAC: Authorizing `identity:get_project(project_id=a99d762a7cad4fc1ac87113f5b01b5b2)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:36.171582 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed6a2b1-f45d-4baf-be16-bca2b399aef8 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:36.173629 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 202/424] 10.222.0.118 () {56 vars in 1191 bytes} [Thu Jul 14 15:23:36 2022] GET /identity/v3/projects/a99d762a7cad4fc1ac87113f5b01b5b2 => generated 299 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:23:36.179267 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed6a2b1-f45d-4baf-be16-bca2b399aef8 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:36.180336 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:36.251631 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e299a2-d9aa-4af7-befb-e0a8a924bcbe None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:36.313792 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97308a9-3a66-4b99-b6f7-16b4be0758a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:36.314897 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97308a9-3a66-4b99-b6f7-16b4be0758a6 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:36.315373 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97308a9-3a66-4b99-b6f7-16b4be0758a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:36.315904 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97308a9-3a66-4b99-b6f7-16b4be0758a6 None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:36.316851 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97308a9-3a66-4b99-b6f7-16b4be0758a6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:36.317370 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97308a9-3a66-4b99-b6f7-16b4be0758a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:36.318971 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97308a9-3a66-4b99-b6f7-16b4be0758a6 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:36.334368 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed6a2b1-f45d-4baf-be16-bca2b399aef8 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:36.337264 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 223/425] 10.222.0.118 () {56 vars in 1116 bytes} [Thu Jul 14 15:23:36 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:36.342774 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97308a9-3a66-4b99-b6f7-16b4be0758a6 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:36.371063 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cb8c67-dc0a-49f4-9400-9e4ae8c115c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:36.371929 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cb8c67-dc0a-49f4-9400-9e4ae8c115c3 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:36.372208 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cb8c67-dc0a-49f4-9400-9e4ae8c115c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:36.372480 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cb8c67-dc0a-49f4-9400-9e4ae8c115c3 None admin] PATH_INFO: `/v3/groups/ed444eb022114f4baa24a7f20c25306f` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:36.373668 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cb8c67-dc0a-49f4-9400-9e4ae8c115c3 None admin] RBAC: Authorizing `identity:get_group(group_id=ed444eb022114f4baa24a7f20c25306f)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:36.376367 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cb8c67-dc0a-49f4-9400-9e4ae8c115c3 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:36.376749 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 203/426] 10.222.0.118 () {56 vars in 1185 bytes} [Thu Jul 14 15:23:36 2022] GET /identity/v3/groups/ed444eb022114f4baa24a7f20c25306f => generated 227 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:36.386817 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cb8c67-dc0a-49f4-9400-9e4ae8c115c3 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:36.488039 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97308a9-3a66-4b99-b6f7-16b4be0758a6 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:36.498116 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:36.533224 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:36.542662 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cb8c67-dc0a-49f4-9400-9e4ae8c115c3 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:36.551899 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079d9451-0406-40ec-aecf-a12893f461ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:36.552933 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079d9451-0406-40ec-aecf-a12893f461ba None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:36.553409 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079d9451-0406-40ec-aecf-a12893f461ba None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:36.554044 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079d9451-0406-40ec-aecf-a12893f461ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:36.600526 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd908aeb-eb7e-4801-94d3-8607630d1c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:36.601105 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd908aeb-eb7e-4801-94d3-8607630d1c47 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:36.601385 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd908aeb-eb7e-4801-94d3-8607630d1c47 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:36.601654 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd908aeb-eb7e-4801-94d3-8607630d1c47 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:36.606151 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd908aeb-eb7e-4801-94d3-8607630d1c47 None admin] RBAC: Adding query filter params (group.id=ed444eb022114f4baa24a7f20c25306f, role.id=4abcf5e5e7cd4b53ae1828fec6550d53, scope.project.id=a99d762a7cad4fc1ac87113f5b01b5b2) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:36.606151 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd908aeb-eb7e-4801-94d3-8607630d1c47 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:36.606151 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd908aeb-eb7e-4801-94d3-8607630d1c47 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:36.611088 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 204/427] 10.222.0.118 () {56 vars in 1381 bytes} [Thu Jul 14 15:23:36 2022] GET /identity/v3/role_assignments?group.id=ed444eb022114f4baa24a7f20c25306f&scope.project.id=a99d762a7cad4fc1ac87113f5b01b5b2&role.id=4abcf5e5e7cd4b53ae1828fec6550d53 => generated 613 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:36.642245 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079d9451-0406-40ec-aecf-a12893f461ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:36.643824 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079d9451-0406-40ec-aecf-a12893f461ba None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:36.754268 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 224/428] 10.222.0.118 () {58 vars in 1287 bytes} [Thu Jul 14 15:23:36 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 15:23:36.763122 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd908aeb-eb7e-4801-94d3-8607630d1c47 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:36.902674 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd908aeb-eb7e-4801-94d3-8607630d1c47 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:36.945941 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:36.955862 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf48dbd-4a85-4ca0-9f49-05574e70b698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:36.956760 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf48dbd-4a85-4ca0-9f49-05574e70b698 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:36.957035 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf48dbd-4a85-4ca0-9f49-05574e70b698 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:36.957303 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf48dbd-4a85-4ca0-9f49-05574e70b698 None admin] PATH_INFO: `/v3/projects/a99d762a7cad4fc1ac87113f5b01b5b2` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:36.962830 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf48dbd-4a85-4ca0-9f49-05574e70b698 None admin] RBAC: Authorizing `identity:get_project(project_id=a99d762a7cad4fc1ac87113f5b01b5b2)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:36.964391 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf48dbd-4a85-4ca0-9f49-05574e70b698 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:36.966576 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 205/429] 10.222.0.118 () {56 vars in 1191 bytes} [Thu Jul 14 15:23:36 2022] GET /identity/v3/projects/a99d762a7cad4fc1ac87113f5b01b5b2 => generated 299 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:36.971897 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079d9451-0406-40ec-aecf-a12893f461ba None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:37.008252 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:37.099738 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079d9451-0406-40ec-aecf-a12893f461ba None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:37.149332 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964cd1a1-0de1-40fc-ba7f-bac53c7e8933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:37.150285 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964cd1a1-0de1-40fc-ba7f-bac53c7e8933 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:37.150558 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964cd1a1-0de1-40fc-ba7f-bac53c7e8933 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:37.150825 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964cd1a1-0de1-40fc-ba7f-bac53c7e8933 None admin] PATH_INFO: `/v3/groups/ed444eb022114f4baa24a7f20c25306f` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:37.152016 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964cd1a1-0de1-40fc-ba7f-bac53c7e8933 None admin] RBAC: Authorizing `identity:get_group(group_id=ed444eb022114f4baa24a7f20c25306f)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:37.153500 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964cd1a1-0de1-40fc-ba7f-bac53c7e8933 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:37.155087 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 225/430] 10.222.0.118 () {56 vars in 1185 bytes} [Thu Jul 14 15:23:36 2022] GET /identity/v3/groups/ed444eb022114f4baa24a7f20c25306f => generated 227 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:23:37.161674 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf48dbd-4a85-4ca0-9f49-05574e70b698 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:37.280021 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf48dbd-4a85-4ca0-9f49-05574e70b698 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:37.318495 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3849a814-0be0-42a1-8c2d-398f6d0231cc None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:37.318833 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3849a814-0be0-42a1-8c2d-398f6d0231cc None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:37.319045 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3849a814-0be0-42a1-8c2d-398f6d0231cc None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:37.320657 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 226/431] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:23:37 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:23:37.326436 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb2a31a-1ed8-45e4-b106-234a8785fcb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:37.326610 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa267e-6457-48c2-b362-9bea6901b85e None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:37.326863 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa267e-6457-48c2-b362-9bea6901b85e None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:37.327134 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa267e-6457-48c2-b362-9bea6901b85e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:37.327876 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb2a31a-1ed8-45e4-b106-234a8785fcb9 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:37.328344 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb2a31a-1ed8-45e4-b106-234a8785fcb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:37.328988 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb2a31a-1ed8-45e4-b106-234a8785fcb9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:37.332005 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb2a31a-1ed8-45e4-b106-234a8785fcb9 None admin] RBAC: Adding query filter params (group.id=ed444eb022114f4baa24a7f20c25306f, role.id=f4e85c621e6d4e749149099dd9303934, scope.project.id=a99d762a7cad4fc1ac87113f5b01b5b2) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:37.332551 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb2a31a-1ed8-45e4-b106-234a8785fcb9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:37.334220 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb2a31a-1ed8-45e4-b106-234a8785fcb9 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:37.342263 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 206/432] 10.222.0.118 () {56 vars in 1381 bytes} [Thu Jul 14 15:23:37 2022] GET /identity/v3/role_assignments?group.id=ed444eb022114f4baa24a7f20c25306f&scope.project.id=a99d762a7cad4fc1ac87113f5b01b5b2&role.id=f4e85c621e6d4e749149099dd9303934 => generated 613 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:37.352491 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-14aa267e-6457-48c2-b362-9bea6901b85e None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:37.353735 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-14aa267e-6457-48c2-b362-9bea6901b85e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:37.436128 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 227/433] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:23:37 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:23:37.464429 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb2a31a-1ed8-45e4-b106-234a8785fcb9 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:37.492491 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85fd935-17d2-4c4b-bc45-476566db9789 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:37.492832 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85fd935-17d2-4c4b-bc45-476566db9789 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:37.493076 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85fd935-17d2-4c4b-bc45-476566db9789 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:37.495197 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 228/434] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:23:37 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:23:37.501639 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b71f4d1-7666-46d7-a80e-fccf598b5b75 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:37.501942 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b71f4d1-7666-46d7-a80e-fccf598b5b75 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:37.502241 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b71f4d1-7666-46d7-a80e-fccf598b5b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:37.531010 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-6b71f4d1-7666-46d7-a80e-fccf598b5b75 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:37.532231 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-6b71f4d1-7666-46d7-a80e-fccf598b5b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:37.546152 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:37.561153 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:37.600521 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb2a31a-1ed8-45e4-b106-234a8785fcb9 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:37.629869 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 229/435] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:23:37 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:23:37.631534 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee391094-e5bd-4883-b5ba-fdd04f885e0d None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:37.631820 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee391094-e5bd-4883-b5ba-fdd04f885e0d None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:37.632092 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee391094-e5bd-4883-b5ba-fdd04f885e0d None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:37.633530 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 230/436] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:23:37 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:23:37.639023 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c1e7bf-b002-4ebe-9894-353b0f06f3fc None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:37.639302 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c1e7bf-b002-4ebe-9894-353b0f06f3fc None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:37.639708 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c1e7bf-b002-4ebe-9894-353b0f06f3fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:37.648286 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508b6ac0-b35c-46b1-97be-12e38c134317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:37.649387 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508b6ac0-b35c-46b1-97be-12e38c134317 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:37.649661 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508b6ac0-b35c-46b1-97be-12e38c134317 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:37.649932 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508b6ac0-b35c-46b1-97be-12e38c134317 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:37.659717 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-a0c1e7bf-b002-4ebe-9894-353b0f06f3fc None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:37.660905 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-a0c1e7bf-b002-4ebe-9894-353b0f06f3fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:37.661520 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508b6ac0-b35c-46b1-97be-12e38c134317 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:23:37.669231 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-508b6ac0-b35c-46b1-97be-12e38c134317 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 15:23:37.669231 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:37.669231 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:37.669231 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:37.669231 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:37.669231 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:37.669231 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:37.669231 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:37.669231 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:37.669231 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:37.669231 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:37.669231 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:37.669231 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:23:37.669231 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:23:37.669231 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:23:37.669231 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:23:37.670149 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:23:37.670149 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:23:37.670149 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:23:37.670149 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:23:37.670149 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:37.670149 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:37.670149 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:37.670149 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:37.670149 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:37.670149 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:37.670149 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:37.670149 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:37.670149 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:37.670149 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:37.670149 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:37.670149 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:37.670924 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:37.670924 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:37.670924 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:37.670924 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:37.670924 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:23:37.670924 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:23:37.670924 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:23:37.670924 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:23:37.670924 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:23:37.670924 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:23:37.670924 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 15:23:37.670924 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:23:37.670924 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 207/437] 10.222.0.118 () {56 vars in 1104 bytes} [Thu Jul 14 15:23:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:37.671566 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508b6ac0-b35c-46b1-97be-12e38c134317 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:37.755423 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 231/438] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:23:37 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 15:23:37.757116 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c1e7bf-b002-4ebe-9894-353b0f06f3fc None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:37.804990 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508b6ac0-b35c-46b1-97be-12e38c134317 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:37.826309 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:37.845743 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9db0ef-1b9a-4428-8b3b-15b0267084e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:37.847071 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9db0ef-1b9a-4428-8b3b-15b0267084e5 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:37.847353 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9db0ef-1b9a-4428-8b3b-15b0267084e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:37.847629 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9db0ef-1b9a-4428-8b3b-15b0267084e5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:37.854560 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:37.858981 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9db0ef-1b9a-4428-8b3b-15b0267084e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:23:37.867047 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-fc9db0ef-1b9a-4428-8b3b-15b0267084e5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 15:23:37.867047 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:37.867047 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:37.867047 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:37.867047 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:37.867047 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:37.867047 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:37.867047 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:37.867047 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:37.867047 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:37.867047 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:37.867047 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:37.867047 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:23:37.867047 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:23:37.867047 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:23:37.867047 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:23:37.868129 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:23:37.868129 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:23:37.868129 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:23:37.868129 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:23:37.868129 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:37.868129 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:37.868129 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:37.868129 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:37.868129 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:37.868129 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:37.868129 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:37.868129 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:37.868129 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:37.868129 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:37.868129 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:37.868129 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:37.868930 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:37.868930 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:37.868930 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:37.868930 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:37.868930 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:23:37.868930 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:23:37.868930 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:23:37.868930 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:23:37.868930 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:23:37.868930 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:23:37.868930 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 15:23:37.868930 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:23:37.868930 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 208/439] 10.222.0.118 () {56 vars in 1119 bytes} [Thu Jul 14 15:23:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:37.869576 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9db0ef-1b9a-4428-8b3b-15b0267084e5 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:37.875443 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c1e7bf-b002-4ebe-9894-353b0f06f3fc None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:37.910712 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1caf4e-4323-4906-97a7-a71a191af043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:37.911517 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1caf4e-4323-4906-97a7-a71a191af043 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:37.911798 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1caf4e-4323-4906-97a7-a71a191af043 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:37.912072 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1caf4e-4323-4906-97a7-a71a191af043 None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:37.912818 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1caf4e-4323-4906-97a7-a71a191af043 None admin] RBAC: Adding query filter params (name=member) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:37.913121 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1caf4e-4323-4906-97a7-a71a191af043 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:37.914539 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1caf4e-4323-4906-97a7-a71a191af043 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:37.923386 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 232/440] 10.222.0.118 () {56 vars in 1106 bytes} [Thu Jul 14 15:23:37 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:37.924017 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1caf4e-4323-4906-97a7-a71a191af043 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:37.985012 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9db0ef-1b9a-4428-8b3b-15b0267084e5 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:38.019255 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757bce54-03ac-4cd0-adb3-ec1fd66dc814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:38.020042 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757bce54-03ac-4cd0-adb3-ec1fd66dc814 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:38.020325 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757bce54-03ac-4cd0-adb3-ec1fd66dc814 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:38.020601 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757bce54-03ac-4cd0-adb3-ec1fd66dc814 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:38.022475 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1caf4e-4323-4906-97a7-a71a191af043 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:38.030473 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757bce54-03ac-4cd0-adb3-ec1fd66dc814 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:23:38.038003 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-757bce54-03ac-4cd0-adb3-ec1fd66dc814 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:23:38.038003 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:38.038003 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:38.038003 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:38.038003 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:38.038003 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:38.038003 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:38.038003 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:38.038003 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:38.038003 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:38.038003 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:38.038003 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:38.038003 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:23:38.038003 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:23:38.038003 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:23:38.038003 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:23:38.039019 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:23:38.039019 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:23:38.039019 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:23:38.039019 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:23:38.039019 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:38.039019 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:38.039019 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:38.039019 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:38.039019 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:38.039019 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:38.039019 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:38.039019 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:38.039019 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:38.039019 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:38.039019 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:38.039019 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:38.039814 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:38.039814 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:38.039814 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:38.039814 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:38.039814 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:23:38.039814 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:23:38.039814 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:23:38.039814 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:23:38.039814 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:23:38.039814 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:23:38.039814 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:23:38.039814 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:23:38.039814 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 209/441] 10.222.0.118 () {56 vars in 1101 bytes} [Thu Jul 14 15:23:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:38.040478 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757bce54-03ac-4cd0-adb3-ec1fd66dc814 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:38.055293 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5a439d-2a27-4195-8aaa-62c0594c49ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:38.055951 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5a439d-2a27-4195-8aaa-62c0594c49ce None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:38.056228 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5a439d-2a27-4195-8aaa-62c0594c49ce None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:38.056496 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5a439d-2a27-4195-8aaa-62c0594c49ce None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:38.057235 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5a439d-2a27-4195-8aaa-62c0594c49ce None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:38.057535 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5a439d-2a27-4195-8aaa-62c0594c49ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:38.058994 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5a439d-2a27-4195-8aaa-62c0594c49ce None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:38.067303 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 233/442] 10.222.0.118 () {56 vars in 1116 bytes} [Thu Jul 14 15:23:37 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:38.068072 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5a439d-2a27-4195-8aaa-62c0594c49ce None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:38.080189 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:38.089798 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:38.150830 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757bce54-03ac-4cd0-adb3-ec1fd66dc814 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:38.169012 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5a439d-2a27-4195-8aaa-62c0594c49ce None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:38.184301 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db170cb-c200-44ea-95b6-79933cb7fe43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:38.185024 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db170cb-c200-44ea-95b6-79933cb7fe43 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:38.185367 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db170cb-c200-44ea-95b6-79933cb7fe43 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:38.185701 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db170cb-c200-44ea-95b6-79933cb7fe43 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:38.203562 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f90ecd-ff8f-4f6e-ba9c-3b3e7ab6594d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:38.204251 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f90ecd-ff8f-4f6e-ba9c-3b3e7ab6594d None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:38.204529 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f90ecd-ff8f-4f6e-ba9c-3b3e7ab6594d None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:38.204808 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f90ecd-ff8f-4f6e-ba9c-3b3e7ab6594d None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:38.205645 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f90ecd-ff8f-4f6e-ba9c-3b3e7ab6594d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:38.205954 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f90ecd-ff8f-4f6e-ba9c-3b3e7ab6594d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:38.207608 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f90ecd-ff8f-4f6e-ba9c-3b3e7ab6594d None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:38.215594 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 234/443] 10.222.0.118 () {56 vars in 1104 bytes} [Thu Jul 14 15:23:38 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:38.216383 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f90ecd-ff8f-4f6e-ba9c-3b3e7ab6594d None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:38.271568 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db170cb-c200-44ea-95b6-79933cb7fe43 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:38.273755 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db170cb-c200-44ea-95b6-79933cb7fe43 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:38.296433 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:38.313081 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:38.328576 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f90ecd-ff8f-4f6e-ba9c-3b3e7ab6594d None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:38.362158 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a8f1c2-3625-4903-be25-639b7e19ebc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:38.363421 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a8f1c2-3625-4903-be25-639b7e19ebc4 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:38.363703 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a8f1c2-3625-4903-be25-639b7e19ebc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:38.363974 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a8f1c2-3625-4903-be25-639b7e19ebc4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:38.373054 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 210/444] 10.222.0.118 () {58 vars in 1287 bytes} [Thu Jul 14 15:23:38 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 15:23:38.373887 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db170cb-c200-44ea-95b6-79933cb7fe43 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:38.431327 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a8f1c2-3625-4903-be25-639b7e19ebc4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:38.432793 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a8f1c2-3625-4903-be25-639b7e19ebc4 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:38.472463 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db170cb-c200-44ea-95b6-79933cb7fe43 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:38.500254 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:38.506151 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564ad607-21d6-4d7d-9ffe-fba7d1852336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:38.506791 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ad607-21d6-4d7d-9ffe-fba7d1852336 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:38.507069 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ad607-21d6-4d7d-9ffe-fba7d1852336 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:38.507342 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ad607-21d6-4d7d-9ffe-fba7d1852336 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:38.515388 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:38.531206 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 235/445] 10.222.0.118 () {58 vars in 1287 bytes} [Thu Jul 14 15:23:38 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 15:23:38.532322 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a8f1c2-3625-4903-be25-639b7e19ebc4 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:38.574909 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564ad607-21d6-4d7d-9ffe-fba7d1852336 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:38.576773 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564ad607-21d6-4d7d-9ffe-fba7d1852336 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:38.632479 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a8f1c2-3625-4903-be25-639b7e19ebc4 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:38.665496 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329f62c0-22f0-4be5-bd7a-0f65887b1d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:38.666377 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329f62c0-22f0-4be5-bd7a-0f65887b1d4d None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:38.666657 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329f62c0-22f0-4be5-bd7a-0f65887b1d4d None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:38.666932 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329f62c0-22f0-4be5-bd7a-0f65887b1d4d None admin] PATH_INFO: `/v3/projects/9d45367dfdd34d7ab5e0b055eda4e88e` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:38.668158 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329f62c0-22f0-4be5-bd7a-0f65887b1d4d None admin] RBAC: Authorizing `identity:get_project(project_id=9d45367dfdd34d7ab5e0b055eda4e88e)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:38.669736 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329f62c0-22f0-4be5-bd7a-0f65887b1d4d None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:38.673957 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 211/446] 10.222.0.118 () {58 vars in 1287 bytes} [Thu Jul 14 15:23:38 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 15:23:38.674813 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564ad607-21d6-4d7d-9ffe-fba7d1852336 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:38.676820 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 236/447] 10.222.0.118 () {56 vars in 1191 bytes} [Thu Jul 14 15:23:38 2022] GET /identity/v3/projects/9d45367dfdd34d7ab5e0b055eda4e88e => generated 303 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:38.677519 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329f62c0-22f0-4be5-bd7a-0f65887b1d4d None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:38.714820 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:38.720193 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:38.776034 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564ad607-21d6-4d7d-9ffe-fba7d1852336 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:38.780731 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329f62c0-22f0-4be5-bd7a-0f65887b1d4d None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:38.810213 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ac57d2-d649-4072-80d8-2a17668b7a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:38.811001 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ac57d2-d649-4072-80d8-2a17668b7a20 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:38.811281 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ac57d2-d649-4072-80d8-2a17668b7a20 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:38.811559 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ac57d2-d649-4072-80d8-2a17668b7a20 None admin] PATH_INFO: `/v3/projects/9d45367dfdd34d7ab5e0b055eda4e88e` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:38.812746 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ac57d2-d649-4072-80d8-2a17668b7a20 None admin] RBAC: Authorizing `identity:get_project(project_id=9d45367dfdd34d7ab5e0b055eda4e88e)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:38.814251 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ac57d2-d649-4072-80d8-2a17668b7a20 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:38.814375 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc72b394-6200-4b48-9866-f9b67d97e89f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:38.815198 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc72b394-6200-4b48-9866-f9b67d97e89f None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:38.815476 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc72b394-6200-4b48-9866-f9b67d97e89f None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:38.815776 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc72b394-6200-4b48-9866-f9b67d97e89f None admin] PATH_INFO: `/v3/groups/ed444eb022114f4baa24a7f20c25306f` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:38.816133 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 212/448] 10.222.0.118 () {56 vars in 1191 bytes} [Thu Jul 14 15:23:38 2022] GET /identity/v3/projects/9d45367dfdd34d7ab5e0b055eda4e88e => generated 303 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:38.816891 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ac57d2-d649-4072-80d8-2a17668b7a20 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:38.817058 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc72b394-6200-4b48-9866-f9b67d97e89f None admin] RBAC: Authorizing `identity:get_group(group_id=ed444eb022114f4baa24a7f20c25306f)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:38.818483 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc72b394-6200-4b48-9866-f9b67d97e89f None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:38.820385 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 237/449] 10.222.0.118 () {56 vars in 1185 bytes} [Thu Jul 14 15:23:38 2022] GET /identity/v3/groups/ed444eb022114f4baa24a7f20c25306f => generated 227 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:23:38.821507 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc72b394-6200-4b48-9866-f9b67d97e89f None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:38.921562 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc72b394-6200-4b48-9866-f9b67d97e89f None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:38.927058 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ac57d2-d649-4072-80d8-2a17668b7a20 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:38.931137 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:38.934215 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:38.957128 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006e99b5-eff1-4f76-a25f-f3a5ff361e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:38.957757 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006e99b5-eff1-4f76-a25f-f3a5ff361e35 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:38.958062 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006e99b5-eff1-4f76-a25f-f3a5ff361e35 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:38.958347 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006e99b5-eff1-4f76-a25f-f3a5ff361e35 None admin] PATH_INFO: `/v3/groups/ed444eb022114f4baa24a7f20c25306f` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:38.959525 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006e99b5-eff1-4f76-a25f-f3a5ff361e35 None admin] RBAC: Authorizing `identity:get_group(group_id=ed444eb022114f4baa24a7f20c25306f)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:38.960968 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006e99b5-eff1-4f76-a25f-f3a5ff361e35 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:38.967621 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 238/450] 10.222.0.118 () {56 vars in 1185 bytes} [Thu Jul 14 15:23:38 2022] GET /identity/v3/groups/ed444eb022114f4baa24a7f20c25306f => generated 227 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:38.967621 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006e99b5-eff1-4f76-a25f-f3a5ff361e35 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:38.967829 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ffa527-2864-479a-b019-12655fc462b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:38.967829 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ffa527-2864-479a-b019-12655fc462b5 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:38.967829 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ffa527-2864-479a-b019-12655fc462b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:38.967829 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ffa527-2864-479a-b019-12655fc462b5 None admin] PATH_INFO: `/v3/projects/e864e571207e4b019bbf56cc1f0bce35` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:38.968095 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ffa527-2864-479a-b019-12655fc462b5 None admin] RBAC: Authorizing `identity:get_project(project_id=e864e571207e4b019bbf56cc1f0bce35)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:38.968167 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ffa527-2864-479a-b019-12655fc462b5 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:38.969816 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 213/451] 10.222.0.118 () {56 vars in 1191 bytes} [Thu Jul 14 15:23:38 2022] GET /identity/v3/projects/e864e571207e4b019bbf56cc1f0bce35 => generated 345 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:38.970607 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ffa527-2864-479a-b019-12655fc462b5 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:39.063892 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006e99b5-eff1-4f76-a25f-f3a5ff361e35 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:39.068573 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ffa527-2864-479a-b019-12655fc462b5 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:39.098611 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5283e370-8810-4fa9-b5b7-21fdbf41a9f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:39.099263 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5283e370-8810-4fa9-b5b7-21fdbf41a9f9 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:39.099542 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5283e370-8810-4fa9-b5b7-21fdbf41a9f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:39.099813 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5283e370-8810-4fa9-b5b7-21fdbf41a9f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:39.100649 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5283e370-8810-4fa9-b5b7-21fdbf41a9f9 None admin] RBAC: Adding query filter params (group.id=ed444eb022114f4baa24a7f20c25306f, role.id=4abcf5e5e7cd4b53ae1828fec6550d53, scope.project.id=9d45367dfdd34d7ab5e0b055eda4e88e) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:39.100962 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5283e370-8810-4fa9-b5b7-21fdbf41a9f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:39.102448 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5283e370-8810-4fa9-b5b7-21fdbf41a9f9 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:39.102612 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81acd673-9cea-43df-a544-4604a7c4cf75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:39.103263 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81acd673-9cea-43df-a544-4604a7c4cf75 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:39.103544 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81acd673-9cea-43df-a544-4604a7c4cf75 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:39.103820 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81acd673-9cea-43df-a544-4604a7c4cf75 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:39.104650 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81acd673-9cea-43df-a544-4604a7c4cf75 None admin] RBAC: Adding query filter params (group.id=ed444eb022114f4baa24a7f20c25306f, role.id=f4e85c621e6d4e749149099dd9303934, scope.project.id=9d45367dfdd34d7ab5e0b055eda4e88e) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:39.104959 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81acd673-9cea-43df-a544-4604a7c4cf75 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:39.106415 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81acd673-9cea-43df-a544-4604a7c4cf75 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:39.108395 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 239/452] 10.222.0.118 () {56 vars in 1381 bytes} [Thu Jul 14 15:23:38 2022] GET /identity/v3/role_assignments?group.id=ed444eb022114f4baa24a7f20c25306f&scope.project.id=9d45367dfdd34d7ab5e0b055eda4e88e&role.id=4abcf5e5e7cd4b53ae1828fec6550d53 => generated 613 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:39.109168 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5283e370-8810-4fa9-b5b7-21fdbf41a9f9 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:39.112265 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 214/453] 10.222.0.118 () {56 vars in 1381 bytes} [Thu Jul 14 15:23:38 2022] GET /identity/v3/role_assignments?group.id=ed444eb022114f4baa24a7f20c25306f&scope.project.id=9d45367dfdd34d7ab5e0b055eda4e88e&role.id=f4e85c621e6d4e749149099dd9303934 => generated 613 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:39.158863 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:39.232344 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5283e370-8810-4fa9-b5b7-21fdbf41a9f9 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:39.272607 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50351b47-beaa-40f7-9f5c-c5824a166787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:39.273500 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50351b47-beaa-40f7-9f5c-c5824a166787 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:39.273779 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50351b47-beaa-40f7-9f5c-c5824a166787 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:39.274091 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50351b47-beaa-40f7-9f5c-c5824a166787 None admin] PATH_INFO: `/v3/groups/05b51acbe4844816865b6e5d5581230e` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:39.275592 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50351b47-beaa-40f7-9f5c-c5824a166787 None admin] RBAC: Authorizing `identity:get_group(group_id=05b51acbe4844816865b6e5d5581230e)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:39.277273 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50351b47-beaa-40f7-9f5c-c5824a166787 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:39.282136 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 240/454] 10.222.0.118 () {56 vars in 1185 bytes} [Thu Jul 14 15:23:39 2022] GET /identity/v3/groups/05b51acbe4844816865b6e5d5581230e => generated 230 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:39.285742 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81acd673-9cea-43df-a544-4604a7c4cf75 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:39.329356 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:39.392802 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81acd673-9cea-43df-a544-4604a7c4cf75 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:39.427134 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23cfe8d-e6c5-440f-abf5-178c93a18e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:39.427799 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23cfe8d-e6c5-440f-abf5-178c93a18e9e None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:39.428076 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23cfe8d-e6c5-440f-abf5-178c93a18e9e None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:39.428356 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23cfe8d-e6c5-440f-abf5-178c93a18e9e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:39.429187 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23cfe8d-e6c5-440f-abf5-178c93a18e9e None admin] RBAC: Adding query filter params (group.id=05b51acbe4844816865b6e5d5581230e, role.id=3b880cef7dcf4baf87b50f8610c0c56e, scope.project.id=e864e571207e4b019bbf56cc1f0bce35) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:39.429497 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23cfe8d-e6c5-440f-abf5-178c93a18e9e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:39.430962 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23cfe8d-e6c5-440f-abf5-178c93a18e9e None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:39.436904 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 215/455] 10.222.0.118 () {56 vars in 1381 bytes} [Thu Jul 14 15:23:39 2022] GET /identity/v3/role_assignments?group.id=05b51acbe4844816865b6e5d5581230e&scope.project.id=e864e571207e4b019bbf56cc1f0bce35&role.id=3b880cef7dcf4baf87b50f8610c0c56e => generated 613 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:23:41.929600 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfd53fe-d197-49b0-829e-061dcb9b59ce None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:41.930515 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfd53fe-d197-49b0-829e-061dcb9b59ce None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:41.930973 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfd53fe-d197-49b0-829e-061dcb9b59ce None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:41.932551 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 241/456] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:23:41 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:23:41.937876 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a13eee4-170d-4b13-8a68-bf65a0aba06e None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:41.938692 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a13eee4-170d-4b13-8a68-bf65a0aba06e None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:41.939151 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a13eee4-170d-4b13-8a68-bf65a0aba06e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:41.962961 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-5a13eee4-170d-4b13-8a68-bf65a0aba06e None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:41.964459 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-5a13eee4-170d-4b13-8a68-bf65a0aba06e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:42.048507 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 216/457] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:23:41 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:23:42.098920 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfd53fe-d197-49b0-829e-061dcb9b59ce None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:42.102741 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c4b9a-21aa-461a-8177-6fa1d35205b5 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:42.103024 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c4b9a-21aa-461a-8177-6fa1d35205b5 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:42.103302 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c4b9a-21aa-461a-8177-6fa1d35205b5 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:42.105015 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 217/458] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:23:42 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 14 15:23:42.110157 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d176d1a-f898-4f7c-a6a7-a13086791b21 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:42.110437 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d176d1a-f898-4f7c-a6a7-a13086791b21 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:42.110706 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d176d1a-f898-4f7c-a6a7-a13086791b21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:42.128807 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-4d176d1a-f898-4f7c-a6a7-a13086791b21 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:42.130009 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-4d176d1a-f898-4f7c-a6a7-a13086791b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:42.162328 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:42.230970 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 218/459] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:23:42 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 15:23:42.256443 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d176d1a-f898-4f7c-a6a7-a13086791b21 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:42.292244 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfd53fe-d197-49b0-829e-061dcb9b59ce None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:42.302934 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:42.356993 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d176d1a-f898-4f7c-a6a7-a13086791b21 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:42.360781 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94ffa81-19ef-4596-b3ce-ab43e955dfa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:42.361581 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94ffa81-19ef-4596-b3ce-ab43e955dfa4 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:42.361860 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94ffa81-19ef-4596-b3ce-ab43e955dfa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:42.362160 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94ffa81-19ef-4596-b3ce-ab43e955dfa4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:42.381588 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94ffa81-19ef-4596-b3ce-ab43e955dfa4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:42.383119 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94ffa81-19ef-4596-b3ce-ab43e955dfa4 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:42.393059 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a306a2-33f1-4f33-9b38-5f6f981e06f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:42.394645 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a306a2-33f1-4f33-9b38-5f6f981e06f1 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:42.394976 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a306a2-33f1-4f33-9b38-5f6f981e06f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:42.395253 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a306a2-33f1-4f33-9b38-5f6f981e06f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:42.406667 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a306a2-33f1-4f33-9b38-5f6f981e06f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:42.408132 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a306a2-33f1-4f33-9b38-5f6f981e06f1 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:42.426759 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-56a306a2-33f1-4f33-9b38-5f6f981e06f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:23:42.426759 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:42.426759 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:42.426759 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:42.426759 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:42.426759 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:42.426759 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:42.426759 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:42.426759 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:42.426759 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:42.426759 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:42.426759 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:42.426759 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:23:42.426759 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:23:42.426759 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:23:42.427645 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:23:42.427645 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:42.427645 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:42.427645 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:42.427645 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:42.427645 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:42.427645 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:42.427645 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:42.427645 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:42.427645 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:42.427645 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:42.427645 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:42.427645 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:42.427645 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:42.427645 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:42.427645 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:42.427645 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:42.428460 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:23:42.428460 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:23:42.428460 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:23:42.428460 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:23:42.428751 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-a94ffa81-19ef-4596-b3ce-ab43e955dfa4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:23:42.428751 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:42.428751 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:42.428751 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:42.428751 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:42.428751 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:42.428751 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:42.428751 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:42.428751 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:42.428751 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:42.428751 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:42.428751 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:42.428751 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:23:42.428751 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:23:42.428751 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:23:42.429473 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:23:42.429473 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:42.429473 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:42.429473 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:42.429473 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:42.429473 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:42.429473 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:42.429473 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:42.429473 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:42.429473 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:42.429473 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:42.429473 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:42.429473 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:42.429473 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:42.429473 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:42.429473 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:42.429473 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:42.431522 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:23:42.431522 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:23:42.431522 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:23:42.431522 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:23:42.431522 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 242/461] 10.222.0.118 () {56 vars in 1113 bytes} [Thu Jul 14 15:23:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:42.437983 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 219/461] 10.222.0.118 () {56 vars in 1113 bytes} [Thu Jul 14 15:23:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:23:42.438212 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94ffa81-19ef-4596-b3ce-ab43e955dfa4 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:42.438366 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a306a2-33f1-4f33-9b38-5f6f981e06f1 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:42.454324 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:42.540620 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a306a2-33f1-4f33-9b38-5f6f981e06f1 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:42.576900 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94ffa81-19ef-4596-b3ce-ab43e955dfa4 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:42.578705 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b5d169-fe7f-4348-811e-e1230eb49cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:42.579435 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b5d169-fe7f-4348-811e-e1230eb49cb9 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:42.579773 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b5d169-fe7f-4348-811e-e1230eb49cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:42.580055 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b5d169-fe7f-4348-811e-e1230eb49cb9 None admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:42.580786 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b5d169-fe7f-4348-811e-e1230eb49cb9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:42.581089 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b5d169-fe7f-4348-811e-e1230eb49cb9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:42.582551 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b5d169-fe7f-4348-811e-e1230eb49cb9 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:42.594584 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 220/462] 10.222.0.118 () {56 vars in 1114 bytes} [Thu Jul 14 15:23:42 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:42.595952 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb33751-efb2-4fcb-b3e9-c019b4bc3855 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:42.596237 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb33751-efb2-4fcb-b3e9-c019b4bc3855 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:42.596509 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb33751-efb2-4fcb-b3e9-c019b4bc3855 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:42.602031 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 221/463] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:23:42 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:23:42.602031 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffeab14-de38-444c-88b9-4b74df87fbbf None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:42.602031 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffeab14-de38-444c-88b9-4b74df87fbbf None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:42.602031 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffeab14-de38-444c-88b9-4b74df87fbbf None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:42.602031 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 222/464] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:23:42 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:23:42.602775 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffeab14-de38-444c-88b9-4b74df87fbbf None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:42.625216 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cc59ba-db7b-4267-97c2-37432e28fb80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:42.625872 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cc59ba-db7b-4267-97c2-37432e28fb80 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:42.626289 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cc59ba-db7b-4267-97c2-37432e28fb80 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:42.626441 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cc59ba-db7b-4267-97c2-37432e28fb80 None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:42.627142 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cc59ba-db7b-4267-97c2-37432e28fb80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:42.627449 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cc59ba-db7b-4267-97c2-37432e28fb80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:42.629361 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cc59ba-db7b-4267-97c2-37432e28fb80 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:42.641411 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 243/465] 10.222.0.118 () {56 vars in 1114 bytes} [Thu Jul 14 15:23:42 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:42.642714 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c672b84d-4311-4fd4-8b24-c01185787c44 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:42.642999 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c672b84d-4311-4fd4-8b24-c01185787c44 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:42.643268 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c672b84d-4311-4fd4-8b24-c01185787c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:42.659053 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-c672b84d-4311-4fd4-8b24-c01185787c44 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:42.660310 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-c672b84d-4311-4fd4-8b24-c01185787c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:42.674776 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:42.691273 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:42.723579 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffeab14-de38-444c-88b9-4b74df87fbbf None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:42.739848 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 244/466] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:23:42 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:23:42.747277 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd246bbb-e4f2-42a8-b13e-accb83d17cf4 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:42.747566 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd246bbb-e4f2-42a8-b13e-accb83d17cf4 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:42.747853 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd246bbb-e4f2-42a8-b13e-accb83d17cf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:42.764178 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d225b7f-3a1c-4a27-8750-9c86b721f0b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:42.764842 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d225b7f-3a1c-4a27-8750-9c86b721f0b6 None admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:42.764943 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-cd246bbb-e4f2-42a8-b13e-accb83d17cf4 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:42.765121 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d225b7f-3a1c-4a27-8750-9c86b721f0b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:42.765388 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d225b7f-3a1c-4a27-8750-9c86b721f0b6 None admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:42.766112 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d225b7f-3a1c-4a27-8750-9c86b721f0b6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:42.766224 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-cd246bbb-e4f2-42a8-b13e-accb83d17cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:42.767559 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d225b7f-3a1c-4a27-8750-9c86b721f0b6 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:42.788992 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 223/467] 10.222.0.118 () {60 vars in 1137 bytes} [Thu Jul 14 15:23:42 2022] POST /identity/v3/users => generated 247 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:23:42.790138 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d225b7f-3a1c-4a27-8750-9c86b721f0b6 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:42.866080 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 245/468] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:23:42 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:23:42.866080 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd246bbb-e4f2-42a8-b13e-accb83d17cf4 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:42.938987 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d225b7f-3a1c-4a27-8750-9c86b721f0b6 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:42.955394 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:42.977586 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd246bbb-e4f2-42a8-b13e-accb83d17cf4 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:42.981661 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:42.992113 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d822ca-0ba8-422b-aaaf-31583bf21bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:42.992786 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d822ca-0ba8-422b-aaaf-31583bf21bdb None admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:42.993063 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d822ca-0ba8-422b-aaaf-31583bf21bdb None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:42.993337 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d822ca-0ba8-422b-aaaf-31583bf21bdb None admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:42.994069 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d822ca-0ba8-422b-aaaf-31583bf21bdb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:42.995500 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d822ca-0ba8-422b-aaaf-31583bf21bdb None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:43.018804 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 224/469] 10.222.0.118 () {60 vars in 1137 bytes} [Thu Jul 14 15:23:42 2022] POST /identity/v3/users => generated 249 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:23:43.018996 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d822ca-0ba8-422b-aaaf-31583bf21bdb None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:43.023697 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cead0459-22ff-4d5a-a150-b7020d9d547d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:43.024595 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cead0459-22ff-4d5a-a150-b7020d9d547d None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:43.024870 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cead0459-22ff-4d5a-a150-b7020d9d547d None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:43.025144 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cead0459-22ff-4d5a-a150-b7020d9d547d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:43.038992 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cead0459-22ff-4d5a-a150-b7020d9d547d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:43.041278 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cead0459-22ff-4d5a-a150-b7020d9d547d None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:43.066920 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-cead0459-22ff-4d5a-a150-b7020d9d547d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:23:43.066920 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:43.066920 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:43.066920 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:43.066920 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:43.066920 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:43.066920 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:43.066920 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:43.066920 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:43.066920 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:43.066920 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:43.066920 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:43.066920 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:23:43.066920 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:23:43.066920 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:23:43.067822 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:23:43.067822 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:43.067822 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:43.067822 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:43.067822 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:43.067822 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:43.067822 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:43.067822 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:43.067822 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:43.067822 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:43.067822 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:43.067822 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:43.067822 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:43.067822 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:43.067822 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:43.067822 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:43.067822 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:43.068637 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:23:43.068637 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:23:43.068637 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:23:43.068637 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:23:43.068637 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 246/470] 10.222.0.118 () {56 vars in 1113 bytes} [Thu Jul 14 15:23:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:43.075033 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cead0459-22ff-4d5a-a150-b7020d9d547d None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:43.157796 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d822ca-0ba8-422b-aaaf-31583bf21bdb None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:43.211815 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ec0d7e-f936-4f47-a5bc-33b386e4c4a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:43.212634 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ec0d7e-f936-4f47-a5bc-33b386e4c4a0 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:43.212921 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ec0d7e-f936-4f47-a5bc-33b386e4c4a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:43.213178 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ec0d7e-f936-4f47-a5bc-33b386e4c4a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:43.220584 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cead0459-22ff-4d5a-a150-b7020d9d547d None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:43.227725 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ec0d7e-f936-4f47-a5bc-33b386e4c4a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:43.229217 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ec0d7e-f936-4f47-a5bc-33b386e4c4a0 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:43.250404 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-b9ec0d7e-f936-4f47-a5bc-33b386e4c4a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:23:43.250404 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:43.250404 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:43.250404 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:43.250404 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:43.250404 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:43.250404 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:43.250404 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:43.250404 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:43.250404 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:43.250404 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:43.250404 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:43.250404 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:23:43.250404 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:23:43.250404 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:23:43.251267 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:23:43.251267 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:43.251267 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:43.251267 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:43.251267 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:43.251267 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:43.251267 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:43.251267 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:43.251267 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:43.251267 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:43.251267 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:43.251267 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:43.251267 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:43.251267 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:43.251267 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:43.251267 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:43.251267 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:43.252733 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:23:43.252733 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:23:43.252733 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:23:43.252733 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:23:43.255081 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 225/471] 10.222.0.118 () {56 vars in 1113 bytes} [Thu Jul 14 15:23:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:43.256958 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:43.261407 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ec0d7e-f936-4f47-a5bc-33b386e4c4a0 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:43.262321 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22f8a2a-ac61-4ffa-8e20-d33bac450373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:43.263262 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f8a2a-ac61-4ffa-8e20-d33bac450373 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:43.263752 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f8a2a-ac61-4ffa-8e20-d33bac450373 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:43.264313 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f8a2a-ac61-4ffa-8e20-d33bac450373 None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:43.265153 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22f8a2a-ac61-4ffa-8e20-d33bac450373 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:43.265823 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22f8a2a-ac61-4ffa-8e20-d33bac450373 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:43.268290 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22f8a2a-ac61-4ffa-8e20-d33bac450373 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:43.283765 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 247/472] 10.222.0.118 () {56 vars in 1114 bytes} [Thu Jul 14 15:23:43 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:43.289678 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22f8a2a-ac61-4ffa-8e20-d33bac450373 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:43.312295 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:43.381434 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ec0d7e-f936-4f47-a5bc-33b386e4c4a0 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:43.395100 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22f8a2a-ac61-4ffa-8e20-d33bac450373 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:43.420433 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4fcfd1-ec95-48a7-8dcc-e87dfc058a03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:43.421493 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4fcfd1-ec95-48a7-8dcc-e87dfc058a03 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:43.421944 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4fcfd1-ec95-48a7-8dcc-e87dfc058a03 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:43.422499 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4fcfd1-ec95-48a7-8dcc-e87dfc058a03 None admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:43.423401 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4fcfd1-ec95-48a7-8dcc-e87dfc058a03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:43.423980 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4fcfd1-ec95-48a7-8dcc-e87dfc058a03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:43.425790 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4fcfd1-ec95-48a7-8dcc-e87dfc058a03 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:43.430647 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1f8662-2c15-4ea0-ba89-101cda7b9a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:43.431400 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1f8662-2c15-4ea0-ba89-101cda7b9a5e None admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:43.431744 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1f8662-2c15-4ea0-ba89-101cda7b9a5e None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:43.432076 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1f8662-2c15-4ea0-ba89-101cda7b9a5e None admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:43.432905 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1f8662-2c15-4ea0-ba89-101cda7b9a5e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:43.435686 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1f8662-2c15-4ea0-ba89-101cda7b9a5e None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:43.442633 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 226/473] 10.222.0.118 () {56 vars in 1114 bytes} [Thu Jul 14 15:23:43 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:43.448221 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4fcfd1-ec95-48a7-8dcc-e87dfc058a03 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:43.463975 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 248/474] 10.222.0.118 () {60 vars in 1137 bytes} [Thu Jul 14 15:23:43 2022] POST /identity/v3/users => generated 249 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:23:43.479921 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185d9e4d-bc79-44e1-b27c-2c781293b2ee None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:43.480235 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185d9e4d-bc79-44e1-b27c-2c781293b2ee None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:43.480487 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185d9e4d-bc79-44e1-b27c-2c781293b2ee None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:43.482269 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 249/475] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:23:43 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:23:43.488571 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33f6a14-a83e-44ad-b33b-74514b34cf88 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:43.488936 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33f6a14-a83e-44ad-b33b-74514b34cf88 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:43.489130 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33f6a14-a83e-44ad-b33b-74514b34cf88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:43.517332 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-d33f6a14-a83e-44ad-b33b-74514b34cf88 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:43.519143 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-d33f6a14-a83e-44ad-b33b-74514b34cf88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:43.586679 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:43.613378 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:43.619042 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 250/476] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:23:43 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 15:23:43.621310 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4fcfd1-ec95-48a7-8dcc-e87dfc058a03 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:43.658281 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ca8bda-23ad-4b29-a5ba-92101bcafa41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:43.659137 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ca8bda-23ad-4b29-a5ba-92101bcafa41 None admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:43.659823 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ca8bda-23ad-4b29-a5ba-92101bcafa41 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:43.660195 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ca8bda-23ad-4b29-a5ba-92101bcafa41 None admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:43.661055 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ca8bda-23ad-4b29-a5ba-92101bcafa41 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:43.662703 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ca8bda-23ad-4b29-a5ba-92101bcafa41 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:43.674665 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33f6a14-a83e-44ad-b33b-74514b34cf88 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:43.692534 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 227/477] 10.222.0.118 () {60 vars in 1137 bytes} [Thu Jul 14 15:23:43 2022] POST /identity/v3/users => generated 250 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:23:43.797652 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33f6a14-a83e-44ad-b33b-74514b34cf88 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:43.841185 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9fa790-bd7a-4017-8f1f-2bca61b569df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:43.841860 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9fa790-bd7a-4017-8f1f-2bca61b569df None admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:43.842181 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9fa790-bd7a-4017-8f1f-2bca61b569df None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:43.842461 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9fa790-bd7a-4017-8f1f-2bca61b569df None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:43.843298 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9fa790-bd7a-4017-8f1f-2bca61b569df None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:43.844791 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9fa790-bd7a-4017-8f1f-2bca61b569df None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:43.856911 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.sql.core [None req-6f9fa790-bd7a-4017-8f1f-2bca61b569df None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 14 15:23:43.856911 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 14 15:23:43.856911 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [parameters: {'id': '35e2cca9b846447db3a32044d9de7ffa', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 14 15:23:43.856911 dv-cinder-826510-8-smb devstack@keystone.service[80344]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80344) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 14 15:23:43.875771 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-6f9fa790-bd7a-4017-8f1f-2bca61b569df None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 14 15:23:43.875771 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:43.875771 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 14 15:23:43.875771 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 14 15:23:43.875771 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 14 15:23:43.875771 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 14 15:23:43.875771 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 14 15:23:43.875771 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application result = self._query(query) Jul 14 15:23:43.875771 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 14 15:23:43.875771 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application conn.query(q) Jul 14 15:23:43.875771 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 14 15:23:43.875771 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 14 15:23:43.875771 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 14 15:23:43.875771 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application result.read() Jul 14 15:23:43.875771 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 14 15:23:43.876661 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 14 15:23:43.876661 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 14 15:23:43.876661 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 14 15:23:43.876661 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 14 15:23:43.876661 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 14 15:23:43.876661 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 14 15:23:43.876661 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 14 15:23:43.876661 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 14 15:23:43.876661 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:23:43.876661 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 14 15:23:43.876661 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:23:43.876661 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:43.876661 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 14 15:23:43.876661 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 14 15:23:43.876661 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 14 15:23:43.876661 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return ref.to_dict() Jul 14 15:23:43.876661 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 14 15:23:43.876661 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application next(self.gen) Jul 14 15:23:43.877586 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 14 15:23:43.877586 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application yield resource Jul 14 15:23:43.877586 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 14 15:23:43.877586 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application next(self.gen) Jul 14 15:23:43.877586 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 14 15:23:43.877586 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application self.session.rollback() Jul 14 15:23:43.877586 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 15:23:43.877586 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application self.force_reraise() Jul 14 15:23:43.877586 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 15:23:43.877586 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise self.value Jul 14 15:23:43.877586 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 14 15:23:43.877586 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 14 15:23:43.877586 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 14 15:23:43.877586 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application session.commit() Jul 14 15:23:43.877586 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 14 15:23:43.877586 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 14 15:23:43.877586 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 14 15:23:43.878484 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application self._prepare_impl() Jul 14 15:23:43.878484 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 14 15:23:43.878484 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application self.session.flush() Jul 14 15:23:43.878484 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 14 15:23:43.878484 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application self._flush(objects) Jul 14 15:23:43.878484 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 14 15:23:43.878484 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 14 15:23:43.878484 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 14 15:23:43.878484 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application compat.raise_( Jul 14 15:23:43.878484 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 14 15:23:43.878484 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception Jul 14 15:23:43.878484 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 14 15:23:43.878484 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application flush_context.execute() Jul 14 15:23:43.878484 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 14 15:23:43.878484 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rec.execute(self) Jul 14 15:23:43.878484 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 14 15:23:43.878484 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 14 15:23:43.879338 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 14 15:23:43.879338 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 14 15:23:43.879338 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 14 15:23:43.879338 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 14 15:23:43.879338 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 14 15:23:43.879338 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 14 15:23:43.879338 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 14 15:23:43.879338 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 14 15:23:43.879338 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 14 15:23:43.879338 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 14 15:23:43.879338 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 14 15:23:43.879338 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 14 15:23:43.879338 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 14 15:23:43.879338 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 14 15:23:43.879338 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 14 15:23:43.879338 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception Jul 14 15:23:43.880145 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 14 15:23:43.880145 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 14 15:23:43.880145 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 14 15:23:43.880145 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 14 15:23:43.880145 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 14 15:23:43.880145 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application result = self._query(query) Jul 14 15:23:43.880145 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 14 15:23:43.880145 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application conn.query(q) Jul 14 15:23:43.880145 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 14 15:23:43.880145 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 14 15:23:43.880145 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 14 15:23:43.880145 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application result.read() Jul 14 15:23:43.880145 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 14 15:23:43.880145 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 14 15:23:43.880145 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 14 15:23:43.880145 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 14 15:23:43.881167 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 14 15:23:43.881167 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 14 15:23:43.881167 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 14 15:23:43.881167 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 14 15:23:43.881167 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 14 15:23:43.881167 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 14 15:23:43.881167 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [parameters: {'id': '35e2cca9b846447db3a32044d9de7ffa', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 14 15:23:43.881167 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 14 15:23:43.881167 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:23:43.881167 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 15:23:43.881167 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:23:43.881167 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:43.881167 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:43.881167 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:43.881167 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:43.881167 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:43.881950 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:43.881950 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:43.881950 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:43.881950 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:43.881950 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:43.881950 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:43.881950 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 14 15:23:43.881950 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 14 15:23:43.881950 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:43.881950 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:43.881950 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 14 15:23:43.881950 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 14 15:23:43.881950 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 14 15:23:43.881950 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 14 15:23:43.881950 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 14 15:23:43.881950 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:23:43.886999 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 251/478] 10.222.0.118 () {60 vars in 1136 bytes} [Thu Jul 14 15:23:43 2022] POST /identity/v3/roles => generated 144 bytes in 204 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:43.887135 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ca8bda-23ad-4b29-a5ba-92101bcafa41 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:44.004184 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ca8bda-23ad-4b29-a5ba-92101bcafa41 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:44.044051 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2446186b-6ea7-44a4-91fc-f371b5c4fe11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:44.044904 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446186b-6ea7-44a4-91fc-f371b5c4fe11 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:44.045187 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446186b-6ea7-44a4-91fc-f371b5c4fe11 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:44.045460 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446186b-6ea7-44a4-91fc-f371b5c4fe11 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:44.062752 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2446186b-6ea7-44a4-91fc-f371b5c4fe11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:23:44.070924 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-2446186b-6ea7-44a4-91fc-f371b5c4fe11 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 15:23:44.070924 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:44.070924 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:44.070924 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:44.070924 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:44.070924 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:44.070924 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:44.070924 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:44.070924 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:44.070924 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:44.070924 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:44.070924 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:44.070924 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:23:44.070924 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:23:44.070924 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:23:44.070924 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:23:44.071801 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:23:44.071801 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:23:44.071801 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:23:44.071801 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:23:44.071801 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:44.071801 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:44.071801 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:44.071801 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:44.071801 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:44.071801 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:44.071801 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:44.071801 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:44.071801 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:44.071801 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:44.071801 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:44.071801 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:44.072571 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:44.072571 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:44.072571 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:44.072571 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:44.072571 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:23:44.072571 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:23:44.072571 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:23:44.072571 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:23:44.072571 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:23:44.072571 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:23:44.072571 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 15:23:44.072571 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:23:44.072571 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 228/479] 10.222.0.118 () {56 vars in 1119 bytes} [Thu Jul 14 15:23:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:44.077704 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9fa790-bd7a-4017-8f1f-2bca61b569df None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:44.128237 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:44.205610 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9fa790-bd7a-4017-8f1f-2bca61b569df None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:44.253419 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8063ee-00e0-41cf-ad74-da44b57b2bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:44.254126 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8063ee-00e0-41cf-ad74-da44b57b2bee None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:44.254466 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8063ee-00e0-41cf-ad74-da44b57b2bee None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:44.254684 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8063ee-00e0-41cf-ad74-da44b57b2bee None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:44.255690 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8063ee-00e0-41cf-ad74-da44b57b2bee None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:44.256008 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8063ee-00e0-41cf-ad74-da44b57b2bee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:44.257384 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8063ee-00e0-41cf-ad74-da44b57b2bee None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:44.266240 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 252/480] 10.222.0.118 () {56 vars in 1116 bytes} [Thu Jul 14 15:23:44 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:45.657465 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64f576c-f4c9-45ff-ac45-3992cb9ec8be None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:45.658035 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64f576c-f4c9-45ff-ac45-3992cb9ec8be None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:45.658035 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64f576c-f4c9-45ff-ac45-3992cb9ec8be None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:45.660270 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 229/481] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:23:45 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:23:45.665221 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24954d81-2d53-4f86-8dbc-5f63c8a986dd None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:45.665662 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24954d81-2d53-4f86-8dbc-5f63c8a986dd None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:45.665830 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24954d81-2d53-4f86-8dbc-5f63c8a986dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:45.672802 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbe2362-4a77-4974-84b3-d7b8982bdc80 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:45.673085 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbe2362-4a77-4974-84b3-d7b8982bdc80 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:45.673363 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbe2362-4a77-4974-84b3-d7b8982bdc80 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:45.675117 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 230/482] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:23:45 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 14 15:23:45.679771 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b872236-a616-4bc4-9031-42b73e9163bd None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:45.680058 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b872236-a616-4bc4-9031-42b73e9163bd None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:45.680335 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b872236-a616-4bc4-9031-42b73e9163bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:45.701257 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-24954d81-2d53-4f86-8dbc-5f63c8a986dd None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:45.702495 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-24954d81-2d53-4f86-8dbc-5f63c8a986dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:45.710816 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-6b872236-a616-4bc4-9031-42b73e9163bd None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:45.712034 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-6b872236-a616-4bc4-9031-42b73e9163bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:45.742351 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:45.818077 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 231/483] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:23:45 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 15:23:45.838471 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 253/484] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:23:45 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:23:45.853671 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b872236-a616-4bc4-9031-42b73e9163bd None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:45.867659 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24954d81-2d53-4f86-8dbc-5f63c8a986dd None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:45.931705 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:46.036599 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b872236-a616-4bc4-9031-42b73e9163bd None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:46.044161 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24954d81-2d53-4f86-8dbc-5f63c8a986dd None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:46.083764 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f1e2cc-6c54-45cf-a42e-d503806af0f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:46.084570 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f1e2cc-6c54-45cf-a42e-d503806af0f2 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:46.084847 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f1e2cc-6c54-45cf-a42e-d503806af0f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:46.085114 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f1e2cc-6c54-45cf-a42e-d503806af0f2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:46.098900 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f1e2cc-6c54-45cf-a42e-d503806af0f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:23:46.106623 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-28f1e2cc-6c54-45cf-a42e-d503806af0f2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:23:46.106623 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:46.106623 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:46.106623 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:46.106623 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:46.106623 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:46.106623 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:46.106623 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:46.106623 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:46.106623 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:46.106623 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:46.106623 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:46.106623 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:23:46.106623 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:23:46.106623 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:23:46.106623 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:23:46.107505 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:23:46.107505 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:23:46.107505 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:23:46.107505 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:23:46.107505 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:46.107505 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:46.107505 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:46.107505 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:46.107505 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:46.107505 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:46.107505 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:46.107505 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:46.107505 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:46.107505 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:46.107505 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:46.107505 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:46.108282 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:46.108282 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:46.108282 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:46.108282 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:46.108282 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:23:46.108282 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:23:46.108282 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:23:46.108282 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:23:46.108282 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:23:46.108282 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:23:46.108282 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:23:46.108282 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:23:46.110215 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 254/485] 10.222.0.118 () {56 vars in 1107 bytes} [Thu Jul 14 15:23:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:46.118331 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29d7728-c30f-489e-9c93-a0f3f9fb72c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:46.119146 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d7728-c30f-489e-9c93-a0f3f9fb72c5 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:46.119540 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d7728-c30f-489e-9c93-a0f3f9fb72c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:46.120438 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f1e2cc-6c54-45cf-a42e-d503806af0f2 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:46.121105 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d7728-c30f-489e-9c93-a0f3f9fb72c5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:46.149907 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29d7728-c30f-489e-9c93-a0f3f9fb72c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:23:46.161226 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-e29d7728-c30f-489e-9c93-a0f3f9fb72c5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:23:46.161226 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:46.161226 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:46.161226 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:46.161226 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:46.161226 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:46.161226 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:46.161226 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:46.161226 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:46.161226 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:46.161226 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:46.161226 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:46.161226 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:23:46.161226 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:23:46.161226 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:23:46.161226 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:23:46.162188 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:23:46.162188 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:23:46.162188 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:23:46.162188 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:23:46.162188 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:46.162188 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:46.162188 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:46.162188 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:46.162188 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:46.162188 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:46.162188 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:46.162188 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:46.162188 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:46.162188 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:46.162188 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:46.162188 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:46.162969 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:46.162969 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:46.162969 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:46.162969 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:46.162969 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:23:46.162969 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:23:46.162969 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:23:46.162969 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:23:46.162969 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:23:46.162969 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:23:46.162969 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:23:46.162969 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:23:46.162969 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 232/486] 10.222.0.118 () {56 vars in 1107 bytes} [Thu Jul 14 15:23:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:46.170448 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29d7728-c30f-489e-9c93-a0f3f9fb72c5 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:46.179433 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:46.275159 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:46.282086 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f1e2cc-6c54-45cf-a42e-d503806af0f2 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:46.302095 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29d7728-c30f-489e-9c93-a0f3f9fb72c5 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:46.317693 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ac0faa-0096-4ea1-b470-b92471d283e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:46.318421 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ac0faa-0096-4ea1-b470-b92471d283e2 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:46.318713 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ac0faa-0096-4ea1-b470-b92471d283e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:46.319070 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ac0faa-0096-4ea1-b470-b92471d283e2 None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:46.319893 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ac0faa-0096-4ea1-b470-b92471d283e2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:46.320202 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ac0faa-0096-4ea1-b470-b92471d283e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:46.321593 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ac0faa-0096-4ea1-b470-b92471d283e2 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:46.333646 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 255/487] 10.222.0.118 () {56 vars in 1108 bytes} [Thu Jul 14 15:23:46 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:23:46.333646 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d50bfb-3da5-40cc-8a55-53965231fea6 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:46.333646 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d50bfb-3da5-40cc-8a55-53965231fea6 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:46.333646 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d50bfb-3da5-40cc-8a55-53965231fea6 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:46.333646 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 256/488] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:23:46 2022] GET /identity => generated 271 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:23:46.333646 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605ce0c7-b67e-4ae9-9e01-7834bc2188c0 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:46.334119 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605ce0c7-b67e-4ae9-9e01-7834bc2188c0 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:46.334119 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605ce0c7-b67e-4ae9-9e01-7834bc2188c0 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:46.339343 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 257/489] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:23:46 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:23:46.339991 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605ce0c7-b67e-4ae9-9e01-7834bc2188c0 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:46.345253 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db2b85e-5122-49db-a589-2046bfca18f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:46.345933 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db2b85e-5122-49db-a589-2046bfca18f0 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:46.346237 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db2b85e-5122-49db-a589-2046bfca18f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:46.346511 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db2b85e-5122-49db-a589-2046bfca18f0 None admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:46.347373 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db2b85e-5122-49db-a589-2046bfca18f0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:46.347681 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db2b85e-5122-49db-a589-2046bfca18f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:46.349057 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db2b85e-5122-49db-a589-2046bfca18f0 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:46.362936 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 233/490] 10.222.0.118 () {56 vars in 1108 bytes} [Thu Jul 14 15:23:46 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:46.362936 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ada44e-1a3d-406e-9e47-777ba2fb2c3d None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:46.362936 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ada44e-1a3d-406e-9e47-777ba2fb2c3d None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:46.362936 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ada44e-1a3d-406e-9e47-777ba2fb2c3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:46.383736 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-a4ada44e-1a3d-406e-9e47-777ba2fb2c3d None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:46.385551 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-a4ada44e-1a3d-406e-9e47-777ba2fb2c3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:46.451776 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605ce0c7-b67e-4ae9-9e01-7834bc2188c0 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:46.461666 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:46.469615 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 234/491] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:23:46 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:23:46.478304 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b04dad2-f4f8-429c-8d09-418fe35bdaa2 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:46.478304 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b04dad2-f4f8-429c-8d09-418fe35bdaa2 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:46.478304 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b04dad2-f4f8-429c-8d09-418fe35bdaa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:46.493884 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d87aa02-9b51-42df-9664-17b252f05fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:46.494794 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d87aa02-9b51-42df-9664-17b252f05fc4 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:46.495140 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d87aa02-9b51-42df-9664-17b252f05fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:46.495470 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-2b04dad2-f4f8-429c-8d09-418fe35bdaa2 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:46.495575 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d87aa02-9b51-42df-9664-17b252f05fc4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:46.496660 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-2b04dad2-f4f8-429c-8d09-418fe35bdaa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:46.507484 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d87aa02-9b51-42df-9664-17b252f05fc4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:46.509042 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d87aa02-9b51-42df-9664-17b252f05fc4 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:46.526506 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-2d87aa02-9b51-42df-9664-17b252f05fc4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:23:46.526506 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:46.526506 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:46.526506 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:46.526506 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:46.526506 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:46.526506 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:46.526506 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:46.526506 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:46.526506 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:46.526506 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:46.526506 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:46.526506 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:23:46.526506 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:23:46.526506 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:23:46.527359 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:23:46.527359 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:46.527359 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:46.527359 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:46.527359 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:46.527359 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:46.527359 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:46.527359 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:46.527359 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:46.527359 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:46.527359 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:46.527359 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:46.527359 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:46.527359 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:46.527359 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:46.527359 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:46.527359 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:46.528184 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:23:46.528184 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:23:46.528184 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:23:46.528184 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:23:46.528184 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 258/492] 10.222.0.118 () {56 vars in 1113 bytes} [Thu Jul 14 15:23:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:46.528942 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d87aa02-9b51-42df-9664-17b252f05fc4 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:46.539396 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:46.573998 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 235/493] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:23:46 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:23:46.573998 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b04dad2-f4f8-429c-8d09-418fe35bdaa2 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:46.642963 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d87aa02-9b51-42df-9664-17b252f05fc4 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:46.677296 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b04dad2-f4f8-429c-8d09-418fe35bdaa2 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:46.679622 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867e86bb-f386-470d-a124-b18a501ef301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:46.680408 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e86bb-f386-470d-a124-b18a501ef301 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:46.680688 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e86bb-f386-470d-a124-b18a501ef301 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:46.680953 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e86bb-f386-470d-a124-b18a501ef301 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:46.692437 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867e86bb-f386-470d-a124-b18a501ef301 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:46.693899 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867e86bb-f386-470d-a124-b18a501ef301 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:46.703278 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:46.712561 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-867e86bb-f386-470d-a124-b18a501ef301 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:23:46.712561 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:46.712561 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:46.712561 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:46.712561 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:46.712561 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:46.712561 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:46.712561 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:46.712561 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:46.712561 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:46.712561 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:46.712561 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:46.712561 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:23:46.712561 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:23:46.712561 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:23:46.713437 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:23:46.713437 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:46.713437 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:46.713437 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:46.713437 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:46.713437 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:46.713437 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:46.713437 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:46.713437 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:46.713437 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:46.713437 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:46.713437 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:46.713437 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:46.713437 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:46.713437 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:46.713437 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:46.713437 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:46.714315 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:23:46.714315 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:23:46.714315 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:23:46.714315 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:23:46.714315 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 259/494] 10.222.0.118 () {56 vars in 1113 bytes} [Thu Jul 14 15:23:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:46.714569 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867e86bb-f386-470d-a124-b18a501ef301 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:46.729588 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4697cc72-b47b-4d54-ab9d-70286d94dde6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:46.730423 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4697cc72-b47b-4d54-ab9d-70286d94dde6 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:46.730706 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4697cc72-b47b-4d54-ab9d-70286d94dde6 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:46.730978 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4697cc72-b47b-4d54-ab9d-70286d94dde6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:46.742869 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4697cc72-b47b-4d54-ab9d-70286d94dde6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:23:46.751035 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-4697cc72-b47b-4d54-ab9d-70286d94dde6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:23:46.751035 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:46.751035 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:46.751035 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:46.751035 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:46.751035 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:46.751035 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:46.751035 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:46.751035 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:46.751035 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:46.751035 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:46.751035 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:46.751035 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:23:46.751035 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:23:46.751035 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:23:46.751035 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:23:46.751881 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:23:46.751881 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:23:46.751881 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:23:46.751881 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:23:46.751881 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:46.751881 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:46.751881 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:46.751881 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:46.751881 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:46.751881 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:46.751881 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:46.751881 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:46.751881 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:46.751881 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:46.751881 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:46.751881 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:46.757832 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:46.757832 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:46.757832 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:46.757832 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:46.757832 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:23:46.757832 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:23:46.757832 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:23:46.757832 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:23:46.757832 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:23:46.757832 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:23:46.757832 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:23:46.757832 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:23:46.757832 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 236/495] 10.222.0.118 () {56 vars in 1107 bytes} [Thu Jul 14 15:23:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:46.757832 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4697cc72-b47b-4d54-ab9d-70286d94dde6 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:46.785347 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:46.831698 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867e86bb-f386-470d-a124-b18a501ef301 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:46.867119 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbca4cf3-8b0b-45ba-bd27-5576b8c8b5ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:46.867782 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca4cf3-8b0b-45ba-bd27-5576b8c8b5ef None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:46.868059 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca4cf3-8b0b-45ba-bd27-5576b8c8b5ef None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:46.868330 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca4cf3-8b0b-45ba-bd27-5576b8c8b5ef None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:46.869041 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbca4cf3-8b0b-45ba-bd27-5576b8c8b5ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:46.869348 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbca4cf3-8b0b-45ba-bd27-5576b8c8b5ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:46.870749 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbca4cf3-8b0b-45ba-bd27-5576b8c8b5ef None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:46.872359 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4697cc72-b47b-4d54-ab9d-70286d94dde6 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:46.883861 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 260/496] 10.222.0.118 () {56 vars in 1114 bytes} [Thu Jul 14 15:23:46 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:46.884674 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbca4cf3-8b0b-45ba-bd27-5576b8c8b5ef None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:46.916641 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5e5127-405d-432a-8a89-0b3b7bfa9652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:46.917452 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5e5127-405d-432a-8a89-0b3b7bfa9652 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:46.917710 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5e5127-405d-432a-8a89-0b3b7bfa9652 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:46.918000 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5e5127-405d-432a-8a89-0b3b7bfa9652 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:46.928806 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5e5127-405d-432a-8a89-0b3b7bfa9652 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:23:46.936429 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-1f5e5127-405d-432a-8a89-0b3b7bfa9652 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:23:46.936429 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:46.936429 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:46.936429 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:46.936429 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:46.936429 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:46.936429 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:46.936429 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:46.936429 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:46.936429 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:46.936429 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:46.936429 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:46.936429 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:23:46.936429 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:23:46.936429 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:23:46.936429 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:23:46.937283 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:23:46.937283 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:23:46.937283 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:23:46.937283 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:23:46.937283 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:46.937283 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:46.937283 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:46.937283 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:46.937283 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:46.937283 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:46.937283 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:46.937283 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:46.937283 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:46.937283 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:46.937283 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:46.937283 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:46.938121 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:46.938121 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:46.938121 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:46.938121 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:46.938121 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:23:46.938121 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:23:46.938121 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:23:46.938121 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:23:46.938121 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:23:46.938121 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:23:46.938121 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:23:46.938121 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:23:46.938121 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 237/497] 10.222.0.118 () {56 vars in 1107 bytes} [Thu Jul 14 15:23:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:46.939236 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5e5127-405d-432a-8a89-0b3b7bfa9652 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:46.986617 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:47.004288 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbca4cf3-8b0b-45ba-bd27-5576b8c8b5ef None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:47.027737 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:47.043536 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d47377-43d8-48b9-b76e-feb4a854bc18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:47.044549 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d47377-43d8-48b9-b76e-feb4a854bc18 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:47.045081 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d47377-43d8-48b9-b76e-feb4a854bc18 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:47.045524 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d47377-43d8-48b9-b76e-feb4a854bc18 None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:47.046465 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d47377-43d8-48b9-b76e-feb4a854bc18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:47.047045 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d47377-43d8-48b9-b76e-feb4a854bc18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:47.048696 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d47377-43d8-48b9-b76e-feb4a854bc18 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:47.050323 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5e5127-405d-432a-8a89-0b3b7bfa9652 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:47.061133 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 261/498] 10.222.0.118 () {56 vars in 1114 bytes} [Thu Jul 14 15:23:46 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:47.062297 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d47377-43d8-48b9-b76e-feb4a854bc18 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:47.088699 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54861fd7-4d88-4329-b6d3-cd66c936c880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:47.089470 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54861fd7-4d88-4329-b6d3-cd66c936c880 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:47.089820 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54861fd7-4d88-4329-b6d3-cd66c936c880 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:47.090210 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54861fd7-4d88-4329-b6d3-cd66c936c880 None admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:47.091036 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54861fd7-4d88-4329-b6d3-cd66c936c880 None admin] RBAC: Adding query filter params (name=service) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:47.091351 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54861fd7-4d88-4329-b6d3-cd66c936c880 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:47.092737 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54861fd7-4d88-4329-b6d3-cd66c936c880 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:47.101193 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 238/499] 10.222.0.118 () {56 vars in 1108 bytes} [Thu Jul 14 15:23:46 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:47.101987 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54861fd7-4d88-4329-b6d3-cd66c936c880 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:47.166556 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d47377-43d8-48b9-b76e-feb4a854bc18 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:47.199576 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fe998c-7151-40df-94c5-3a29b6b1337a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:47.200406 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fe998c-7151-40df-94c5-3a29b6b1337a None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:47.200685 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fe998c-7151-40df-94c5-3a29b6b1337a None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:47.200954 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fe998c-7151-40df-94c5-3a29b6b1337a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:47.201056 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54861fd7-4d88-4329-b6d3-cd66c936c880 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:47.209146 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fe998c-7151-40df-94c5-3a29b6b1337a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:47.210387 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:47.210634 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fe998c-7151-40df-94c5-3a29b6b1337a None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:47.226487 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-87fe998c-7151-40df-94c5-3a29b6b1337a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 15:23:47.226487 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:47.226487 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:47.226487 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:47.226487 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:47.226487 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:47.226487 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:47.226487 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:47.226487 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:47.226487 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:47.226487 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:47.226487 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:47.226487 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 15:23:47.226487 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 15:23:47.226487 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 15:23:47.226487 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 15:23:47.227595 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:47.227595 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:47.227595 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 15:23:47.227595 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:23:47.227595 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 15:23:47.227595 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:23:47.227595 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:47.227595 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:47.227595 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:47.227595 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:47.227595 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:47.227595 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:47.227595 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:47.227595 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:47.227595 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:47.227595 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:47.227595 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:47.227595 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:47.228658 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:47.228658 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:47.228658 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 15:23:47.228658 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 15:23:47.228658 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 15:23:47.228658 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 15:23:47.228658 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 15:23:47.228658 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 15:23:47.228658 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 15:23:47.228658 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:23:47.228658 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 262/500] 10.222.0.118 () {56 vars in 1098 bytes} [Thu Jul 14 15:23:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:47.228658 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fe998c-7151-40df-94c5-3a29b6b1337a None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:47.239623 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1fe66c-8cde-48fb-9cb3-eb26a1aed335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:47.240301 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1fe66c-8cde-48fb-9cb3-eb26a1aed335 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:47.240582 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1fe66c-8cde-48fb-9cb3-eb26a1aed335 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:47.240860 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1fe66c-8cde-48fb-9cb3-eb26a1aed335 None admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:47.241616 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1fe66c-8cde-48fb-9cb3-eb26a1aed335 None admin] RBAC: Adding query filter params (name=service) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:47.241928 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1fe66c-8cde-48fb-9cb3-eb26a1aed335 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:47.243363 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1fe66c-8cde-48fb-9cb3-eb26a1aed335 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:47.251769 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 239/501] 10.222.0.118 () {56 vars in 1108 bytes} [Thu Jul 14 15:23:47 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:47.256919 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce8e2fa-df39-4170-b129-dc3b1fa52e8c None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:47.256919 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce8e2fa-df39-4170-b129-dc3b1fa52e8c None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:47.256919 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce8e2fa-df39-4170-b129-dc3b1fa52e8c None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:47.256919 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 240/502] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:23:47 2022] GET /identity => generated 271 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:23:47.256919 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce8e2fa-df39-4170-b129-dc3b1fa52e8c None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:47.273951 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:47.345841 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fe998c-7151-40df-94c5-3a29b6b1337a None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:47.370064 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce8e2fa-df39-4170-b129-dc3b1fa52e8c None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:47.380297 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1f5eee-fe24-4bcc-8db0-f2db40dc2db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:47.381338 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1f5eee-fe24-4bcc-8db0-f2db40dc2db2 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:47.381616 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1f5eee-fe24-4bcc-8db0-f2db40dc2db2 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:47.381884 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1f5eee-fe24-4bcc-8db0-f2db40dc2db2 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:47.389234 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1f5eee-fe24-4bcc-8db0-f2db40dc2db2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:47.390743 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1f5eee-fe24-4bcc-8db0-f2db40dc2db2 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:47.403678 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcdbf3c-0cac-4dfe-bb98-d6afdb69c35a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:47.404450 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcdbf3c-0cac-4dfe-bb98-d6afdb69c35a None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:47.404722 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcdbf3c-0cac-4dfe-bb98-d6afdb69c35a None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:47.404987 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcdbf3c-0cac-4dfe-bb98-d6afdb69c35a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:47.405264 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-dd1f5eee-fe24-4bcc-8db0-f2db40dc2db2 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 14 15:23:47.405264 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:47.405264 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:47.405264 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:47.405264 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:47.405264 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:47.405264 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:47.405264 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:47.405264 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:47.405264 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:47.405264 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:47.405264 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:47.405264 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 15:23:47.405264 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 15:23:47.405264 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 15:23:47.405264 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 15:23:47.406285 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:47.406285 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:47.406285 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 15:23:47.406285 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:23:47.406285 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 15:23:47.406285 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:23:47.406285 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:47.406285 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:47.406285 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:47.406285 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:47.406285 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:47.406285 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:47.406285 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:47.406285 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:47.406285 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:47.406285 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:47.406285 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:47.406285 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:47.407364 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:47.407364 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:47.407364 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 15:23:47.407364 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 15:23:47.407364 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 15:23:47.407364 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 15:23:47.407364 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 15:23:47.407364 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 15:23:47.407364 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 14 15:23:47.407364 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:23:47.407364 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 263/503] 10.222.0.118 () {56 vars in 1104 bytes} [Thu Jul 14 15:23:47 2022] GET /identity/v3/users/glance => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:47.407364 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1f5eee-fe24-4bcc-8db0-f2db40dc2db2 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:47.420271 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcdbf3c-0cac-4dfe-bb98-d6afdb69c35a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:47.421705 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcdbf3c-0cac-4dfe-bb98-d6afdb69c35a None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:47.438628 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-7fcdbf3c-0cac-4dfe-bb98-d6afdb69c35a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:23:47.438628 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:47.438628 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:47.438628 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:47.438628 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:47.438628 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:47.438628 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:47.438628 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:47.438628 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:47.438628 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:47.438628 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:47.438628 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:47.438628 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:23:47.438628 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:23:47.438628 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:23:47.439563 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:23:47.439563 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:47.439563 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:47.439563 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:47.439563 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:47.439563 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:47.439563 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:47.439563 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:47.439563 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:47.439563 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:47.439563 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:47.439563 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:47.439563 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:47.439563 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:47.439563 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:47.439563 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:47.439563 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:47.441038 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:23:47.441038 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:23:47.441038 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:23:47.441038 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:23:47.441038 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 241/504] 10.222.0.118 () {56 vars in 1113 bytes} [Thu Jul 14 15:23:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:47.441547 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcdbf3c-0cac-4dfe-bb98-d6afdb69c35a None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:47.465134 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:47.503591 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:47.506605 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1f5eee-fe24-4bcc-8db0-f2db40dc2db2 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:47.540069 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeab842-48d7-42a1-885c-4b889de168f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:47.540726 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeab842-48d7-42a1-885c-4b889de168f8 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:47.541000 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeab842-48d7-42a1-885c-4b889de168f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:47.541270 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeab842-48d7-42a1-885c-4b889de168f8 None admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:47.541522 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcdbf3c-0cac-4dfe-bb98-d6afdb69c35a None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:47.542134 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeab842-48d7-42a1-885c-4b889de168f8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:47.542442 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeab842-48d7-42a1-885c-4b889de168f8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:47.543874 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeab842-48d7-42a1-885c-4b889de168f8 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:47.574993 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6899c37-84e9-4bac-bd9b-6704eb02b7ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:47.575780 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6899c37-84e9-4bac-bd9b-6704eb02b7ac None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:47.576060 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6899c37-84e9-4bac-bd9b-6704eb02b7ac None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:47.576333 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6899c37-84e9-4bac-bd9b-6704eb02b7ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:47.581006 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 264/505] 10.222.0.118 () {56 vars in 1138 bytes} [Thu Jul 14 15:23:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:47.582276 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be10827-b3e1-446e-ab1a-94df92e2cdfe None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:47.582560 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be10827-b3e1-446e-ab1a-94df92e2cdfe None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:47.582832 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be10827-b3e1-446e-ab1a-94df92e2cdfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:47.590314 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6899c37-84e9-4bac-bd9b-6704eb02b7ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:47.591790 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6899c37-84e9-4bac-bd9b-6704eb02b7ac None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:47.601047 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-8be10827-b3e1-446e-ab1a-94df92e2cdfe None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:47.602192 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-8be10827-b3e1-446e-ab1a-94df92e2cdfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:47.609416 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-c6899c37-84e9-4bac-bd9b-6704eb02b7ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:23:47.609416 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:47.609416 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:47.609416 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:47.609416 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:47.609416 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:47.609416 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:47.609416 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:47.609416 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:47.609416 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:47.609416 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:47.609416 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:47.609416 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:23:47.609416 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:23:47.609416 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:23:47.610314 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:23:47.610314 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:47.610314 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:47.610314 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:47.610314 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:47.610314 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:47.610314 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:47.610314 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:47.610314 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:47.610314 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:47.610314 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:47.610314 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:47.610314 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:47.610314 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:47.610314 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:47.610314 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:47.610314 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:47.611362 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:23:47.611362 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:23:47.611362 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:23:47.611362 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:23:47.611362 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 242/506] 10.222.0.118 () {56 vars in 1113 bytes} [Thu Jul 14 15:23:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:47.611998 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6899c37-84e9-4bac-bd9b-6704eb02b7ac None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:47.673781 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 265/507] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:23:47 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:23:47.678612 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be10827-b3e1-446e-ab1a-94df92e2cdfe None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:47.687561 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:47.718469 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6899c37-84e9-4bac-bd9b-6704eb02b7ac None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:47.752166 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ba767c-3432-43e2-9e1e-708ef8c0aeef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:47.752835 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ba767c-3432-43e2-9e1e-708ef8c0aeef None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:47.753114 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ba767c-3432-43e2-9e1e-708ef8c0aeef None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:47.753421 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ba767c-3432-43e2-9e1e-708ef8c0aeef None admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:47.754355 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ba767c-3432-43e2-9e1e-708ef8c0aeef None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:47.754661 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ba767c-3432-43e2-9e1e-708ef8c0aeef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:47.756362 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ba767c-3432-43e2-9e1e-708ef8c0aeef None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:47.769342 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:47.786410 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be10827-b3e1-446e-ab1a-94df92e2cdfe None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:47.795427 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 243/508] 10.222.0.118 () {56 vars in 1142 bytes} [Thu Jul 14 15:23:47 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 374 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:47.796275 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ba767c-3432-43e2-9e1e-708ef8c0aeef None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:47.827960 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f32a4aa-7e5a-440b-8e75-31a7759f2df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:47.828621 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f32a4aa-7e5a-440b-8e75-31a7759f2df5 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:47.828929 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f32a4aa-7e5a-440b-8e75-31a7759f2df5 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:47.829199 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f32a4aa-7e5a-440b-8e75-31a7759f2df5 None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:47.830075 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f32a4aa-7e5a-440b-8e75-31a7759f2df5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:47.830383 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f32a4aa-7e5a-440b-8e75-31a7759f2df5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:47.832287 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f32a4aa-7e5a-440b-8e75-31a7759f2df5 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:47.843694 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 266/509] 10.222.0.118 () {56 vars in 1114 bytes} [Thu Jul 14 15:23:47 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:47.844478 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f32a4aa-7e5a-440b-8e75-31a7759f2df5 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:47.896690 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ba767c-3432-43e2-9e1e-708ef8c0aeef None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:47.928305 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:47.937753 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c7d60a-b680-49c5-a7ce-dc1e1e4f37da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:47.938445 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c7d60a-b680-49c5-a7ce-dc1e1e4f37da None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:47.938725 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c7d60a-b680-49c5-a7ce-dc1e1e4f37da None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:47.940171 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c7d60a-b680-49c5-a7ce-dc1e1e4f37da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:47.944767 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f32a4aa-7e5a-440b-8e75-31a7759f2df5 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:47.981631 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d853417-4d9d-4446-b9f3-341985d4a9ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:47.982331 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d853417-4d9d-4446-b9f3-341985d4a9ed None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:47.982610 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d853417-4d9d-4446-b9f3-341985d4a9ed None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:47.982886 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d853417-4d9d-4446-b9f3-341985d4a9ed None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:47.983608 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d853417-4d9d-4446-b9f3-341985d4a9ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:47.983914 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d853417-4d9d-4446-b9f3-341985d4a9ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:47.985286 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d853417-4d9d-4446-b9f3-341985d4a9ed None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:47.997233 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 267/510] 10.222.0.118 () {56 vars in 1114 bytes} [Thu Jul 14 15:23:47 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:47.998132 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d853417-4d9d-4446-b9f3-341985d4a9ed None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:48.008694 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c7d60a-b680-49c5-a7ce-dc1e1e4f37da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:48.010202 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c7d60a-b680-49c5-a7ce-dc1e1e4f37da None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:48.010408 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:48.100085 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d853417-4d9d-4446-b9f3-341985d4a9ed None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:48.115038 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 244/511] 10.222.0.118 () {58 vars in 1287 bytes} [Thu Jul 14 15:23:47 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 15:23:48.115038 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c7d60a-b680-49c5-a7ce-dc1e1e4f37da None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:48.135250 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1037845-fe00-46e6-b476-03c85b3ff5af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:48.136033 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1037845-fe00-46e6-b476-03c85b3ff5af None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:48.136312 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1037845-fe00-46e6-b476-03c85b3ff5af None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:48.136589 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1037845-fe00-46e6-b476-03c85b3ff5af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:48.141386 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:48.147350 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1037845-fe00-46e6-b476-03c85b3ff5af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:48.148746 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1037845-fe00-46e6-b476-03c85b3ff5af None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:48.165749 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-b1037845-fe00-46e6-b476-03c85b3ff5af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:23:48.165749 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:48.165749 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:48.165749 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:48.165749 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:48.165749 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:48.165749 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:48.165749 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:48.165749 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:48.165749 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:48.165749 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:48.165749 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:48.165749 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:23:48.165749 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:23:48.165749 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:23:48.166772 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:23:48.166772 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:48.166772 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:48.166772 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:48.166772 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:48.166772 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:48.166772 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:48.166772 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:48.166772 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:48.166772 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:48.166772 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:48.166772 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:48.166772 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:48.166772 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:48.166772 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:48.166772 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:48.166772 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:48.167783 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:23:48.167783 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:23:48.167783 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:23:48.167783 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:23:48.167783 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 268/512] 10.222.0.118 () {56 vars in 1113 bytes} [Thu Jul 14 15:23:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:48.167783 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1037845-fe00-46e6-b476-03c85b3ff5af None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:48.215598 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c7d60a-b680-49c5-a7ce-dc1e1e4f37da None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:48.227774 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:48.249783 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb668387-9b02-433f-b342-6deabc339919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:48.250485 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb668387-9b02-433f-b342-6deabc339919 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:48.250766 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb668387-9b02-433f-b342-6deabc339919 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:48.251040 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb668387-9b02-433f-b342-6deabc339919 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:48.270423 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1037845-fe00-46e6-b476-03c85b3ff5af None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:48.305619 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfac5eb-f05d-4d28-a2a4-ea21917a1a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:48.306444 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfac5eb-f05d-4d28-a2a4-ea21917a1a7b None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:48.306723 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfac5eb-f05d-4d28-a2a4-ea21917a1a7b None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:48.306992 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfac5eb-f05d-4d28-a2a4-ea21917a1a7b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:48.315079 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfac5eb-f05d-4d28-a2a4-ea21917a1a7b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:48.317078 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfac5eb-f05d-4d28-a2a4-ea21917a1a7b None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:48.324395 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb668387-9b02-433f-b342-6deabc339919 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:48.326029 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb668387-9b02-433f-b342-6deabc339919 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:48.341595 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-dbfac5eb-f05d-4d28-a2a4-ea21917a1a7b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 15:23:48.341595 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:48.341595 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:48.341595 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:48.341595 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:48.341595 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:48.341595 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:48.341595 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:48.341595 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:48.341595 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:48.341595 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:48.341595 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:48.341595 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 15:23:48.341595 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 15:23:48.341595 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 15:23:48.341595 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 15:23:48.342732 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:48.342732 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:48.342732 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 15:23:48.342732 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:23:48.342732 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 15:23:48.342732 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:23:48.342732 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:48.342732 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:48.342732 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:48.342732 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:48.342732 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:48.342732 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:48.342732 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:48.342732 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:48.342732 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:48.342732 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:48.342732 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:48.342732 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:48.343615 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:48.343615 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:48.343615 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 15:23:48.343615 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 15:23:48.343615 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 15:23:48.343615 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 15:23:48.343615 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 15:23:48.343615 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 15:23:48.343615 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 15:23:48.343615 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:23:48.343615 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 269/513] 10.222.0.118 () {56 vars in 1104 bytes} [Thu Jul 14 15:23:48 2022] GET /identity/v3/users/cinder => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:48.344176 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfac5eb-f05d-4d28-a2a4-ea21917a1a7b None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:48.361738 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:48.433716 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 245/514] 10.222.0.118 () {58 vars in 1287 bytes} [Thu Jul 14 15:23:48 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 15:23:48.434504 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb668387-9b02-433f-b342-6deabc339919 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:48.448343 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfac5eb-f05d-4d28-a2a4-ea21917a1a7b None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:48.468612 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:48.482845 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0261d0a2-9eae-4bab-a759-e28410383dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:48.483633 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0261d0a2-9eae-4bab-a759-e28410383dc8 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:48.483908 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0261d0a2-9eae-4bab-a759-e28410383dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:48.484177 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0261d0a2-9eae-4bab-a759-e28410383dc8 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:48.492090 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0261d0a2-9eae-4bab-a759-e28410383dc8 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:48.493513 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0261d0a2-9eae-4bab-a759-e28410383dc8 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:48.507855 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-0261d0a2-9eae-4bab-a759-e28410383dc8 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 14 15:23:48.507855 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:48.507855 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:48.507855 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:48.507855 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:48.507855 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:48.507855 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:48.507855 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:48.507855 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:48.507855 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:48.507855 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:48.507855 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:48.507855 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 15:23:48.507855 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 15:23:48.507855 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 15:23:48.507855 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 15:23:48.508718 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:48.508718 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:48.508718 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 15:23:48.508718 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:23:48.508718 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 15:23:48.508718 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:23:48.508718 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:48.508718 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:48.508718 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:48.508718 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:48.508718 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:48.508718 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:48.508718 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:48.508718 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:48.508718 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:48.508718 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:48.508718 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:48.508718 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:48.509591 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:48.509591 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:48.509591 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 15:23:48.509591 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 15:23:48.509591 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 15:23:48.509591 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 15:23:48.509591 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 15:23:48.509591 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 15:23:48.509591 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 14 15:23:48.509591 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:23:48.509591 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 270/515] 10.222.0.118 () {56 vars in 1107 bytes} [Thu Jul 14 15:23:48 2022] GET /identity/v3/users/neutron => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:48.510177 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0261d0a2-9eae-4bab-a759-e28410383dc8 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:48.537715 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb668387-9b02-433f-b342-6deabc339919 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:48.566516 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:48.571886 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fef769a-e79b-4afe-ab94-2b5b8f203b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:48.572670 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef769a-e79b-4afe-ab94-2b5b8f203b64 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:48.572943 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef769a-e79b-4afe-ab94-2b5b8f203b64 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:48.573211 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef769a-e79b-4afe-ab94-2b5b8f203b64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:48.583722 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fef769a-e79b-4afe-ab94-2b5b8f203b64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:48.585171 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fef769a-e79b-4afe-ab94-2b5b8f203b64 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:48.602784 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-5fef769a-e79b-4afe-ab94-2b5b8f203b64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:23:48.602784 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:48.602784 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:48.602784 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:48.602784 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:48.602784 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:48.602784 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:48.602784 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:48.602784 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:48.602784 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:48.602784 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:48.602784 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:48.602784 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:23:48.602784 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:23:48.602784 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:23:48.603630 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:23:48.603630 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:48.603630 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:48.603630 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:48.603630 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:48.603630 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:48.603630 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:48.603630 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:48.603630 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:48.603630 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:48.603630 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:48.603630 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:48.603630 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:48.603630 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:48.603630 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:48.603630 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:48.603630 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:48.604439 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:23:48.604439 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:23:48.604439 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:23:48.604439 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:23:48.604439 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 246/516] 10.222.0.118 () {56 vars in 1113 bytes} [Thu Jul 14 15:23:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:48.604830 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fef769a-e79b-4afe-ab94-2b5b8f203b64 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:48.613848 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0261d0a2-9eae-4bab-a759-e28410383dc8 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:48.647078 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fbc9f5-7d23-4d41-ab3e-a6f0aabdb34e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:48.647727 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fbc9f5-7d23-4d41-ab3e-a6f0aabdb34e None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:48.648013 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fbc9f5-7d23-4d41-ab3e-a6f0aabdb34e None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:48.648281 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fbc9f5-7d23-4d41-ab3e-a6f0aabdb34e None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:48.648990 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fbc9f5-7d23-4d41-ab3e-a6f0aabdb34e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:48.649291 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fbc9f5-7d23-4d41-ab3e-a6f0aabdb34e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:48.650677 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fbc9f5-7d23-4d41-ab3e-a6f0aabdb34e None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:48.663279 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 271/517] 10.222.0.118 () {56 vars in 1114 bytes} [Thu Jul 14 15:23:48 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:48.663850 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fbc9f5-7d23-4d41-ab3e-a6f0aabdb34e None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:48.709888 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fef769a-e79b-4afe-ab94-2b5b8f203b64 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:48.719469 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:48.744613 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e9fff2-b543-4b2a-b9d8-71bb6c1cc29e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:48.745277 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e9fff2-b543-4b2a-b9d8-71bb6c1cc29e None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:48.745551 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e9fff2-b543-4b2a-b9d8-71bb6c1cc29e None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:48.746232 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e9fff2-b543-4b2a-b9d8-71bb6c1cc29e None admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:48.746751 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e9fff2-b543-4b2a-b9d8-71bb6c1cc29e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:48.747057 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e9fff2-b543-4b2a-b9d8-71bb6c1cc29e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:48.748502 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e9fff2-b543-4b2a-b9d8-71bb6c1cc29e None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:48.766525 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 247/518] 10.222.0.118 () {56 vars in 1142 bytes} [Thu Jul 14 15:23:48 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 374 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:48.767671 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e9fff2-b543-4b2a-b9d8-71bb6c1cc29e None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:48.784869 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fbc9f5-7d23-4d41-ab3e-a6f0aabdb34e None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:48.809382 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:48.820033 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd197ec-82b7-4721-9af8-0f9f2e60d440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:48.820822 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd197ec-82b7-4721-9af8-0f9f2e60d440 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:48.821100 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd197ec-82b7-4721-9af8-0f9f2e60d440 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:48.821366 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd197ec-82b7-4721-9af8-0f9f2e60d440 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:48.831577 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd197ec-82b7-4721-9af8-0f9f2e60d440 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:48.833051 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd197ec-82b7-4721-9af8-0f9f2e60d440 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:48.851004 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-abd197ec-82b7-4721-9af8-0f9f2e60d440 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:23:48.851004 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:48.851004 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:48.851004 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:48.851004 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:48.851004 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:48.851004 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:48.851004 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:48.851004 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:48.851004 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:48.851004 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:48.851004 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:48.851004 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:23:48.851004 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:23:48.851004 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:23:48.851862 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:23:48.851862 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:48.851862 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:48.851862 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:48.851862 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:48.851862 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:48.851862 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:48.851862 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:48.851862 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:48.851862 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:48.851862 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:48.851862 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:48.851862 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:48.851862 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:48.851862 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:48.851862 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:48.851862 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:48.852694 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:23:48.852694 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:23:48.852694 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:23:48.852694 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:23:48.852694 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 272/519] 10.222.0.118 () {56 vars in 1113 bytes} [Thu Jul 14 15:23:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:48.852957 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd197ec-82b7-4721-9af8-0f9f2e60d440 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:48.866577 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e9fff2-b543-4b2a-b9d8-71bb6c1cc29e None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:48.899862 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e422e85-189e-4ad3-8ff9-5470e105c40a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:48.900556 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e422e85-189e-4ad3-8ff9-5470e105c40a None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:48.900837 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e422e85-189e-4ad3-8ff9-5470e105c40a None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:48.901119 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e422e85-189e-4ad3-8ff9-5470e105c40a None admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:48.901950 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e422e85-189e-4ad3-8ff9-5470e105c40a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:48.902295 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e422e85-189e-4ad3-8ff9-5470e105c40a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:48.903743 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e422e85-189e-4ad3-8ff9-5470e105c40a None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:48.922054 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 248/520] 10.222.0.118 () {56 vars in 1144 bytes} [Thu Jul 14 15:23:48 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 376 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:48.922833 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e422e85-189e-4ad3-8ff9-5470e105c40a None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:48.944450 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:48.954083 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd197ec-82b7-4721-9af8-0f9f2e60d440 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:48.990697 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca5c4cc-55ff-4577-b36d-d100bec11dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:48.991279 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca5c4cc-55ff-4577-b36d-d100bec11dcb None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:48.991563 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca5c4cc-55ff-4577-b36d-d100bec11dcb None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:48.991838 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca5c4cc-55ff-4577-b36d-d100bec11dcb None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:48.992559 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca5c4cc-55ff-4577-b36d-d100bec11dcb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:48.992867 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca5c4cc-55ff-4577-b36d-d100bec11dcb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:48.994303 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca5c4cc-55ff-4577-b36d-d100bec11dcb None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:49.005709 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 273/521] 10.222.0.118 () {56 vars in 1114 bytes} [Thu Jul 14 15:23:48 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:49.006547 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca5c4cc-55ff-4577-b36d-d100bec11dcb None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:49.028582 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:49.033212 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e422e85-189e-4ad3-8ff9-5470e105c40a None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:49.076177 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25241d16-7428-4d86-ac54-7ad7f4619064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:49.076910 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25241d16-7428-4d86-ac54-7ad7f4619064 None admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:49.077217 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25241d16-7428-4d86-ac54-7ad7f4619064 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:49.077507 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25241d16-7428-4d86-ac54-7ad7f4619064 None admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:49.078314 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25241d16-7428-4d86-ac54-7ad7f4619064 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:49.079842 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25241d16-7428-4d86-ac54-7ad7f4619064 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:49.099672 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 249/522] 10.222.0.118 () {60 vars in 1137 bytes} [Thu Jul 14 15:23:48 2022] POST /identity/v3/users => generated 248 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:23:49.100484 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25241d16-7428-4d86-ac54-7ad7f4619064 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:49.107160 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca5c4cc-55ff-4577-b36d-d100bec11dcb None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:49.145412 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c345c964-dc2e-45b4-8b49-9a8a51574caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:49.146167 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c345c964-dc2e-45b4-8b49-9a8a51574caa None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:49.146450 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c345c964-dc2e-45b4-8b49-9a8a51574caa None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:49.146726 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c345c964-dc2e-45b4-8b49-9a8a51574caa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:49.170801 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:49.219913 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25241d16-7428-4d86-ac54-7ad7f4619064 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:49.226304 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c345c964-dc2e-45b4-8b49-9a8a51574caa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:49.227777 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c345c964-dc2e-45b4-8b49-9a8a51574caa None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:49.260256 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc85ee0-261d-459c-afc3-97fecb931988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:49.260437 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc85ee0-261d-459c-afc3-97fecb931988 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:49.260697 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc85ee0-261d-459c-afc3-97fecb931988 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:49.261026 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc85ee0-261d-459c-afc3-97fecb931988 None admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:49.261686 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc85ee0-261d-459c-afc3-97fecb931988 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:49.262648 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc85ee0-261d-459c-afc3-97fecb931988 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:49.263383 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc85ee0-261d-459c-afc3-97fecb931988 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:49.276351 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 250/523] 10.222.0.118 () {56 vars in 1114 bytes} [Thu Jul 14 15:23:49 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:49.277698 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc85ee0-261d-459c-afc3-97fecb931988 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:49.303912 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:49.344994 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 274/524] 10.222.0.118 () {58 vars in 1287 bytes} [Thu Jul 14 15:23:49 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 15:23:49.345932 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c345c964-dc2e-45b4-8b49-9a8a51574caa None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:49.398390 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc85ee0-261d-459c-afc3-97fecb931988 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:49.407113 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:49.432091 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a382a2d-2f78-4732-8b8f-4796dbf27450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:49.432737 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a382a2d-2f78-4732-8b8f-4796dbf27450 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:49.433019 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a382a2d-2f78-4732-8b8f-4796dbf27450 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:49.433293 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a382a2d-2f78-4732-8b8f-4796dbf27450 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:49.460532 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c345c964-dc2e-45b4-8b49-9a8a51574caa None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:49.496799 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c8beb5-abeb-495a-979d-259e6ad92573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:49.498125 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c8beb5-abeb-495a-979d-259e6ad92573 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:49.498660 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c8beb5-abeb-495a-979d-259e6ad92573 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:49.498931 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c8beb5-abeb-495a-979d-259e6ad92573 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:49.500721 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a382a2d-2f78-4732-8b8f-4796dbf27450 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:49.502219 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a382a2d-2f78-4732-8b8f-4796dbf27450 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:49.507192 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c8beb5-abeb-495a-979d-259e6ad92573 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:49.508793 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c8beb5-abeb-495a-979d-259e6ad92573 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:49.521029 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:49.525586 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-61c8beb5-abeb-495a-979d-259e6ad92573 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:23:49.525586 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:49.525586 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:49.525586 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:49.525586 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:49.525586 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:49.525586 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:49.525586 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:49.525586 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:49.525586 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:49.525586 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:49.525586 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:49.525586 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 15:23:49.525586 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 15:23:49.525586 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 15:23:49.526630 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 15:23:49.526630 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:49.526630 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:49.526630 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:49.526630 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:49.526630 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:49.526630 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:49.526630 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:49.526630 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:49.526630 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:49.526630 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:49.526630 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:49.526630 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:49.526630 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:49.526630 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:49.526630 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:49.526630 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:49.527641 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 15:23:49.527641 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 15:23:49.527641 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:23:49.527641 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:23:49.527641 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:23:49.527641 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:23:49.527641 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:23:49.527641 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:23:49.529426 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 275/525] 10.222.0.118 () {56 vars in 1116 bytes} [Thu Jul 14 15:23:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:49.530375 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c8beb5-abeb-495a-979d-259e6ad92573 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:49.623018 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 251/526] 10.222.0.118 () {58 vars in 1287 bytes} [Thu Jul 14 15:23:49 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 15:23:49.624239 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a382a2d-2f78-4732-8b8f-4796dbf27450 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:49.645354 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c8beb5-abeb-495a-979d-259e6ad92573 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:49.660089 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:49.685431 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d26b913-d19f-4c0a-bcde-3e8f8f1b54ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:49.686263 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d26b913-d19f-4c0a-bcde-3e8f8f1b54ac None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:49.686973 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d26b913-d19f-4c0a-bcde-3e8f8f1b54ac None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:49.687258 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d26b913-d19f-4c0a-bcde-3e8f8f1b54ac None admin] PATH_INFO: `/v3/projects/service` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:49.697207 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d26b913-d19f-4c0a-bcde-3e8f8f1b54ac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:49.698710 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d26b913-d19f-4c0a-bcde-3e8f8f1b54ac None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:49.720729 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-7d26b913-d19f-4c0a-bcde-3e8f8f1b54ac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:23:49.720729 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:49.720729 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:49.720729 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:49.720729 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:49.720729 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:49.720729 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:49.720729 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:49.720729 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:49.720729 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:49.720729 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:49.720729 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:49.720729 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 15:23:49.720729 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 15:23:49.720729 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 15:23:49.722185 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 15:23:49.722185 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:49.722185 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:49.722185 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:49.722185 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:49.722185 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:49.722185 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:49.722185 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:49.722185 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:49.722185 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:49.722185 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:49.722185 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:49.722185 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:49.722185 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:49.722185 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:49.722185 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:49.722185 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:49.727979 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 15:23:49.727979 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 15:23:49.727979 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:23:49.727979 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:23:49.727979 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:23:49.727979 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:23:49.727979 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:23:49.727979 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:23:49.727979 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 276/527] 10.222.0.118 () {56 vars in 1116 bytes} [Thu Jul 14 15:23:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:49.727979 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d26b913-d19f-4c0a-bcde-3e8f8f1b54ac None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:49.735532 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a382a2d-2f78-4732-8b8f-4796dbf27450 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:49.753599 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:49.771824 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7ad0f9-c293-4295-a067-5b854a91cbe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:49.772545 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ad0f9-c293-4295-a067-5b854a91cbe7 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:49.772824 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ad0f9-c293-4295-a067-5b854a91cbe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:49.773094 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ad0f9-c293-4295-a067-5b854a91cbe7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:49.784814 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7ad0f9-c293-4295-a067-5b854a91cbe7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:49.785382 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7ad0f9-c293-4295-a067-5b854a91cbe7 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:49.806886 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-7a7ad0f9-c293-4295-a067-5b854a91cbe7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:23:49.806886 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:49.806886 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:49.806886 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:49.806886 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:49.806886 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:49.806886 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:49.806886 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:49.806886 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:49.806886 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:49.806886 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:49.806886 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:49.806886 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:23:49.806886 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:23:49.806886 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:23:49.807898 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:23:49.807898 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:49.807898 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:49.807898 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:49.807898 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:49.807898 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:49.807898 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:49.807898 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:49.807898 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:49.807898 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:49.807898 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:49.807898 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:49.807898 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:49.807898 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:49.807898 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:49.807898 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:49.807898 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:49.809642 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:23:49.809642 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:23:49.809642 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:23:49.809642 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:23:49.809642 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 252/528] 10.222.0.118 () {56 vars in 1113 bytes} [Thu Jul 14 15:23:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:49.809642 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7ad0f9-c293-4295-a067-5b854a91cbe7 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:49.851940 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d26b913-d19f-4c0a-bcde-3e8f8f1b54ac None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:49.888856 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2238096-dbf7-4a88-b839-d2b6dfada363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:49.889240 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2238096-dbf7-4a88-b839-d2b6dfada363 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:49.889507 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2238096-dbf7-4a88-b839-d2b6dfada363 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:49.889775 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2238096-dbf7-4a88-b839-d2b6dfada363 None admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:49.890599 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2238096-dbf7-4a88-b839-d2b6dfada363 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:49.890904 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2238096-dbf7-4a88-b839-d2b6dfada363 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:49.892348 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2238096-dbf7-4a88-b839-d2b6dfada363 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:49.915086 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 277/529] 10.222.0.118 () {56 vars in 1153 bytes} [Thu Jul 14 15:23:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:49.915086 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2238096-dbf7-4a88-b839-d2b6dfada363 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:49.926550 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7ad0f9-c293-4295-a067-5b854a91cbe7 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:49.946619 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:49.964883 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3104bb-185e-4231-a2f1-15e6effd8955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:49.965680 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3104bb-185e-4231-a2f1-15e6effd8955 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:49.965979 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3104bb-185e-4231-a2f1-15e6effd8955 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:49.966264 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3104bb-185e-4231-a2f1-15e6effd8955 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:49.977406 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3104bb-185e-4231-a2f1-15e6effd8955 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:49.978889 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3104bb-185e-4231-a2f1-15e6effd8955 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:49.997092 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-cb3104bb-185e-4231-a2f1-15e6effd8955 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:23:49.997092 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:49.997092 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:49.997092 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:49.997092 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:49.997092 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:49.997092 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:49.997092 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:49.997092 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:49.997092 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:49.997092 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:49.997092 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:49.997092 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:23:49.997092 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:23:49.997092 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:23:49.998100 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:23:49.998100 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:49.998100 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:49.998100 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:49.998100 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:49.998100 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:49.998100 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:49.998100 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:49.998100 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:49.998100 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:49.998100 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:49.998100 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:49.998100 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:49.998100 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:49.998100 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:49.998100 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:49.998100 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:49.998956 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:23:49.998956 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:23:49.998956 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:23:49.998956 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:23:49.998956 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 253/530] 10.222.0.118 () {56 vars in 1113 bytes} [Thu Jul 14 15:23:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:49.999217 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3104bb-185e-4231-a2f1-15e6effd8955 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:50.025888 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2238096-dbf7-4a88-b839-d2b6dfada363 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:50.026268 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:50.063524 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48bd09f-946e-4104-bd73-bbd89442ed31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:50.064182 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48bd09f-946e-4104-bd73-bbd89442ed31 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:50.064464 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48bd09f-946e-4104-bd73-bbd89442ed31 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:50.064744 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48bd09f-946e-4104-bd73-bbd89442ed31 None admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:50.065531 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48bd09f-946e-4104-bd73-bbd89442ed31 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:50.066080 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48bd09f-946e-4104-bd73-bbd89442ed31 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:50.067299 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48bd09f-946e-4104-bd73-bbd89442ed31 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:50.084790 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 278/531] 10.222.0.118 () {56 vars in 1153 bytes} [Thu Jul 14 15:23:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:50.084790 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48bd09f-946e-4104-bd73-bbd89442ed31 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:50.111113 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3104bb-185e-4231-a2f1-15e6effd8955 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:50.148626 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62894a7-0d54-492f-b7aa-6750626df9b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:50.149544 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62894a7-0d54-492f-b7aa-6750626df9b5 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:50.149987 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62894a7-0d54-492f-b7aa-6750626df9b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:50.150288 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62894a7-0d54-492f-b7aa-6750626df9b5 None admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:50.151006 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62894a7-0d54-492f-b7aa-6750626df9b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:50.151312 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62894a7-0d54-492f-b7aa-6750626df9b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:50.152673 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62894a7-0d54-492f-b7aa-6750626df9b5 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:50.164792 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 254/532] 10.222.0.118 () {56 vars in 1114 bytes} [Thu Jul 14 15:23:49 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:50.165742 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62894a7-0d54-492f-b7aa-6750626df9b5 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:50.185508 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:50.197329 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48bd09f-946e-4104-bd73-bbd89442ed31 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:50.232316 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d265cc5-2690-410d-81c7-d0b1349bb4de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:50.232978 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d265cc5-2690-410d-81c7-d0b1349bb4de None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:50.233258 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d265cc5-2690-410d-81c7-d0b1349bb4de None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:50.233516 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d265cc5-2690-410d-81c7-d0b1349bb4de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:50.234409 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d265cc5-2690-410d-81c7-d0b1349bb4de None admin] RBAC: Adding query filter params (role.id=3185f450429e4bb3b5f289b615f3269b, scope.project.id=939bf9541f4a4afe86550f749d337680, user.id=f0177fc696ea40069902803da09f437c) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:50.234726 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d265cc5-2690-410d-81c7-d0b1349bb4de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:50.236200 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d265cc5-2690-410d-81c7-d0b1349bb4de None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:50.249994 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 279/533] 10.222.0.118 () {56 vars in 1379 bytes} [Thu Jul 14 15:23:50 2022] GET /identity/v3/role_assignments?user.id=f0177fc696ea40069902803da09f437c&scope.project.id=939bf9541f4a4afe86550f749d337680&role.id=3185f450429e4bb3b5f289b615f3269b => generated 260 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:50.249994 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d265cc5-2690-410d-81c7-d0b1349bb4de None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:50.278195 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:50.302667 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62894a7-0d54-492f-b7aa-6750626df9b5 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:50.360339 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c18750-edca-4f30-bc97-70acff33fb20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:50.361179 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c18750-edca-4f30-bc97-70acff33fb20 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:50.361575 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c18750-edca-4f30-bc97-70acff33fb20 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:50.361946 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c18750-edca-4f30-bc97-70acff33fb20 None admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:50.363633 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c18750-edca-4f30-bc97-70acff33fb20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:50.364048 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c18750-edca-4f30-bc97-70acff33fb20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:50.366158 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c18750-edca-4f30-bc97-70acff33fb20 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:50.377148 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d265cc5-2690-410d-81c7-d0b1349bb4de None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:50.390665 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 255/534] 10.222.0.118 () {56 vars in 1114 bytes} [Thu Jul 14 15:23:50 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:50.391981 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c18750-edca-4f30-bc97-70acff33fb20 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:50.420869 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a130fcb-2477-4d0d-a2ea-4f94febb0e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:50.421838 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a130fcb-2477-4d0d-a2ea-4f94febb0e46 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:50.422351 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a130fcb-2477-4d0d-a2ea-4f94febb0e46 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:50.422806 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a130fcb-2477-4d0d-a2ea-4f94febb0e46 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:50.423849 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a130fcb-2477-4d0d-a2ea-4f94febb0e46 None admin] RBAC: Adding query filter params (role.id=3185f450429e4bb3b5f289b615f3269b, scope.project.id=939bf9541f4a4afe86550f749d337680, user.id=b4336c3d678a4d33b00885def42dfb1f) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:50.424665 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a130fcb-2477-4d0d-a2ea-4f94febb0e46 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:50.425761 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a130fcb-2477-4d0d-a2ea-4f94febb0e46 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:50.432148 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 280/535] 10.222.0.118 () {56 vars in 1379 bytes} [Thu Jul 14 15:23:50 2022] GET /identity/v3/role_assignments?user.id=b4336c3d678a4d33b00885def42dfb1f&scope.project.id=939bf9541f4a4afe86550f749d337680&role.id=3185f450429e4bb3b5f289b615f3269b => generated 260 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:50.433098 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a130fcb-2477-4d0d-a2ea-4f94febb0e46 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:50.461816 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:50.550662 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c18750-edca-4f30-bc97-70acff33fb20 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:50.615324 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a130fcb-2477-4d0d-a2ea-4f94febb0e46 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:50.621065 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f00f3b9-2d39-414b-a694-6103d26b86f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:50.621882 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f00f3b9-2d39-414b-a694-6103d26b86f1 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:50.622205 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f00f3b9-2d39-414b-a694-6103d26b86f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:50.622481 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f00f3b9-2d39-414b-a694-6103d26b86f1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:50.631542 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f00f3b9-2d39-414b-a694-6103d26b86f1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:50.633182 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f00f3b9-2d39-414b-a694-6103d26b86f1 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:50.636187 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:50.653513 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-1f00f3b9-2d39-414b-a694-6103d26b86f1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:23:50.653513 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:50.653513 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:50.653513 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:50.653513 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:50.653513 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:50.653513 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:50.653513 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:50.653513 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:50.653513 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:50.653513 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:50.653513 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:50.653513 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 15:23:50.653513 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 15:23:50.653513 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 15:23:50.654417 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 15:23:50.654417 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:50.654417 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:50.654417 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:50.654417 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:50.654417 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:50.654417 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:50.654417 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:50.654417 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:50.654417 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:50.654417 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:50.654417 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:50.654417 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:50.654417 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:50.654417 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:50.654417 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:50.654417 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:50.655236 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 15:23:50.655236 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 15:23:50.655236 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:23:50.655236 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:23:50.655236 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:23:50.655236 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:23:50.655236 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:23:50.655236 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:23:50.655236 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 256/536] 10.222.0.118 () {56 vars in 1116 bytes} [Thu Jul 14 15:23:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:50.655669 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8ac300-72d0-4643-806f-0436b6b868ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:50.656406 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ac300-72d0-4643-806f-0436b6b868ce None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:50.656541 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ac300-72d0-4643-806f-0436b6b868ce None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:50.656870 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ac300-72d0-4643-806f-0436b6b868ce None admin] PATH_INFO: `/v3/projects/service` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:50.662400 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f00f3b9-2d39-414b-a694-6103d26b86f1 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:50.673205 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8ac300-72d0-4643-806f-0436b6b868ce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:50.674888 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8ac300-72d0-4643-806f-0436b6b868ce None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:50.707993 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-ef8ac300-72d0-4643-806f-0436b6b868ce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:23:50.707993 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:50.707993 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:50.707993 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:50.707993 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:50.707993 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:50.707993 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:50.707993 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:50.707993 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:50.707993 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:50.707993 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:50.707993 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:50.707993 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 15:23:50.707993 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 15:23:50.707993 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 15:23:50.710334 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 15:23:50.710334 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:50.710334 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:50.710334 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:50.710334 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:50.710334 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:50.710334 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:50.710334 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:50.710334 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:50.710334 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:50.710334 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:50.710334 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:50.710334 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:50.710334 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:50.710334 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:50.710334 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:50.710334 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:50.712338 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 15:23:50.712338 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 15:23:50.712338 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:23:50.712338 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:23:50.712338 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:23:50.712338 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:23:50.712338 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:23:50.712338 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:23:50.712338 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 281/537] 10.222.0.118 () {56 vars in 1116 bytes} [Thu Jul 14 15:23:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:50.716809 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8ac300-72d0-4643-806f-0436b6b868ce None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:50.786136 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f00f3b9-2d39-414b-a694-6103d26b86f1 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:50.855869 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064547f6-3717-4b26-ad3e-7b202237baa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:50.856455 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064547f6-3717-4b26-ad3e-7b202237baa7 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:50.856737 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064547f6-3717-4b26-ad3e-7b202237baa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:50.857016 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064547f6-3717-4b26-ad3e-7b202237baa7 None admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:50.857814 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064547f6-3717-4b26-ad3e-7b202237baa7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:50.858148 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064547f6-3717-4b26-ad3e-7b202237baa7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:50.859607 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064547f6-3717-4b26-ad3e-7b202237baa7 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:50.876717 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:50.891836 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 257/538] 10.222.0.118 () {56 vars in 1153 bytes} [Thu Jul 14 15:23:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:50.898055 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064547f6-3717-4b26-ad3e-7b202237baa7 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:50.918065 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8ac300-72d0-4643-806f-0436b6b868ce None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:50.959637 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:51.001878 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064547f6-3717-4b26-ad3e-7b202237baa7 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:51.031259 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5186ea1d-cadc-458b-be5b-aaa9900c6a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:51.031935 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5186ea1d-cadc-458b-be5b-aaa9900c6a68 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:51.032263 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5186ea1d-cadc-458b-be5b-aaa9900c6a68 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:51.032480 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5186ea1d-cadc-458b-be5b-aaa9900c6a68 None admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:51.033283 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5186ea1d-cadc-458b-be5b-aaa9900c6a68 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:51.033588 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5186ea1d-cadc-458b-be5b-aaa9900c6a68 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:51.035205 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5186ea1d-cadc-458b-be5b-aaa9900c6a68 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:51.040047 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5767447-f1f8-4858-ad7f-285d5b3c575c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:51.040942 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5767447-f1f8-4858-ad7f-285d5b3c575c None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:51.041414 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5767447-f1f8-4858-ad7f-285d5b3c575c None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:51.041898 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5767447-f1f8-4858-ad7f-285d5b3c575c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:51.042947 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5767447-f1f8-4858-ad7f-285d5b3c575c None admin] RBAC: Adding query filter params (role.id=3185f450429e4bb3b5f289b615f3269b, scope.project.id=939bf9541f4a4afe86550f749d337680, user.id=ea647438ea1c438987f28cbe39c3ff2f) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:51.043453 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5767447-f1f8-4858-ad7f-285d5b3c575c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:51.045096 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5767447-f1f8-4858-ad7f-285d5b3c575c None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:51.052038 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 258/539] 10.222.0.118 () {56 vars in 1379 bytes} [Thu Jul 14 15:23:50 2022] GET /identity/v3/role_assignments?user.id=ea647438ea1c438987f28cbe39c3ff2f&scope.project.id=939bf9541f4a4afe86550f749d337680&role.id=3185f450429e4bb3b5f289b615f3269b => generated 260 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:51.061041 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 282/540] 10.222.0.118 () {56 vars in 1153 bytes} [Thu Jul 14 15:23:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:51.067616 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5767447-f1f8-4858-ad7f-285d5b3c575c None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:51.201443 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5767447-f1f8-4858-ad7f-285d5b3c575c None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:51.229280 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:51.241503 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c583ef55-ec67-4b69-b6a9-5a4e5f755c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:51.242554 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c583ef55-ec67-4b69-b6a9-5a4e5f755c73 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:51.243061 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c583ef55-ec67-4b69-b6a9-5a4e5f755c73 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:51.243550 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c583ef55-ec67-4b69-b6a9-5a4e5f755c73 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:51.244603 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c583ef55-ec67-4b69-b6a9-5a4e5f755c73 None admin] RBAC: Adding query filter params (role.id=3185f450429e4bb3b5f289b615f3269b, scope.project.id=939bf9541f4a4afe86550f749d337680, user.id=b650be8114b64df0ac88441f1c50b2cd) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:51.245117 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c583ef55-ec67-4b69-b6a9-5a4e5f755c73 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:51.246846 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c583ef55-ec67-4b69-b6a9-5a4e5f755c73 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:51.253856 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 259/541] 10.222.0.118 () {56 vars in 1379 bytes} [Thu Jul 14 15:23:51 2022] GET /identity/v3/role_assignments?user.id=b650be8114b64df0ac88441f1c50b2cd&scope.project.id=939bf9541f4a4afe86550f749d337680&role.id=3185f450429e4bb3b5f289b615f3269b => generated 260 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:51.331559 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a96f087-b2b3-459f-bad3-ae579e17d6b3 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:51.331887 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a96f087-b2b3-459f-bad3-ae579e17d6b3 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:51.332125 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a96f087-b2b3-459f-bad3-ae579e17d6b3 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:51.333886 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 283/542] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:23:51 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:23:51.340057 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f219c838-72a7-4e14-8c0f-b9c6cbe0cd6f None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:51.340411 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f219c838-72a7-4e14-8c0f-b9c6cbe0cd6f None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:51.340696 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f219c838-72a7-4e14-8c0f-b9c6cbe0cd6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:51.367445 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-f219c838-72a7-4e14-8c0f-b9c6cbe0cd6f None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:51.368675 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-f219c838-72a7-4e14-8c0f-b9c6cbe0cd6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:51.448728 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 260/543] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:23:51 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 15:23:51.473555 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a96f087-b2b3-459f-bad3-ae579e17d6b3 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:51.600019 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a96f087-b2b3-459f-bad3-ae579e17d6b3 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:51.634631 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fddd00-167a-4c7a-883b-6ec5063fe370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:51.635437 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fddd00-167a-4c7a-883b-6ec5063fe370 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:51.635704 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fddd00-167a-4c7a-883b-6ec5063fe370 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:51.635979 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fddd00-167a-4c7a-883b-6ec5063fe370 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:51.644403 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:51.648202 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fddd00-167a-4c7a-883b-6ec5063fe370 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:23:51.656417 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-e3fddd00-167a-4c7a-883b-6ec5063fe370 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:23:51.656417 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:51.656417 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:51.656417 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:51.656417 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:51.656417 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:51.656417 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:51.656417 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:51.656417 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:51.656417 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:51.656417 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:51.656417 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:51.656417 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:23:51.656417 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:23:51.656417 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:23:51.656417 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:23:51.657310 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:23:51.657310 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:23:51.657310 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:23:51.657310 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:23:51.657310 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:51.657310 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:51.657310 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:51.657310 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:51.657310 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:51.657310 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:51.657310 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:51.657310 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:51.657310 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:51.657310 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:51.657310 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:51.657310 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:51.658170 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:51.658170 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:51.658170 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:51.658170 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:51.658170 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:23:51.658170 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:23:51.658170 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:23:51.658170 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:23:51.658170 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:23:51.658170 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:23:51.658170 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:23:51.658170 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:23:51.658170 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 284/544] 10.222.0.118 () {56 vars in 1107 bytes} [Thu Jul 14 15:23:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:51.663510 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f219c838-72a7-4e14-8c0f-b9c6cbe0cd6f None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:51.847089 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f219c838-72a7-4e14-8c0f-b9c6cbe0cd6f None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:51.874182 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:51.898701 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ace57c8-55c9-4411-a897-ef3a6ff0d41d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:51.899431 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ace57c8-55c9-4411-a897-ef3a6ff0d41d None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:51.899717 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ace57c8-55c9-4411-a897-ef3a6ff0d41d None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:51.899993 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ace57c8-55c9-4411-a897-ef3a6ff0d41d None admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:51.900750 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ace57c8-55c9-4411-a897-ef3a6ff0d41d None admin] RBAC: Adding query filter params (name=service) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:51.901119 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ace57c8-55c9-4411-a897-ef3a6ff0d41d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:51.902559 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ace57c8-55c9-4411-a897-ef3a6ff0d41d None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:51.917548 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 261/545] 10.222.0.118 () {56 vars in 1108 bytes} [Thu Jul 14 15:23:51 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:51.922629 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fddd00-167a-4c7a-883b-6ec5063fe370 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:52.075476 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fddd00-167a-4c7a-883b-6ec5063fe370 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:52.132253 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a573c9-14f3-4ee6-ab56-0357e684c84f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:52.132974 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a573c9-14f3-4ee6-ab56-0357e684c84f None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:52.133260 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a573c9-14f3-4ee6-ab56-0357e684c84f None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:52.133536 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a573c9-14f3-4ee6-ab56-0357e684c84f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:52.147539 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a573c9-14f3-4ee6-ab56-0357e684c84f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:52.149000 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a573c9-14f3-4ee6-ab56-0357e684c84f None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:52.177803 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-c8a573c9-14f3-4ee6-ab56-0357e684c84f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:23:52.177803 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:52.177803 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:52.177803 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:52.177803 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:52.177803 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:52.177803 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:52.177803 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:52.177803 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:52.177803 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:52.177803 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:52.177803 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:52.177803 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:23:52.177803 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:23:52.177803 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:23:52.178723 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:23:52.178723 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:52.178723 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:52.178723 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:52.178723 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:52.178723 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:52.178723 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:52.178723 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:52.178723 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:52.178723 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:52.178723 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:52.178723 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:52.178723 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:52.178723 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:52.178723 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:52.178723 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:52.178723 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:52.179565 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:23:52.179565 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:23:52.179565 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:23:52.179565 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:23:52.190980 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 285/546] 10.222.0.118 () {56 vars in 1113 bytes} [Thu Jul 14 15:23:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:52.191232 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ace57c8-55c9-4411-a897-ef3a6ff0d41d None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:52.327082 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ace57c8-55c9-4411-a897-ef3a6ff0d41d None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:52.369472 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4abef9d-4ec0-495c-bfc1-94e20d685bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:52.370546 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4abef9d-4ec0-495c-bfc1-94e20d685bb9 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:52.371022 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4abef9d-4ec0-495c-bfc1-94e20d685bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:52.371511 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4abef9d-4ec0-495c-bfc1-94e20d685bb9 None admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:52.372439 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4abef9d-4ec0-495c-bfc1-94e20d685bb9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:52.372934 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4abef9d-4ec0-495c-bfc1-94e20d685bb9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:52.374551 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4abef9d-4ec0-495c-bfc1-94e20d685bb9 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:52.392710 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 262/547] 10.222.0.118 () {56 vars in 1114 bytes} [Thu Jul 14 15:23:52 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:52.398904 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a573c9-14f3-4ee6-ab56-0357e684c84f None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:52.482022 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:52.554096 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a573c9-14f3-4ee6-ab56-0357e684c84f None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:52.593484 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5382c8-5ac3-4bad-97c9-55aa969f2985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:52.594340 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5382c8-5ac3-4bad-97c9-55aa969f2985 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:52.594588 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5382c8-5ac3-4bad-97c9-55aa969f2985 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:52.594856 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5382c8-5ac3-4bad-97c9-55aa969f2985 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:52.605258 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5382c8-5ac3-4bad-97c9-55aa969f2985 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:52.606734 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5382c8-5ac3-4bad-97c9-55aa969f2985 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:52.624555 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-bf5382c8-5ac3-4bad-97c9-55aa969f2985 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 14 15:23:52.624555 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:52.624555 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:52.624555 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:52.624555 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:52.624555 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:52.624555 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:52.624555 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:52.624555 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:52.624555 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:52.624555 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:52.624555 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:52.624555 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 15:23:52.624555 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 15:23:52.624555 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 15:23:52.624555 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 15:23:52.625525 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:52.625525 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:52.625525 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 15:23:52.625525 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:23:52.625525 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 15:23:52.625525 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:23:52.625525 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:52.625525 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:52.625525 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:52.625525 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:52.625525 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:52.625525 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:52.625525 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:52.625525 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:52.625525 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:52.625525 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:52.625525 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:52.625525 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:52.626969 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:52.626969 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:52.626969 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 15:23:52.626969 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 15:23:52.626969 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 15:23:52.626969 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 15:23:52.626969 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 15:23:52.626969 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 15:23:52.626969 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 14 15:23:52.626969 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:23:52.630189 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 286/548] 10.222.0.118 () {56 vars in 1101 bytes} [Thu Jul 14 15:23:52 2022] GET /identity/v3/users/swift => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:52.632020 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4abef9d-4ec0-495c-bfc1-94e20d685bb9 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:52.692359 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:52.781896 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4abef9d-4ec0-495c-bfc1-94e20d685bb9 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:52.814034 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d2b716-05dd-481f-bde4-e574d58ce22d None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:52.814599 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d2b716-05dd-481f-bde4-e574d58ce22d None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:52.815086 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d2b716-05dd-481f-bde4-e574d58ce22d None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:52.816981 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 287/549] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:23:52 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:23:52.823278 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fa90cc-0260-4153-9966-6c50302e4550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:52.823736 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2653d94e-980c-454b-90d3-c15dcd81f2fc None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:52.823942 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fa90cc-0260-4153-9966-6c50302e4550 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:52.824304 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fa90cc-0260-4153-9966-6c50302e4550 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:52.824584 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fa90cc-0260-4153-9966-6c50302e4550 None admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:52.824878 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2653d94e-980c-454b-90d3-c15dcd81f2fc None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:52.825344 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2653d94e-980c-454b-90d3-c15dcd81f2fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:52.825442 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fa90cc-0260-4153-9966-6c50302e4550 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:52.825728 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fa90cc-0260-4153-9966-6c50302e4550 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:52.827203 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fa90cc-0260-4153-9966-6c50302e4550 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:52.843169 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-2653d94e-980c-454b-90d3-c15dcd81f2fc None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:52.844673 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-2653d94e-980c-454b-90d3-c15dcd81f2fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:52.845987 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 263/550] 10.222.0.118 () {56 vars in 1140 bytes} [Thu Jul 14 15:23:52 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 372 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:52.852198 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2e714c-a54b-412f-a04b-8914603c695d None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:52.852198 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2e714c-a54b-412f-a04b-8914603c695d None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:52.852198 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2e714c-a54b-412f-a04b-8914603c695d None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:52.852198 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 264/551] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:23:52 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:23:52.854289 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2e714c-a54b-412f-a04b-8914603c695d None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:52.937524 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 288/552] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:23:52 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:23:52.939041 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97889eef-3e71-4d90-bc33-aa1b7a638d01 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:52.939333 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97889eef-3e71-4d90-bc33-aa1b7a638d01 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:52.939643 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97889eef-3e71-4d90-bc33-aa1b7a638d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:52.962740 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-97889eef-3e71-4d90-bc33-aa1b7a638d01 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:52.964139 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-97889eef-3e71-4d90-bc33-aa1b7a638d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:52.972186 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:52.979333 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2e714c-a54b-412f-a04b-8914603c695d None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:53.009804 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:53.019155 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f9b654-21bb-4cbe-a3e7-625277bae947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:53.020161 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f9b654-21bb-4cbe-a3e7-625277bae947 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:53.020633 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f9b654-21bb-4cbe-a3e7-625277bae947 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:53.021147 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f9b654-21bb-4cbe-a3e7-625277bae947 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:53.049352 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 289/553] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:23:52 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:23:53.051043 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97889eef-3e71-4d90-bc33-aa1b7a638d01 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:53.100758 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f9b654-21bb-4cbe-a3e7-625277bae947 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:53.102335 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f9b654-21bb-4cbe-a3e7-625277bae947 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:53.164376 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97889eef-3e71-4d90-bc33-aa1b7a638d01 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:53.201861 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5f34b8-8227-4823-8c9a-9f7db779fb03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:53.203104 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5f34b8-8227-4823-8c9a-9f7db779fb03 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:53.203576 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5f34b8-8227-4823-8c9a-9f7db779fb03 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:53.204037 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5f34b8-8227-4823-8c9a-9f7db779fb03 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:53.221541 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5f34b8-8227-4823-8c9a-9f7db779fb03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:23:53.227962 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:53.230075 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-7c5f34b8-8227-4823-8c9a-9f7db779fb03 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:23:53.230075 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:53.230075 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:53.230075 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:53.230075 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:53.230075 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:53.230075 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:53.230075 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:53.230075 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:53.230075 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:53.230075 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:53.230075 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:53.230075 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:23:53.230075 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:23:53.230075 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:23:53.230075 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:23:53.231238 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:23:53.231238 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:23:53.231238 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:23:53.231238 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:23:53.231238 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:53.231238 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:53.231238 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:53.231238 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:53.231238 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:53.231238 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:53.231238 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:53.231238 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:53.231238 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:53.231238 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:53.231238 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:53.231238 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:53.232034 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:53.232034 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:53.232034 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:53.232034 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:53.232034 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:23:53.232034 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:23:53.232034 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:23:53.232034 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:23:53.232034 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:23:53.232034 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:23:53.232034 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:23:53.232034 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:23:53.233364 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 290/554] 10.222.0.118 () {56 vars in 1107 bytes} [Thu Jul 14 15:23:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:53.233364 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5f34b8-8227-4823-8c9a-9f7db779fb03 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:53.238765 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 265/555] 10.222.0.118 () {58 vars in 1287 bytes} [Thu Jul 14 15:23:52 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 15:23:53.239844 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f9b654-21bb-4cbe-a3e7-625277bae947 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:53.272344 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:53.355716 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5f34b8-8227-4823-8c9a-9f7db779fb03 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:53.367819 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f9b654-21bb-4cbe-a3e7-625277bae947 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:53.400694 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec94a8b-ee69-4ae6-932c-f397f76e9a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:53.402259 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec94a8b-ee69-4ae6-932c-f397f76e9a76 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:53.402696 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec94a8b-ee69-4ae6-932c-f397f76e9a76 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:53.403512 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec94a8b-ee69-4ae6-932c-f397f76e9a76 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:53.407167 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c034b2-4b6d-40e7-849a-839dc2bee7be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:53.407941 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c034b2-4b6d-40e7-849a-839dc2bee7be None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:53.408315 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c034b2-4b6d-40e7-849a-839dc2bee7be None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:53.408681 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c034b2-4b6d-40e7-849a-839dc2bee7be None admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:53.409656 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c034b2-4b6d-40e7-849a-839dc2bee7be None admin] RBAC: Adding query filter params (name=service) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:53.409955 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c034b2-4b6d-40e7-849a-839dc2bee7be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:53.411477 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c034b2-4b6d-40e7-849a-839dc2bee7be None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:53.416677 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec94a8b-ee69-4ae6-932c-f397f76e9a76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:23:53.420765 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 266/556] 10.222.0.118 () {56 vars in 1108 bytes} [Thu Jul 14 15:23:53 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:53.421755 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c034b2-4b6d-40e7-849a-839dc2bee7be None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:53.427406 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-7ec94a8b-ee69-4ae6-932c-f397f76e9a76 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:23:53.427406 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:53.427406 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:53.427406 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:53.427406 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:53.427406 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:53.427406 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:53.427406 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:53.427406 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:53.427406 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:53.427406 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:53.427406 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:53.427406 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:23:53.427406 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:23:53.427406 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:23:53.427406 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:23:53.428329 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:23:53.428329 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:23:53.428329 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:23:53.428329 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:23:53.428329 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:53.428329 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:53.428329 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:53.428329 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:53.428329 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:53.428329 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:53.428329 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:53.428329 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:53.428329 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:53.428329 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:53.428329 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:53.428329 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:53.429115 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:53.429115 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:53.429115 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:53.429115 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:53.429115 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:23:53.429115 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:23:53.429115 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:23:53.429115 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:23:53.429115 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:23:53.429115 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:23:53.429115 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:23:53.429115 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:23:53.433385 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 291/557] 10.222.0.118 () {56 vars in 1107 bytes} [Thu Jul 14 15:23:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:53.434918 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec94a8b-ee69-4ae6-932c-f397f76e9a76 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:53.492885 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:53.543838 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c034b2-4b6d-40e7-849a-839dc2bee7be None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:53.551336 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:53.562585 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec94a8b-ee69-4ae6-932c-f397f76e9a76 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:53.585918 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c432ef77-509a-4dc4-8733-bde4540871ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:53.586740 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c432ef77-509a-4dc4-8733-bde4540871ec None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:53.587014 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c432ef77-509a-4dc4-8733-bde4540871ec None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:53.587283 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c432ef77-509a-4dc4-8733-bde4540871ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:53.599300 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c432ef77-509a-4dc4-8733-bde4540871ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:53.601031 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c432ef77-509a-4dc4-8733-bde4540871ec None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:53.606470 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db1af4d-998c-492a-b515-dcd61332dc1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:53.607510 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db1af4d-998c-492a-b515-dcd61332dc1e None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:53.608358 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db1af4d-998c-492a-b515-dcd61332dc1e None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:53.609274 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db1af4d-998c-492a-b515-dcd61332dc1e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:53.619630 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-c432ef77-509a-4dc4-8733-bde4540871ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:23:53.619630 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:53.619630 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:53.619630 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:53.619630 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:53.619630 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:53.619630 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:53.619630 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:53.619630 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:53.619630 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:53.619630 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:53.619630 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:53.619630 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:23:53.619630 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:23:53.619630 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:23:53.620509 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:23:53.620509 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:53.620509 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:53.620509 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:53.620509 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:53.620509 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:53.620509 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:53.620509 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:53.620509 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:53.620509 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:53.620509 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:53.620509 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:53.620509 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:53.620509 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:53.620509 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:53.620509 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:53.620509 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:53.621387 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:23:53.621387 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:23:53.621387 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:23:53.621387 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:23:53.623890 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db1af4d-998c-492a-b515-dcd61332dc1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:53.625745 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 267/558] 10.222.0.118 () {56 vars in 1113 bytes} [Thu Jul 14 15:23:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:53.625994 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db1af4d-998c-492a-b515-dcd61332dc1e None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:53.626855 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c432ef77-509a-4dc4-8733-bde4540871ec None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:53.649482 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-9db1af4d-998c-492a-b515-dcd61332dc1e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:23:53.649482 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:53.649482 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:53.649482 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:53.649482 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:53.649482 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:53.649482 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:53.649482 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:53.649482 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:53.649482 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:53.649482 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:53.649482 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:53.649482 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:23:53.649482 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:23:53.649482 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:23:53.650444 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:23:53.650444 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:53.650444 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:53.650444 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:53.650444 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:53.650444 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:53.650444 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:53.650444 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:53.650444 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:53.650444 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:53.650444 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:53.650444 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:53.650444 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:53.650444 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:53.650444 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:53.650444 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:53.650444 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:53.651288 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:23:53.651288 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:23:53.651288 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:23:53.651288 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:23:53.654321 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 292/559] 10.222.0.118 () {56 vars in 1113 bytes} [Thu Jul 14 15:23:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:53.655517 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db1af4d-998c-492a-b515-dcd61332dc1e None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:53.756815 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c432ef77-509a-4dc4-8733-bde4540871ec None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:53.773601 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:53.777075 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db1af4d-998c-492a-b515-dcd61332dc1e None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:53.796755 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c532cc-9793-413d-a50b-b3bb7324fbcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:53.797654 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c532cc-9793-413d-a50b-b3bb7324fbcd None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:53.797931 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c532cc-9793-413d-a50b-b3bb7324fbcd None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:53.798234 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c532cc-9793-413d-a50b-b3bb7324fbcd None admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:53.800607 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c532cc-9793-413d-a50b-b3bb7324fbcd None admin] RBAC: Adding query filter params (name=service) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:53.800607 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c532cc-9793-413d-a50b-b3bb7324fbcd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:53.801842 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c532cc-9793-413d-a50b-b3bb7324fbcd None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:53.816843 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 268/560] 10.222.0.118 () {56 vars in 1108 bytes} [Thu Jul 14 15:23:53 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:53.816843 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c532cc-9793-413d-a50b-b3bb7324fbcd None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:53.823412 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29049119-955d-4d66-a68a-e6dfe133d686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:53.824082 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29049119-955d-4d66-a68a-e6dfe133d686 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:53.824363 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29049119-955d-4d66-a68a-e6dfe133d686 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:53.824640 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29049119-955d-4d66-a68a-e6dfe133d686 None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:53.825371 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29049119-955d-4d66-a68a-e6dfe133d686 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:53.825678 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29049119-955d-4d66-a68a-e6dfe133d686 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:53.827081 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29049119-955d-4d66-a68a-e6dfe133d686 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:53.839119 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 293/561] 10.222.0.118 () {56 vars in 1114 bytes} [Thu Jul 14 15:23:53 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:53.840550 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127a5979-ae03-4791-8ccf-de4353b38849 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:53.840838 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127a5979-ae03-4791-8ccf-de4353b38849 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:53.841114 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127a5979-ae03-4791-8ccf-de4353b38849 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:53.842372 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 294/562] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:23:53 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:23:53.843064 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127a5979-ae03-4791-8ccf-de4353b38849 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:53.847455 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:53.928713 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c532cc-9793-413d-a50b-b3bb7324fbcd None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:53.950515 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127a5979-ae03-4791-8ccf-de4353b38849 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:53.962191 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1a4664-91f0-46c3-b126-fa1706ff3945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:53.962849 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a4664-91f0-46c3-b126-fa1706ff3945 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:53.963131 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a4664-91f0-46c3-b126-fa1706ff3945 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:53.963408 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a4664-91f0-46c3-b126-fa1706ff3945 None admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:53.964132 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1a4664-91f0-46c3-b126-fa1706ff3945 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:53.964439 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1a4664-91f0-46c3-b126-fa1706ff3945 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:53.965833 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1a4664-91f0-46c3-b126-fa1706ff3945 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:53.977298 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 269/563] 10.222.0.118 () {56 vars in 1114 bytes} [Thu Jul 14 15:23:53 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:53.978561 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03b9532-7047-49f3-9481-86938802f656 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:53.978843 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03b9532-7047-49f3-9481-86938802f656 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:53.979116 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03b9532-7047-49f3-9481-86938802f656 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:53.980349 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 270/564] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:23:53 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:23:53.981043 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03b9532-7047-49f3-9481-86938802f656 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:53.990647 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb2a572-4182-4fae-a525-17afb3ccfb8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:53.991435 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb2a572-4182-4fae-a525-17afb3ccfb8f None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:53.991710 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb2a572-4182-4fae-a525-17afb3ccfb8f None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:53.991977 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb2a572-4182-4fae-a525-17afb3ccfb8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:54.001949 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb2a572-4182-4fae-a525-17afb3ccfb8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:54.004038 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb2a572-4182-4fae-a525-17afb3ccfb8f None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:54.016397 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:54.021626 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-8eb2a572-4182-4fae-a525-17afb3ccfb8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:23:54.021626 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:54.021626 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:54.021626 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:54.021626 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:54.021626 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:54.021626 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:54.021626 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:54.021626 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:54.021626 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:54.021626 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:54.021626 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:54.021626 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:23:54.021626 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:23:54.021626 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:23:54.022563 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:23:54.022563 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:54.022563 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:54.022563 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:54.022563 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:54.022563 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:54.022563 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:54.022563 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:54.022563 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:54.022563 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:54.022563 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:54.022563 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:54.022563 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:54.022563 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:54.022563 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:54.022563 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:54.022563 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:54.023429 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:23:54.023429 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:23:54.023429 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:23:54.023429 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:23:54.023429 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 295/565] 10.222.0.118 () {56 vars in 1113 bytes} [Thu Jul 14 15:23:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:54.024125 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fd7178-e574-4a1e-9116-206a6736127b None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:54.024346 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fd7178-e574-4a1e-9116-206a6736127b None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:54.024615 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fd7178-e574-4a1e-9116-206a6736127b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:54.040397 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-a6fd7178-e574-4a1e-9116-206a6736127b None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:54.041581 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-a6fd7178-e574-4a1e-9116-206a6736127b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:54.087056 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03b9532-7047-49f3-9481-86938802f656 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:54.091012 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:54.108316 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 296/566] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:23:54 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:23:54.109130 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fd7178-e574-4a1e-9116-206a6736127b None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:54.136904 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976799ff-30fb-4aac-aeb8-4f2763559f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:54.137781 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976799ff-30fb-4aac-aeb8-4f2763559f8a None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:54.138158 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976799ff-30fb-4aac-aeb8-4f2763559f8a None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:54.138493 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976799ff-30fb-4aac-aeb8-4f2763559f8a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:54.145163 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976799ff-30fb-4aac-aeb8-4f2763559f8a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:54.146722 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976799ff-30fb-4aac-aeb8-4f2763559f8a None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:54.160571 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-976799ff-30fb-4aac-aeb8-4f2763559f8a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:23:54.160571 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:54.160571 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:54.160571 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:54.160571 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:54.160571 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:54.160571 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:54.160571 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:54.160571 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:54.160571 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:54.160571 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:54.160571 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:54.160571 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 15:23:54.160571 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 15:23:54.160571 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 15:23:54.161619 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 15:23:54.161619 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:54.161619 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:54.161619 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:54.161619 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:54.161619 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:54.161619 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:54.161619 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:54.161619 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:54.161619 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:54.161619 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:54.161619 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:54.161619 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:54.161619 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:54.161619 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:54.161619 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:54.161619 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:54.167427 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 15:23:54.167427 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 15:23:54.167427 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:23:54.167427 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:23:54.167427 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:23:54.167427 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:23:54.167427 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:23:54.167427 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:23:54.167427 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 271/567] 10.222.0.118 () {56 vars in 1116 bytes} [Thu Jul 14 15:23:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:54.167427 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef38036f-5a85-445c-b8d6-900776fc61f2 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:54.167427 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef38036f-5a85-445c-b8d6-900776fc61f2 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:54.168037 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef38036f-5a85-445c-b8d6-900776fc61f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:54.188691 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-ef38036f-5a85-445c-b8d6-900776fc61f2 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:54.189903 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-ef38036f-5a85-445c-b8d6-900776fc61f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:54.209799 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fd7178-e574-4a1e-9116-206a6736127b None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:54.246984 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b0bf17-7770-4e6f-a558-0f6a62353598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:54.247766 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b0bf17-7770-4e6f-a558-0f6a62353598 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:54.248042 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b0bf17-7770-4e6f-a558-0f6a62353598 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:54.248310 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b0bf17-7770-4e6f-a558-0f6a62353598 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:54.255799 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b0bf17-7770-4e6f-a558-0f6a62353598 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:54.257242 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b0bf17-7770-4e6f-a558-0f6a62353598 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:54.259464 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 272/568] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:23:54 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:23:54.260307 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef38036f-5a85-445c-b8d6-900776fc61f2 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:54.271881 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-e5b0bf17-7770-4e6f-a558-0f6a62353598 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 15:23:54.271881 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:54.271881 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:54.271881 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:54.271881 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:54.271881 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:54.271881 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:54.271881 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:54.271881 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:54.271881 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:54.271881 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:54.271881 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:54.271881 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 15:23:54.271881 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 15:23:54.271881 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 15:23:54.271881 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 15:23:54.272788 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:54.272788 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:54.272788 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 15:23:54.272788 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:23:54.272788 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 15:23:54.272788 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:23:54.272788 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:54.272788 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:54.272788 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:54.272788 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:54.272788 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:54.272788 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:54.272788 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:54.272788 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:54.272788 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:54.272788 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:54.272788 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:54.272788 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:54.273783 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:54.273783 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:54.273783 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 15:23:54.273783 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 15:23:54.273783 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 15:23:54.273783 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 15:23:54.273783 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 15:23:54.273783 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 15:23:54.273783 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 15:23:54.273783 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:23:54.273783 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 297/569] 10.222.0.118 () {56 vars in 1098 bytes} [Thu Jul 14 15:23:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:54.274757 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b0bf17-7770-4e6f-a558-0f6a62353598 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:54.290228 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:54.322348 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:54.364439 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef38036f-5a85-445c-b8d6-900776fc61f2 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:54.376491 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b0bf17-7770-4e6f-a558-0f6a62353598 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:54.397976 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2740942-aa48-4abe-8328-77598a41b746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:54.398812 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2740942-aa48-4abe-8328-77598a41b746 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:54.399095 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2740942-aa48-4abe-8328-77598a41b746 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:54.399375 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2740942-aa48-4abe-8328-77598a41b746 None admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:54.400151 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2740942-aa48-4abe-8328-77598a41b746 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:54.400460 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2740942-aa48-4abe-8328-77598a41b746 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:54.401882 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2740942-aa48-4abe-8328-77598a41b746 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:54.411455 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f41c4f-48b7-4606-b385-f63b5e845b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:54.412323 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f41c4f-48b7-4606-b385-f63b5e845b2f None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:54.412604 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f41c4f-48b7-4606-b385-f63b5e845b2f None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:54.412873 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f41c4f-48b7-4606-b385-f63b5e845b2f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:54.413649 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 273/570] 10.222.0.118 () {56 vars in 1114 bytes} [Thu Jul 14 15:23:54 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:54.414481 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2740942-aa48-4abe-8328-77598a41b746 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:54.423277 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f41c4f-48b7-4606-b385-f63b5e845b2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:23:54.431515 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-c1f41c4f-48b7-4606-b385-f63b5e845b2f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:23:54.431515 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:54.431515 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:54.431515 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:54.431515 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:54.431515 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:54.431515 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:54.431515 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:54.431515 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:54.431515 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:54.431515 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:54.431515 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:54.431515 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:23:54.431515 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:23:54.431515 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:23:54.431515 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:23:54.432396 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:23:54.432396 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:23:54.432396 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:23:54.432396 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:23:54.432396 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:54.432396 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:54.432396 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:54.432396 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:54.432396 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:54.432396 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:54.432396 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:54.432396 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:54.432396 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:54.432396 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:54.432396 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:54.432396 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:54.433207 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:54.433207 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:54.433207 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:54.433207 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:54.433207 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:23:54.433207 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:23:54.433207 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:23:54.433207 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:23:54.433207 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:23:54.433207 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:23:54.433207 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:23:54.433207 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:23:54.433207 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 298/571] 10.222.0.118 () {56 vars in 1107 bytes} [Thu Jul 14 15:23:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:54.434122 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f41c4f-48b7-4606-b385-f63b5e845b2f None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:54.503118 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:54.519261 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2740942-aa48-4abe-8328-77598a41b746 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:54.536083 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f41c4f-48b7-4606-b385-f63b5e845b2f None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:54.542860 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:54.552333 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9142d78-ae0b-45a2-9e4f-7e2d3a127560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:54.552998 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9142d78-ae0b-45a2-9e4f-7e2d3a127560 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:54.553280 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9142d78-ae0b-45a2-9e4f-7e2d3a127560 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:54.553560 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9142d78-ae0b-45a2-9e4f-7e2d3a127560 None admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:54.554377 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9142d78-ae0b-45a2-9e4f-7e2d3a127560 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:54.554689 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9142d78-ae0b-45a2-9e4f-7e2d3a127560 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:54.556132 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9142d78-ae0b-45a2-9e4f-7e2d3a127560 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:54.567991 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 274/572] 10.222.0.118 () {56 vars in 1153 bytes} [Thu Jul 14 15:23:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:54.568877 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9142d78-ae0b-45a2-9e4f-7e2d3a127560 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:54.570459 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe6e8ce-bbf2-493b-a1d2-6d9e4a71b03c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:54.571128 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe6e8ce-bbf2-493b-a1d2-6d9e4a71b03c None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:54.571513 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe6e8ce-bbf2-493b-a1d2-6d9e4a71b03c None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:54.571775 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe6e8ce-bbf2-493b-a1d2-6d9e4a71b03c None admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:54.572820 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe6e8ce-bbf2-493b-a1d2-6d9e4a71b03c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:54.573156 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe6e8ce-bbf2-493b-a1d2-6d9e4a71b03c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:54.574600 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe6e8ce-bbf2-493b-a1d2-6d9e4a71b03c None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:54.592730 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 299/573] 10.222.0.118 () {56 vars in 1138 bytes} [Thu Jul 14 15:23:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:54.593513 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe6e8ce-bbf2-493b-a1d2-6d9e4a71b03c None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:54.671530 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9142d78-ae0b-45a2-9e4f-7e2d3a127560 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:54.692559 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe6e8ce-bbf2-493b-a1d2-6d9e4a71b03c None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:54.706304 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2896f09-843a-429c-9014-2fbf8e2a774a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:54.707103 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2896f09-843a-429c-9014-2fbf8e2a774a None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:54.707381 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2896f09-843a-429c-9014-2fbf8e2a774a None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:54.707656 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2896f09-843a-429c-9014-2fbf8e2a774a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:54.718813 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2896f09-843a-429c-9014-2fbf8e2a774a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:23:54.726929 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baf0e85-e503-4f6a-b84d-3e3a1a2ea0ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:54.727123 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-c2896f09-843a-429c-9014-2fbf8e2a774a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:23:54.727123 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:54.727123 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:54.727123 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:54.727123 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:54.727123 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:54.727123 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:54.727123 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:54.727123 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:54.727123 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:54.727123 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:54.727123 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:54.727123 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:23:54.727123 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:23:54.727123 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:23:54.727123 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:23:54.728167 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:23:54.728167 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:23:54.728167 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:23:54.728167 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:23:54.728167 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:54.728167 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:54.728167 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:54.728167 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:54.728167 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:54.728167 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:54.728167 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:54.728167 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:54.728167 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:54.728167 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:54.728167 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:54.728167 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:54.729008 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:54.729008 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:54.729008 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:54.729008 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:54.729008 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:23:54.729008 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:23:54.729008 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:23:54.729008 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:23:54.729008 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:23:54.729008 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:23:54.729008 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:23:54.729008 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:23:54.729625 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baf0e85-e503-4f6a-b84d-3e3a1a2ea0ed None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:54.729625 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baf0e85-e503-4f6a-b84d-3e3a1a2ea0ed None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:54.729625 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baf0e85-e503-4f6a-b84d-3e3a1a2ea0ed None admin] PATH_INFO: `/v3/users/glance` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:54.729823 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 275/574] 10.222.0.118 () {56 vars in 1107 bytes} [Thu Jul 14 15:23:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:54.729823 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2896f09-843a-429c-9014-2fbf8e2a774a None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:54.735119 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:54.739367 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baf0e85-e503-4f6a-b84d-3e3a1a2ea0ed None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:54.740822 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baf0e85-e503-4f6a-b84d-3e3a1a2ea0ed None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:54.756221 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-5baf0e85-e503-4f6a-b84d-3e3a1a2ea0ed None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 14 15:23:54.756221 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:54.756221 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:54.756221 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:54.756221 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:54.756221 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:54.756221 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:54.756221 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:54.756221 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:54.756221 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:54.756221 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:54.756221 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:54.756221 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 15:23:54.756221 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 15:23:54.756221 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 15:23:54.756221 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 15:23:54.757315 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:54.757315 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:54.757315 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 15:23:54.757315 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:23:54.757315 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 15:23:54.757315 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:23:54.757315 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:54.757315 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:54.757315 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:54.757315 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:54.757315 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:54.757315 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:54.757315 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:54.757315 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:54.757315 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:54.757315 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:54.757315 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:54.757315 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:54.758518 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:54.758518 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:54.758518 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 15:23:54.758518 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 15:23:54.758518 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 15:23:54.758518 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 15:23:54.758518 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 15:23:54.758518 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 15:23:54.758518 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 14 15:23:54.758518 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:23:54.758518 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 300/575] 10.222.0.118 () {56 vars in 1104 bytes} [Thu Jul 14 15:23:54 2022] GET /identity/v3/users/glance => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:54.758518 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baf0e85-e503-4f6a-b84d-3e3a1a2ea0ed None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:54.786646 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:54.836364 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2896f09-843a-429c-9014-2fbf8e2a774a None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:54.859879 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baf0e85-e503-4f6a-b84d-3e3a1a2ea0ed None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:54.871453 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884517bc-9bab-4784-97b9-02068c3fa968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:54.872198 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884517bc-9bab-4784-97b9-02068c3fa968 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:54.872479 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884517bc-9bab-4784-97b9-02068c3fa968 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:54.872755 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884517bc-9bab-4784-97b9-02068c3fa968 None admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:54.873506 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884517bc-9bab-4784-97b9-02068c3fa968 None admin] RBAC: Adding query filter params (name=service) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:54.873816 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884517bc-9bab-4784-97b9-02068c3fa968 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:54.875244 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884517bc-9bab-4784-97b9-02068c3fa968 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:54.883402 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 276/576] 10.222.0.118 () {56 vars in 1108 bytes} [Thu Jul 14 15:23:54 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:54.884186 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884517bc-9bab-4784-97b9-02068c3fa968 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:54.893144 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2eba93-dcf1-472c-8ff4-f17c87487142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:54.893815 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2eba93-dcf1-472c-8ff4-f17c87487142 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:54.894119 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2eba93-dcf1-472c-8ff4-f17c87487142 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:54.894389 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2eba93-dcf1-472c-8ff4-f17c87487142 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:54.895214 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2eba93-dcf1-472c-8ff4-f17c87487142 None admin] RBAC: Adding query filter params (role.id=3185f450429e4bb3b5f289b615f3269b, scope.project.id=939bf9541f4a4afe86550f749d337680, user.id=b672a6a601584d2d826147069e90a10f) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:54.895523 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2eba93-dcf1-472c-8ff4-f17c87487142 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:54.896936 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2eba93-dcf1-472c-8ff4-f17c87487142 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:54.902388 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 301/577] 10.222.0.118 () {56 vars in 1379 bytes} [Thu Jul 14 15:23:54 2022] GET /identity/v3/role_assignments?user.id=b672a6a601584d2d826147069e90a10f&scope.project.id=939bf9541f4a4afe86550f749d337680&role.id=3185f450429e4bb3b5f289b615f3269b => generated 260 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:54.903211 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2eba93-dcf1-472c-8ff4-f17c87487142 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:54.961246 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:55.001717 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884517bc-9bab-4784-97b9-02068c3fa968 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:55.007583 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:55.021748 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2eba93-dcf1-472c-8ff4-f17c87487142 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:55.042332 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdafd5f0-3be6-4b98-b773-ccb89763def3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:55.043055 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdafd5f0-3be6-4b98-b773-ccb89763def3 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:55.043330 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdafd5f0-3be6-4b98-b773-ccb89763def3 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:55.043600 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdafd5f0-3be6-4b98-b773-ccb89763def3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:55.056931 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdafd5f0-3be6-4b98-b773-ccb89763def3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:55.058586 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdafd5f0-3be6-4b98-b773-ccb89763def3 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:55.061292 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe3198d-cc9d-455b-8522-dae7c71a51b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:55.062018 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe3198d-cc9d-455b-8522-dae7c71a51b7 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:55.062899 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe3198d-cc9d-455b-8522-dae7c71a51b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:55.062899 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe3198d-cc9d-455b-8522-dae7c71a51b7 None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:55.063314 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe3198d-cc9d-455b-8522-dae7c71a51b7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:55.063965 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe3198d-cc9d-455b-8522-dae7c71a51b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:55.064978 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe3198d-cc9d-455b-8522-dae7c71a51b7 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:55.077895 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 302/578] 10.222.0.118 () {56 vars in 1108 bytes} [Thu Jul 14 15:23:54 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:55.077895 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe3198d-cc9d-455b-8522-dae7c71a51b7 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:55.078696 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-fdafd5f0-3be6-4b98-b773-ccb89763def3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:23:55.078696 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:55.078696 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:55.078696 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:55.078696 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:55.078696 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:55.078696 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:55.078696 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:55.078696 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:55.078696 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:55.078696 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:55.078696 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:55.078696 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:23:55.078696 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:23:55.078696 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:23:55.079518 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:23:55.079518 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:55.079518 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:55.079518 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:55.079518 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:55.079518 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:55.079518 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:55.079518 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:55.079518 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:55.079518 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:55.079518 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:55.079518 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:55.079518 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:55.079518 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:55.079518 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:55.079518 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:55.079518 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:55.080383 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:23:55.080383 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:23:55.080383 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:23:55.080383 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:23:55.080383 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 277/579] 10.222.0.118 () {56 vars in 1113 bytes} [Thu Jul 14 15:23:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:55.080383 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdafd5f0-3be6-4b98-b773-ccb89763def3 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:55.188233 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdafd5f0-3be6-4b98-b773-ccb89763def3 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:55.191203 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe3198d-cc9d-455b-8522-dae7c71a51b7 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:55.207575 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:55.225737 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54d9f04-6255-429d-86e8-0aee34977061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:55.226559 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54d9f04-6255-429d-86e8-0aee34977061 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:55.226844 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54d9f04-6255-429d-86e8-0aee34977061 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:55.227115 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54d9f04-6255-429d-86e8-0aee34977061 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:55.228132 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b23e96-f20a-471d-b546-1064512aaa76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:55.228909 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b23e96-f20a-471d-b546-1064512aaa76 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:55.229086 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b23e96-f20a-471d-b546-1064512aaa76 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:55.229361 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b23e96-f20a-471d-b546-1064512aaa76 None admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:55.230225 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b23e96-f20a-471d-b546-1064512aaa76 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:55.230532 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b23e96-f20a-471d-b546-1064512aaa76 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:55.231971 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b23e96-f20a-471d-b546-1064512aaa76 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:55.239888 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54d9f04-6255-429d-86e8-0aee34977061 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:55.241588 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54d9f04-6255-429d-86e8-0aee34977061 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:55.254588 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 303/580] 10.222.0.118 () {56 vars in 1142 bytes} [Thu Jul 14 15:23:55 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 374 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:55.255749 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b23e96-f20a-471d-b546-1064512aaa76 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:55.260800 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-e54d9f04-6255-429d-86e8-0aee34977061 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:23:55.260800 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:55.260800 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:55.260800 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:55.260800 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:55.260800 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:55.260800 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:55.260800 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:55.260800 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:55.260800 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:55.260800 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:55.260800 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:55.260800 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:23:55.260800 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:23:55.260800 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:23:55.261683 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:23:55.261683 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:55.261683 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:55.261683 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:55.261683 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:55.261683 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:55.261683 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:55.261683 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:55.261683 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:55.261683 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:55.261683 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:55.261683 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:55.261683 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:55.261683 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:55.261683 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:55.261683 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:55.261683 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:55.262891 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:23:55.262891 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:23:55.262891 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:23:55.262891 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:23:55.268012 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 278/581] 10.222.0.118 () {56 vars in 1113 bytes} [Thu Jul 14 15:23:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:55.268012 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54d9f04-6255-429d-86e8-0aee34977061 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:55.268948 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:55.363757 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b23e96-f20a-471d-b546-1064512aaa76 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:55.376168 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54d9f04-6255-429d-86e8-0aee34977061 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:55.401523 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab6bac4-a929-488b-bb9b-41cca4856707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:55.402317 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab6bac4-a929-488b-bb9b-41cca4856707 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:55.402593 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab6bac4-a929-488b-bb9b-41cca4856707 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:55.402860 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab6bac4-a929-488b-bb9b-41cca4856707 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:55.413572 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edbfb84-11b3-4b15-ab37-1d63e8944b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:55.414069 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab6bac4-a929-488b-bb9b-41cca4856707 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:55.414317 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edbfb84-11b3-4b15-ab37-1d63e8944b62 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:55.414538 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edbfb84-11b3-4b15-ab37-1d63e8944b62 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:55.414810 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edbfb84-11b3-4b15-ab37-1d63e8944b62 None admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:55.415518 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab6bac4-a929-488b-bb9b-41cca4856707 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:55.415616 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edbfb84-11b3-4b15-ab37-1d63e8944b62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:55.415822 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edbfb84-11b3-4b15-ab37-1d63e8944b62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:55.417178 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edbfb84-11b3-4b15-ab37-1d63e8944b62 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:55.429350 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 279/582] 10.222.0.118 () {56 vars in 1114 bytes} [Thu Jul 14 15:23:55 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:55.430193 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edbfb84-11b3-4b15-ab37-1d63e8944b62 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:55.434778 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-2ab6bac4-a929-488b-bb9b-41cca4856707 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:23:55.434778 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:55.434778 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:55.434778 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:55.434778 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:55.434778 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:55.434778 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:55.434778 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:55.434778 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:55.434778 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:55.434778 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:55.434778 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:55.434778 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:23:55.434778 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:23:55.434778 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:23:55.435662 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:23:55.435662 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:55.435662 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:55.435662 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:55.435662 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:55.435662 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:55.435662 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:55.435662 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:55.435662 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:55.435662 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:55.435662 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:55.435662 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:55.435662 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:55.435662 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:55.435662 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:55.435662 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:55.435662 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:55.436545 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:23:55.436545 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:23:55.436545 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:23:55.436545 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:23:55.436545 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 304/583] 10.222.0.118 () {56 vars in 1113 bytes} [Thu Jul 14 15:23:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:55.436852 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab6bac4-a929-488b-bb9b-41cca4856707 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:55.473128 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:55.501291 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:55.545187 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab6bac4-a929-488b-bb9b-41cca4856707 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:55.545642 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edbfb84-11b3-4b15-ab37-1d63e8944b62 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:55.580350 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7305892a-6789-4ca5-9d81-e354f603b8eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:55.581077 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3dc044-a1d2-418f-8e70-7940084cf4bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:55.581293 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7305892a-6789-4ca5-9d81-e354f603b8eb None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:55.581523 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7305892a-6789-4ca5-9d81-e354f603b8eb None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:55.581739 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3dc044-a1d2-418f-8e70-7940084cf4bd None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:55.581839 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7305892a-6789-4ca5-9d81-e354f603b8eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:55.582053 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3dc044-a1d2-418f-8e70-7940084cf4bd None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:55.582363 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3dc044-a1d2-418f-8e70-7940084cf4bd None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:55.583052 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3dc044-a1d2-418f-8e70-7940084cf4bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:55.583356 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3dc044-a1d2-418f-8e70-7940084cf4bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:55.584732 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3dc044-a1d2-418f-8e70-7940084cf4bd None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:55.592600 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7305892a-6789-4ca5-9d81-e354f603b8eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:55.594085 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7305892a-6789-4ca5-9d81-e354f603b8eb None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:55.597452 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 305/584] 10.222.0.118 () {56 vars in 1114 bytes} [Thu Jul 14 15:23:55 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:55.598393 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3dc044-a1d2-418f-8e70-7940084cf4bd None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:55.614545 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-7305892a-6789-4ca5-9d81-e354f603b8eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:23:55.614545 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:55.614545 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:55.614545 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:55.614545 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:55.614545 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:55.614545 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:55.614545 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:55.614545 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:55.614545 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:55.614545 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:55.614545 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:55.614545 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:23:55.614545 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:23:55.614545 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:23:55.615433 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:23:55.615433 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:55.615433 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:55.615433 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:55.615433 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:55.615433 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:55.615433 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:55.615433 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:55.615433 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:55.615433 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:55.615433 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:55.615433 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:55.615433 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:55.615433 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:55.615433 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:55.615433 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:55.615433 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:55.616282 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:23:55.616282 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:23:55.616282 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:23:55.616282 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:23:55.620087 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 280/585] 10.222.0.118 () {56 vars in 1113 bytes} [Thu Jul 14 15:23:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:55.620889 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7305892a-6789-4ca5-9d81-e354f603b8eb None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:55.706502 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3dc044-a1d2-418f-8e70-7940084cf4bd None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:55.709947 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:55.732857 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:55.734097 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7305892a-6789-4ca5-9d81-e354f603b8eb None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:55.750043 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47855a2c-42a3-48dd-9877-eb59178f186b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:55.750834 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47855a2c-42a3-48dd-9877-eb59178f186b None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:55.751231 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47855a2c-42a3-48dd-9877-eb59178f186b None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:55.751507 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47855a2c-42a3-48dd-9877-eb59178f186b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:55.759174 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47855a2c-42a3-48dd-9877-eb59178f186b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:55.760731 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47855a2c-42a3-48dd-9877-eb59178f186b None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:55.769350 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0483a0b5-c421-4e44-9786-b93ba7e1059a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:55.770037 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0483a0b5-c421-4e44-9786-b93ba7e1059a None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:55.770324 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0483a0b5-c421-4e44-9786-b93ba7e1059a None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:55.770604 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0483a0b5-c421-4e44-9786-b93ba7e1059a None admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:55.771307 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0483a0b5-c421-4e44-9786-b93ba7e1059a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:55.771644 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0483a0b5-c421-4e44-9786-b93ba7e1059a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:55.772998 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0483a0b5-c421-4e44-9786-b93ba7e1059a None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:55.775322 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-47855a2c-42a3-48dd-9877-eb59178f186b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:23:55.775322 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:55.775322 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:55.775322 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:55.775322 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:55.775322 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:55.775322 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:55.775322 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:55.775322 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:55.775322 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:55.775322 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:55.775322 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:55.775322 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 15:23:55.775322 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 15:23:55.775322 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 15:23:55.776176 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 15:23:55.776176 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:55.776176 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:55.776176 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:55.776176 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:55.776176 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:55.776176 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:55.776176 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:55.776176 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:55.776176 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:55.776176 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:55.776176 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:55.776176 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:55.776176 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:55.776176 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:55.776176 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:55.776176 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:55.777044 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 15:23:55.777044 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 15:23:55.777044 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:23:55.777044 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:23:55.777044 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:23:55.777044 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:23:55.777044 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:23:55.777044 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:23:55.777044 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 306/586] 10.222.0.118 () {56 vars in 1116 bytes} [Thu Jul 14 15:23:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:55.777512 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47855a2c-42a3-48dd-9877-eb59178f186b None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:55.788850 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 281/587] 10.222.0.118 () {56 vars in 1114 bytes} [Thu Jul 14 15:23:55 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:55.789887 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0483a0b5-c421-4e44-9786-b93ba7e1059a None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:55.889477 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47855a2c-42a3-48dd-9877-eb59178f186b None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:55.899286 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0483a0b5-c421-4e44-9786-b93ba7e1059a None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:55.926783 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f16a050-8aa1-4b92-964d-2645f87d688c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:55.927583 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f16a050-8aa1-4b92-964d-2645f87d688c None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:55.927861 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f16a050-8aa1-4b92-964d-2645f87d688c None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:55.928136 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f16a050-8aa1-4b92-964d-2645f87d688c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:55.935200 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f16a050-8aa1-4b92-964d-2645f87d688c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:55.935503 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52f8d44-e2ae-4951-abe8-85ee528661fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:55.936166 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52f8d44-e2ae-4951-abe8-85ee528661fc None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:55.936447 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52f8d44-e2ae-4951-abe8-85ee528661fc None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:55.936642 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f16a050-8aa1-4b92-964d-2645f87d688c None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:55.936757 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52f8d44-e2ae-4951-abe8-85ee528661fc None admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:55.937427 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52f8d44-e2ae-4951-abe8-85ee528661fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:55.937751 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52f8d44-e2ae-4951-abe8-85ee528661fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:55.939496 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52f8d44-e2ae-4951-abe8-85ee528661fc None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:55.956488 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 282/588] 10.222.0.118 () {56 vars in 1114 bytes} [Thu Jul 14 15:23:55 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:55.956705 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-9f16a050-8aa1-4b92-964d-2645f87d688c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 15:23:55.956705 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:55.956705 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:55.956705 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:55.956705 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:55.956705 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:55.956705 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:55.956705 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:55.956705 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:55.956705 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:55.956705 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:55.956705 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:55.956705 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 15:23:55.956705 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 15:23:55.956705 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 15:23:55.956705 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 15:23:55.957557 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:55.957557 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:55.957557 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 15:23:55.957557 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:23:55.957557 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 15:23:55.957557 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:23:55.957557 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:55.957557 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:55.957557 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:55.957557 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:55.957557 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:55.957557 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:55.957557 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:55.957557 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:55.957557 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:55.957557 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:55.957557 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:55.957557 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:55.958511 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:55.958511 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:55.958511 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 15:23:55.958511 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 15:23:55.958511 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 15:23:55.958511 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 15:23:55.958511 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 15:23:55.958511 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 15:23:55.958511 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 15:23:55.958511 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:23:55.959108 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52f8d44-e2ae-4951-abe8-85ee528661fc None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:55.959177 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 307/589] 10.222.0.118 () {56 vars in 1104 bytes} [Thu Jul 14 15:23:55 2022] GET /identity/v3/users/cinder => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:55.959177 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f16a050-8aa1-4b92-964d-2645f87d688c None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:55.962331 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:56.006400 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:56.066654 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52f8d44-e2ae-4951-abe8-85ee528661fc None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:56.072325 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f16a050-8aa1-4b92-964d-2645f87d688c None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:56.104928 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331fb254-db8c-4ce6-ae9f-9520d8d4b206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:56.105867 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331fb254-db8c-4ce6-ae9f-9520d8d4b206 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:56.107072 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331fb254-db8c-4ce6-ae9f-9520d8d4b206 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:56.107183 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331fb254-db8c-4ce6-ae9f-9520d8d4b206 None admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:56.108250 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331fb254-db8c-4ce6-ae9f-9520d8d4b206 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:56.108566 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331fb254-db8c-4ce6-ae9f-9520d8d4b206 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:56.110027 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331fb254-db8c-4ce6-ae9f-9520d8d4b206 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:56.112970 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f56930-ae8b-4614-8307-7cabc6671e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:56.113774 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f56930-ae8b-4614-8307-7cabc6671e65 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:56.114082 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f56930-ae8b-4614-8307-7cabc6671e65 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:56.114359 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f56930-ae8b-4614-8307-7cabc6671e65 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:56.122283 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 283/590] 10.222.0.118 () {56 vars in 1153 bytes} [Thu Jul 14 15:23:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:56.123460 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331fb254-db8c-4ce6-ae9f-9520d8d4b206 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:56.128022 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f56930-ae8b-4614-8307-7cabc6671e65 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:56.129738 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f56930-ae8b-4614-8307-7cabc6671e65 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:56.146311 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-a2f56930-ae8b-4614-8307-7cabc6671e65 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 14 15:23:56.146311 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:56.146311 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:56.146311 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:56.146311 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:56.146311 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:56.146311 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:56.146311 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:56.146311 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:56.146311 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:56.146311 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:56.146311 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:56.146311 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 15:23:56.146311 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 15:23:56.146311 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 15:23:56.146311 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 15:23:56.147248 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:56.147248 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:56.147248 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 15:23:56.147248 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:23:56.147248 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 15:23:56.147248 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:23:56.147248 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:56.147248 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:56.147248 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:56.147248 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:56.147248 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:56.147248 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:56.147248 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:56.147248 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:56.147248 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:56.147248 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:56.147248 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:56.147248 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:56.148161 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:56.148161 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:56.148161 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 15:23:56.148161 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 15:23:56.148161 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 15:23:56.148161 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 15:23:56.148161 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 15:23:56.148161 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 15:23:56.148161 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 14 15:23:56.148161 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:23:56.148161 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 308/591] 10.222.0.118 () {56 vars in 1107 bytes} [Thu Jul 14 15:23:55 2022] GET /identity/v3/users/neutron => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:56.148732 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f56930-ae8b-4614-8307-7cabc6671e65 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:56.191191 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:56.236380 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331fb254-db8c-4ce6-ae9f-9520d8d4b206 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:56.254162 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:56.257236 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f56930-ae8b-4614-8307-7cabc6671e65 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:56.275620 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53397af-2f62-4e69-a70d-c2fdc4b05dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:56.276410 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53397af-2f62-4e69-a70d-c2fdc4b05dd3 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:56.276692 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53397af-2f62-4e69-a70d-c2fdc4b05dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:56.276965 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53397af-2f62-4e69-a70d-c2fdc4b05dd3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:56.284386 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53397af-2f62-4e69-a70d-c2fdc4b05dd3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:56.285852 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53397af-2f62-4e69-a70d-c2fdc4b05dd3 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:56.293032 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb458c8-2d3b-4d43-8daa-b9e41fbb5c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:56.293702 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb458c8-2d3b-4d43-8daa-b9e41fbb5c91 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:56.294002 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb458c8-2d3b-4d43-8daa-b9e41fbb5c91 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:56.294287 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb458c8-2d3b-4d43-8daa-b9e41fbb5c91 None admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:56.295121 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb458c8-2d3b-4d43-8daa-b9e41fbb5c91 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:56.295428 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb458c8-2d3b-4d43-8daa-b9e41fbb5c91 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:56.296823 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb458c8-2d3b-4d43-8daa-b9e41fbb5c91 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:56.300319 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-a53397af-2f62-4e69-a70d-c2fdc4b05dd3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:23:56.300319 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:56.300319 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:56.300319 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:56.300319 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:56.300319 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:56.300319 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:56.300319 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:56.300319 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:56.300319 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:56.300319 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:56.300319 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:56.300319 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 15:23:56.300319 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 15:23:56.300319 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 15:23:56.301179 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 15:23:56.301179 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:56.301179 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:56.301179 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:56.301179 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:56.301179 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:56.301179 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:56.301179 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:56.301179 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:56.301179 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:56.301179 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:56.301179 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:56.301179 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:56.301179 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:56.301179 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:56.301179 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:56.301179 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:56.302080 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 15:23:56.302080 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 15:23:56.302080 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:23:56.302080 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:23:56.302080 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:23:56.302080 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:23:56.302080 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:23:56.302080 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:23:56.306270 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 284/592] 10.222.0.118 () {56 vars in 1116 bytes} [Thu Jul 14 15:23:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:56.307082 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53397af-2f62-4e69-a70d-c2fdc4b05dd3 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:56.319987 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 309/593] 10.222.0.118 () {56 vars in 1142 bytes} [Thu Jul 14 15:23:56 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 374 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:56.321112 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb458c8-2d3b-4d43-8daa-b9e41fbb5c91 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:56.417052 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53397af-2f62-4e69-a70d-c2fdc4b05dd3 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:56.427146 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb458c8-2d3b-4d43-8daa-b9e41fbb5c91 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:56.442511 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:56.456448 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225724d1-ae07-4d99-a200-1efa6e444459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:56.457481 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225724d1-ae07-4d99-a200-1efa6e444459 None admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:56.457762 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225724d1-ae07-4d99-a200-1efa6e444459 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:56.458136 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225724d1-ae07-4d99-a200-1efa6e444459 None admin] PATH_INFO: `/v3/projects/939bf9541f4a4afe86550f749d337680/users/f0177fc696ea40069902803da09f437c/roles/3185f450429e4bb3b5f289b615f3269b` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:56.464118 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0171808-e340-40d0-89c8-980b7ec91ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:56.464787 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0171808-e340-40d0-89c8-980b7ec91ac0 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:56.465073 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0171808-e340-40d0-89c8-980b7ec91ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:56.465345 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0171808-e340-40d0-89c8-980b7ec91ac0 None admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:56.466204 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0171808-e340-40d0-89c8-980b7ec91ac0 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:56.466513 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0171808-e340-40d0-89c8-980b7ec91ac0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:56.467932 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0171808-e340-40d0-89c8-980b7ec91ac0 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:56.474809 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225724d1-ae07-4d99-a200-1efa6e444459 None admin] RBAC: Authorizing `identity:create_grant(project_id=939bf9541f4a4afe86550f749d337680, user_id=f0177fc696ea40069902803da09f437c, role_id=3185f450429e4bb3b5f289b615f3269b)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:56.476342 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225724d1-ae07-4d99-a200-1efa6e444459 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:56.485553 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 310/594] 10.222.0.118 () {56 vars in 1144 bytes} [Thu Jul 14 15:23:56 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 376 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:56.485553 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0171808-e340-40d0-89c8-980b7ec91ac0 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:56.494813 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 285/595] 10.222.0.118 () {58 vars in 1444 bytes} [Thu Jul 14 15:23:56 2022] PUT /identity/v3/projects/939bf9541f4a4afe86550f749d337680/users/f0177fc696ea40069902803da09f437c/roles/3185f450429e4bb3b5f289b615f3269b => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:23:56.495902 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225724d1-ae07-4d99-a200-1efa6e444459 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:56.515712 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:56.620628 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0171808-e340-40d0-89c8-980b7ec91ac0 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:56.637202 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225724d1-ae07-4d99-a200-1efa6e444459 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:56.676011 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32cc372-c612-4f19-bdbe-d99c1bebd0b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:56.676949 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32cc372-c612-4f19-bdbe-d99c1bebd0b8 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:56.677237 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32cc372-c612-4f19-bdbe-d99c1bebd0b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:56.677638 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32cc372-c612-4f19-bdbe-d99c1bebd0b8 None admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:56.679585 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32cc372-c612-4f19-bdbe-d99c1bebd0b8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:56.679585 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32cc372-c612-4f19-bdbe-d99c1bebd0b8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:56.680337 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32cc372-c612-4f19-bdbe-d99c1bebd0b8 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:56.684162 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e1686c-5939-41d4-90a3-b8a47ded8b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:56.685176 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e1686c-5939-41d4-90a3-b8a47ded8b6d None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:56.685640 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e1686c-5939-41d4-90a3-b8a47ded8b6d None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:56.686152 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e1686c-5939-41d4-90a3-b8a47ded8b6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:56.697133 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 311/596] 10.222.0.118 () {56 vars in 1153 bytes} [Thu Jul 14 15:23:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:56.702020 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32cc372-c612-4f19-bdbe-d99c1bebd0b8 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:56.708090 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e1686c-5939-41d4-90a3-b8a47ded8b6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:56.709835 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e1686c-5939-41d4-90a3-b8a47ded8b6d None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:56.733565 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-39e1686c-5939-41d4-90a3-b8a47ded8b6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:23:56.733565 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:56.733565 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:56.733565 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:56.733565 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:56.733565 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:56.733565 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:56.733565 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:56.733565 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:56.733565 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:56.733565 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:56.733565 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:56.733565 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:23:56.733565 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:23:56.733565 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:23:56.734495 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:23:56.734495 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:56.734495 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:56.734495 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:56.734495 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:56.734495 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:56.734495 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:56.734495 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:56.734495 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:56.734495 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:56.734495 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:56.734495 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:56.734495 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:56.734495 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:56.734495 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:56.734495 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:56.734495 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:56.735364 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:23:56.735364 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:23:56.735364 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:23:56.735364 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:23:56.738287 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 286/597] 10.222.0.118 () {56 vars in 1113 bytes} [Thu Jul 14 15:23:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:56.739371 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e1686c-5939-41d4-90a3-b8a47ded8b6d None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:56.767165 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:56.801700 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:56.834886 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32cc372-c612-4f19-bdbe-d99c1bebd0b8 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:56.850101 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e1686c-5939-41d4-90a3-b8a47ded8b6d None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:56.878347 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af759ba4-39ef-4168-b242-412e4e23147f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:56.879142 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af759ba4-39ef-4168-b242-412e4e23147f None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:56.879480 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af759ba4-39ef-4168-b242-412e4e23147f None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:56.879680 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af759ba4-39ef-4168-b242-412e4e23147f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:56.889084 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f289ed4-7e13-400a-95d5-2cb2f1d16584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:56.890330 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f289ed4-7e13-400a-95d5-2cb2f1d16584 None admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:56.890841 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f289ed4-7e13-400a-95d5-2cb2f1d16584 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:56.891319 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f289ed4-7e13-400a-95d5-2cb2f1d16584 None admin] PATH_INFO: `/v3/projects/939bf9541f4a4afe86550f749d337680/users/b4336c3d678a4d33b00885def42dfb1f/roles/3185f450429e4bb3b5f289b615f3269b` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:56.891425 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af759ba4-39ef-4168-b242-412e4e23147f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:56.892878 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af759ba4-39ef-4168-b242-412e4e23147f None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:56.907785 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f289ed4-7e13-400a-95d5-2cb2f1d16584 None admin] RBAC: Authorizing `identity:create_grant(project_id=939bf9541f4a4afe86550f749d337680, user_id=b4336c3d678a4d33b00885def42dfb1f, role_id=3185f450429e4bb3b5f289b615f3269b)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:56.909706 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f289ed4-7e13-400a-95d5-2cb2f1d16584 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:56.911338 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-af759ba4-39ef-4168-b242-412e4e23147f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:23:56.911338 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:56.911338 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:56.911338 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:56.911338 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:56.911338 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:56.911338 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:56.911338 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:56.911338 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:56.911338 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:56.911338 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:56.911338 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:56.911338 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:23:56.911338 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:23:56.911338 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:23:56.912204 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:23:56.912204 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:56.912204 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:56.912204 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:56.912204 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:56.912204 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:56.912204 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:56.912204 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:56.912204 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:56.912204 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:56.912204 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:56.912204 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:56.912204 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:56.912204 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:56.912204 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:56.912204 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:56.912204 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:56.913104 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:23:56.913104 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:23:56.913104 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:23:56.913104 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:23:56.913104 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 312/598] 10.222.0.118 () {56 vars in 1113 bytes} [Thu Jul 14 15:23:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:56.917721 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af759ba4-39ef-4168-b242-412e4e23147f None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:56.933406 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 287/599] 10.222.0.118 () {58 vars in 1444 bytes} [Thu Jul 14 15:23:56 2022] PUT /identity/v3/projects/939bf9541f4a4afe86550f749d337680/users/b4336c3d678a4d33b00885def42dfb1f/roles/3185f450429e4bb3b5f289b615f3269b => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:23:56.934729 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f289ed4-7e13-400a-95d5-2cb2f1d16584 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:57.029789 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:57.032497 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af759ba4-39ef-4168-b242-412e4e23147f None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:57.067172 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:57.070878 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f289ed4-7e13-400a-95d5-2cb2f1d16584 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:57.077416 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c23ff9-55f6-435b-82a7-2d91dc9cebe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:57.078182 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c23ff9-55f6-435b-82a7-2d91dc9cebe8 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:57.078459 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c23ff9-55f6-435b-82a7-2d91dc9cebe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:57.078727 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c23ff9-55f6-435b-82a7-2d91dc9cebe8 None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:57.079542 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c23ff9-55f6-435b-82a7-2d91dc9cebe8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:57.079850 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c23ff9-55f6-435b-82a7-2d91dc9cebe8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:57.081380 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c23ff9-55f6-435b-82a7-2d91dc9cebe8 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:57.095964 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 313/600] 10.222.0.118 () {56 vars in 1114 bytes} [Thu Jul 14 15:23:56 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:57.098157 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4656a8-ebeb-4495-b540-2c90b3f408bf None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:57.098440 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4656a8-ebeb-4495-b540-2c90b3f408bf None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:57.098710 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4656a8-ebeb-4495-b540-2c90b3f408bf None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:57.100061 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 314/601] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:23:57 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:23:57.105532 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4656a8-ebeb-4495-b540-2c90b3f408bf None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:57.120555 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f63501e-23d0-4980-8db4-74094e8697ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:57.121246 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f63501e-23d0-4980-8db4-74094e8697ae None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:57.121692 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f63501e-23d0-4980-8db4-74094e8697ae None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:57.122010 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f63501e-23d0-4980-8db4-74094e8697ae None admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:57.122763 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f63501e-23d0-4980-8db4-74094e8697ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:57.123076 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f63501e-23d0-4980-8db4-74094e8697ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:57.124458 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f63501e-23d0-4980-8db4-74094e8697ae None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:57.141588 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 288/602] 10.222.0.118 () {56 vars in 1114 bytes} [Thu Jul 14 15:23:56 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:57.143884 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cee9e1-d58e-4929-b7df-738c510968c0 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:57.144374 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cee9e1-d58e-4929-b7df-738c510968c0 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:57.144789 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cee9e1-d58e-4929-b7df-738c510968c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:57.164491 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-54cee9e1-d58e-4929-b7df-738c510968c0 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:57.166420 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-54cee9e1-d58e-4929-b7df-738c510968c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:57.258066 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 289/603] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:23:57 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:23:57.258066 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cee9e1-d58e-4929-b7df-738c510968c0 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:57.260933 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4656a8-ebeb-4495-b540-2c90b3f408bf None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:57.313115 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c70f758-e581-4273-9270-a2474047da89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:57.314242 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c70f758-e581-4273-9270-a2474047da89 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:57.314697 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c70f758-e581-4273-9270-a2474047da89 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:57.315661 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c70f758-e581-4273-9270-a2474047da89 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:57.322260 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:57.323463 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c70f758-e581-4273-9270-a2474047da89 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:57.325310 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c70f758-e581-4273-9270-a2474047da89 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:57.341365 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-5c70f758-e581-4273-9270-a2474047da89 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:23:57.341365 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:57.341365 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:57.341365 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:57.341365 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:57.341365 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:57.341365 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:57.341365 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:57.341365 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:57.341365 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:57.341365 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:57.341365 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:57.341365 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 15:23:57.341365 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 15:23:57.341365 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 15:23:57.342293 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 15:23:57.342293 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:57.342293 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:57.342293 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:57.342293 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:57.342293 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:57.342293 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:57.342293 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:57.342293 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:57.342293 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:57.342293 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:57.342293 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:57.342293 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:57.342293 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:57.342293 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:57.342293 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:57.342293 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:57.343171 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 15:23:57.343171 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 15:23:57.343171 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:23:57.343171 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:23:57.343171 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:23:57.343171 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:23:57.343171 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:23:57.343171 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:23:57.345712 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 315/604] 10.222.0.118 () {56 vars in 1116 bytes} [Thu Jul 14 15:23:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:23:57.347092 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c70f758-e581-4273-9270-a2474047da89 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:57.363341 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cee9e1-d58e-4929-b7df-738c510968c0 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:57.402927 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:57.404866 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbf378d-2cc6-4317-9de2-3dbca89a663d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:57.405836 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf378d-2cc6-4317-9de2-3dbca89a663d None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:57.406289 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf378d-2cc6-4317-9de2-3dbca89a663d None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:57.406709 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf378d-2cc6-4317-9de2-3dbca89a663d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:57.415439 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbf378d-2cc6-4317-9de2-3dbca89a663d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:57.417130 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbf378d-2cc6-4317-9de2-3dbca89a663d None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:57.431678 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-8fbf378d-2cc6-4317-9de2-3dbca89a663d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:23:57.431678 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:57.431678 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:57.431678 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:57.431678 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:57.431678 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:57.431678 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:57.431678 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:57.431678 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:57.431678 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:57.431678 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:57.431678 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:57.431678 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 15:23:57.431678 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 15:23:57.431678 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 15:23:57.432583 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 15:23:57.432583 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:57.432583 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:57.432583 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:57.432583 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:57.432583 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:57.432583 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:57.432583 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:57.432583 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:57.432583 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:57.432583 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:57.432583 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:57.432583 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:57.432583 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:57.432583 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:57.432583 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:57.432583 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:57.433456 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 15:23:57.433456 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 15:23:57.433456 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:23:57.433456 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:23:57.433456 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:23:57.433456 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:23:57.433456 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:23:57.433456 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:23:57.440932 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 290/605] 10.222.0.118 () {56 vars in 1116 bytes} [Thu Jul 14 15:23:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:57.442025 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbf378d-2cc6-4317-9de2-3dbca89a663d None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:57.458553 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c70f758-e581-4273-9270-a2474047da89 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:57.494782 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd1d98b-84b2-4a61-88b2-dbd933c282d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:57.495712 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd1d98b-84b2-4a61-88b2-dbd933c282d2 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:57.495935 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd1d98b-84b2-4a61-88b2-dbd933c282d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:57.496209 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd1d98b-84b2-4a61-88b2-dbd933c282d2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:57.507756 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd1d98b-84b2-4a61-88b2-dbd933c282d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:23:57.516128 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-3bd1d98b-84b2-4a61-88b2-dbd933c282d2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:23:57.516128 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:57.516128 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:57.516128 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:57.516128 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:57.516128 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:57.516128 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:57.516128 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:57.516128 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:57.516128 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:57.516128 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:57.516128 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:57.516128 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:23:57.516128 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:23:57.516128 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:23:57.516128 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:23:57.517047 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:23:57.517047 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:23:57.517047 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:23:57.517047 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:23:57.517047 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:57.517047 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:57.517047 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:57.517047 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:57.517047 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:57.517047 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:57.517047 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:57.517047 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:57.517047 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:57.517047 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:57.517047 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:57.517047 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:57.517870 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:57.517870 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:57.517870 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:57.517870 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:57.517870 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:23:57.517870 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:23:57.517870 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:23:57.517870 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:23:57.517870 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:23:57.517870 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:23:57.517870 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:23:57.517870 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:23:57.517870 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 316/606] 10.222.0.118 () {56 vars in 1107 bytes} [Thu Jul 14 15:23:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:57.518618 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd1d98b-84b2-4a61-88b2-dbd933c282d2 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:57.555727 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbf378d-2cc6-4317-9de2-3dbca89a663d None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:57.581602 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:57.593738 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef8eb0d-84e9-4ecb-9d15-014b678d94cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:57.594583 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef8eb0d-84e9-4ecb-9d15-014b678d94cd None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:57.594967 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef8eb0d-84e9-4ecb-9d15-014b678d94cd None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:57.595386 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef8eb0d-84e9-4ecb-9d15-014b678d94cd None admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:57.596370 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef8eb0d-84e9-4ecb-9d15-014b678d94cd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:57.597304 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef8eb0d-84e9-4ecb-9d15-014b678d94cd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:57.598416 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef8eb0d-84e9-4ecb-9d15-014b678d94cd None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:57.611717 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 291/607] 10.222.0.118 () {56 vars in 1153 bytes} [Thu Jul 14 15:23:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:57.613350 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef8eb0d-84e9-4ecb-9d15-014b678d94cd None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:57.631599 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd1d98b-84b2-4a61-88b2-dbd933c282d2 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:57.641501 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:57.667963 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9e2497-916b-4501-a9d9-a76cc8440938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:57.668669 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9e2497-916b-4501-a9d9-a76cc8440938 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:57.668893 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9e2497-916b-4501-a9d9-a76cc8440938 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:57.669167 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9e2497-916b-4501-a9d9-a76cc8440938 None admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:57.669974 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9e2497-916b-4501-a9d9-a76cc8440938 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:57.670305 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9e2497-916b-4501-a9d9-a76cc8440938 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:57.672088 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9e2497-916b-4501-a9d9-a76cc8440938 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:57.691447 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 317/608] 10.222.0.118 () {56 vars in 1153 bytes} [Thu Jul 14 15:23:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:57.691447 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9e2497-916b-4501-a9d9-a76cc8440938 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:57.740203 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef8eb0d-84e9-4ecb-9d15-014b678d94cd None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:57.778559 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7eeb6b-bb18-4f06-a9e6-c8e03529b201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:57.779658 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7eeb6b-bb18-4f06-a9e6-c8e03529b201 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:57.780193 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7eeb6b-bb18-4f06-a9e6-c8e03529b201 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:57.780674 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7eeb6b-bb18-4f06-a9e6-c8e03529b201 None admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:57.781684 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7eeb6b-bb18-4f06-a9e6-c8e03529b201 None admin] RBAC: Adding query filter params (name=service) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:57.782348 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7eeb6b-bb18-4f06-a9e6-c8e03529b201 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:57.784082 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7eeb6b-bb18-4f06-a9e6-c8e03529b201 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:57.793627 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 292/609] 10.222.0.118 () {56 vars in 1108 bytes} [Thu Jul 14 15:23:57 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:57.794810 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7eeb6b-bb18-4f06-a9e6-c8e03529b201 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:57.800132 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9e2497-916b-4501-a9d9-a76cc8440938 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:57.841316 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2de4e81-27ff-4dc7-8d70-318fe1d77c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:57.842953 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2de4e81-27ff-4dc7-8d70-318fe1d77c88 None admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:57.843718 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2de4e81-27ff-4dc7-8d70-318fe1d77c88 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:57.844200 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2de4e81-27ff-4dc7-8d70-318fe1d77c88 None admin] PATH_INFO: `/v3/projects/939bf9541f4a4afe86550f749d337680/users/ea647438ea1c438987f28cbe39c3ff2f/roles/3185f450429e4bb3b5f289b615f3269b` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:57.845916 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:57.864668 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2de4e81-27ff-4dc7-8d70-318fe1d77c88 None admin] RBAC: Authorizing `identity:create_grant(project_id=939bf9541f4a4afe86550f749d337680, user_id=ea647438ea1c438987f28cbe39c3ff2f, role_id=3185f450429e4bb3b5f289b615f3269b)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:57.866342 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2de4e81-27ff-4dc7-8d70-318fe1d77c88 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:57.882786 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 318/610] 10.222.0.118 () {58 vars in 1444 bytes} [Thu Jul 14 15:23:57 2022] PUT /identity/v3/projects/939bf9541f4a4afe86550f749d337680/users/ea647438ea1c438987f28cbe39c3ff2f/roles/3185f450429e4bb3b5f289b615f3269b => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:23:57.883892 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2de4e81-27ff-4dc7-8d70-318fe1d77c88 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:57.905747 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:57.922739 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7eeb6b-bb18-4f06-a9e6-c8e03529b201 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:57.960829 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d257b8-5552-4d5f-8c78-fee2e35f5811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:57.962235 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d257b8-5552-4d5f-8c78-fee2e35f5811 None admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:57.962744 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d257b8-5552-4d5f-8c78-fee2e35f5811 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:57.963305 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d257b8-5552-4d5f-8c78-fee2e35f5811 None admin] PATH_INFO: `/v3/projects/939bf9541f4a4afe86550f749d337680/users/b650be8114b64df0ac88441f1c50b2cd/roles/3185f450429e4bb3b5f289b615f3269b` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:57.981247 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d257b8-5552-4d5f-8c78-fee2e35f5811 None admin] RBAC: Authorizing `identity:create_grant(project_id=939bf9541f4a4afe86550f749d337680, user_id=b650be8114b64df0ac88441f1c50b2cd, role_id=3185f450429e4bb3b5f289b615f3269b)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:57.983412 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d257b8-5552-4d5f-8c78-fee2e35f5811 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:58.000582 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 293/611] 10.222.0.118 () {58 vars in 1444 bytes} [Thu Jul 14 15:23:57 2022] PUT /identity/v3/projects/939bf9541f4a4afe86550f749d337680/users/b650be8114b64df0ac88441f1c50b2cd/roles/3185f450429e4bb3b5f289b615f3269b => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:23:58.077928 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2de4e81-27ff-4dc7-8d70-318fe1d77c88 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:58.129235 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be65379-826d-4508-841b-42a75b0fb34f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:58.130691 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be65379-826d-4508-841b-42a75b0fb34f None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:58.131192 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be65379-826d-4508-841b-42a75b0fb34f None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:58.131683 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be65379-826d-4508-841b-42a75b0fb34f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:58.143548 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be65379-826d-4508-841b-42a75b0fb34f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:58.145370 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be65379-826d-4508-841b-42a75b0fb34f None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:58.166563 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-7be65379-826d-4508-841b-42a75b0fb34f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:23:58.166563 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:58.166563 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:58.166563 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:58.166563 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:58.166563 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:58.166563 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:58.166563 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:58.166563 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:58.166563 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:58.166563 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:58.166563 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:58.166563 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:23:58.166563 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:23:58.166563 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:23:58.167496 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:23:58.167496 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:58.167496 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:58.167496 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:58.167496 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:58.167496 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:58.167496 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:58.167496 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:58.167496 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:58.167496 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:58.167496 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:58.167496 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:58.167496 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:58.167496 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:58.167496 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:58.167496 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:58.167496 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:58.168371 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:23:58.168371 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:23:58.168371 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:23:58.168371 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:23:58.170827 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 319/612] 10.222.0.118 () {56 vars in 1113 bytes} [Thu Jul 14 15:23:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:58.177219 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d257b8-5552-4d5f-8c78-fee2e35f5811 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:58.293360 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:58.301073 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d257b8-5552-4d5f-8c78-fee2e35f5811 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:58.337720 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354a317b-1984-4867-a09c-f48e7854aa5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:58.338839 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a317b-1984-4867-a09c-f48e7854aa5d None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:58.339358 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a317b-1984-4867-a09c-f48e7854aa5d None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:58.339836 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a317b-1984-4867-a09c-f48e7854aa5d None admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:58.340799 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354a317b-1984-4867-a09c-f48e7854aa5d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:58.341309 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354a317b-1984-4867-a09c-f48e7854aa5d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:58.342918 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354a317b-1984-4867-a09c-f48e7854aa5d None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:58.356469 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 294/613] 10.222.0.118 () {56 vars in 1114 bytes} [Thu Jul 14 15:23:58 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:58.363335 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be65379-826d-4508-841b-42a75b0fb34f None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:58.458313 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:58.497134 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be65379-826d-4508-841b-42a75b0fb34f None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:58.537896 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c4c7ef-cfed-418a-8be8-0e8e235e3458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:58.538746 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c4c7ef-cfed-418a-8be8-0e8e235e3458 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:58.539015 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c4c7ef-cfed-418a-8be8-0e8e235e3458 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:58.539286 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c4c7ef-cfed-418a-8be8-0e8e235e3458 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:58.559090 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c4c7ef-cfed-418a-8be8-0e8e235e3458 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:58.560557 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c4c7ef-cfed-418a-8be8-0e8e235e3458 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:58.579110 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-48c4c7ef-cfed-418a-8be8-0e8e235e3458 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 14 15:23:58.579110 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:58.579110 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:58.579110 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:58.579110 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:58.579110 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:58.579110 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:58.579110 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:58.579110 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:58.579110 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:58.579110 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:58.579110 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:58.579110 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 15:23:58.579110 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 15:23:58.579110 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 15:23:58.579110 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 15:23:58.580043 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:58.580043 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:58.580043 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 15:23:58.580043 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:23:58.580043 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 15:23:58.580043 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:23:58.580043 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:58.580043 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:58.580043 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:58.580043 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:58.580043 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:58.580043 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:58.580043 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:58.580043 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:58.580043 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:58.580043 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:58.580043 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:58.580043 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:58.582191 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:58.582191 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:58.582191 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 15:23:58.582191 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 15:23:58.582191 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 15:23:58.582191 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 15:23:58.582191 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 15:23:58.582191 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 15:23:58.582191 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 14 15:23:58.582191 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:23:58.582191 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 320/614] 10.222.0.118 () {56 vars in 1101 bytes} [Thu Jul 14 15:23:58 2022] GET /identity/v3/users/swift => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:58.586492 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354a317b-1984-4867-a09c-f48e7854aa5d None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:58.702228 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd65a3c-de56-44da-82c3-cffb86f8eef5 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:58.702579 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd65a3c-de56-44da-82c3-cffb86f8eef5 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:58.702890 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd65a3c-de56-44da-82c3-cffb86f8eef5 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:58.704524 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 321/615] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:23:58 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:23:58.712797 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd98414-9c60-4e41-b526-6a3affd12e09 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:58.713081 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd98414-9c60-4e41-b526-6a3affd12e09 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:58.713357 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd98414-9c60-4e41-b526-6a3affd12e09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:58.745325 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-ebd98414-9c60-4e41-b526-6a3affd12e09 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:58.746533 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-ebd98414-9c60-4e41-b526-6a3affd12e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:58.765540 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354a317b-1984-4867-a09c-f48e7854aa5d None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:58.824599 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 322/616] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:23:58 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 14 15:23:58.850266 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd98414-9c60-4e41-b526-6a3affd12e09 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:58.858658 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964c99eb-61c1-4137-8cb8-6c6967ad792b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:58.859333 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c99eb-61c1-4137-8cb8-6c6967ad792b None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:58.859605 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c99eb-61c1-4137-8cb8-6c6967ad792b None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:58.859869 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c99eb-61c1-4137-8cb8-6c6967ad792b None admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:58.860717 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964c99eb-61c1-4137-8cb8-6c6967ad792b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:58.861024 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964c99eb-61c1-4137-8cb8-6c6967ad792b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:58.863979 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964c99eb-61c1-4137-8cb8-6c6967ad792b None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:58.892138 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 295/617] 10.222.0.118 () {56 vars in 1140 bytes} [Thu Jul 14 15:23:58 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 372 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:58.894236 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964c99eb-61c1-4137-8cb8-6c6967ad792b None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:58.910968 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:58.934661 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:59.004228 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd98414-9c60-4e41-b526-6a3affd12e09 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:59.012509 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964c99eb-61c1-4137-8cb8-6c6967ad792b None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:59.047246 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cff1418-4b8a-4269-b0be-d458c2a65099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:59.049209 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff1418-4b8a-4269-b0be-d458c2a65099 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:59.050671 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff1418-4b8a-4269-b0be-d458c2a65099 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:59.051496 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff1418-4b8a-4269-b0be-d458c2a65099 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:59.053659 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7472be65-1f7a-4e25-93fa-8f4d07b57df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:59.055708 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7472be65-1f7a-4e25-93fa-8f4d07b57df6 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:59.056389 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7472be65-1f7a-4e25-93fa-8f4d07b57df6 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:59.057497 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7472be65-1f7a-4e25-93fa-8f4d07b57df6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:59.076768 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cff1418-4b8a-4269-b0be-d458c2a65099 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:23:59.081875 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7472be65-1f7a-4e25-93fa-8f4d07b57df6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:59.088032 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7472be65-1f7a-4e25-93fa-8f4d07b57df6 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:59.090009 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-8cff1418-4b8a-4269-b0be-d458c2a65099 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:23:59.090009 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:59.090009 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:59.090009 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:59.090009 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:59.090009 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:59.090009 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:59.090009 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:59.090009 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:59.090009 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:59.090009 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:59.090009 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:59.090009 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:23:59.090009 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:23:59.090009 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:23:59.090009 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:23:59.091436 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:23:59.091436 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:23:59.091436 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:23:59.091436 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:23:59.091436 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:59.091436 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:59.091436 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:59.091436 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:59.091436 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:59.091436 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:59.091436 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:59.091436 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:59.091436 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:59.091436 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:59.091436 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:59.091436 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:59.092343 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:59.092343 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:59.092343 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:59.092343 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:59.092343 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:23:59.092343 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:23:59.092343 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:23:59.092343 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:23:59.092343 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:23:59.092343 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:23:59.092343 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:23:59.092343 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:23:59.101303 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 323/618] 10.222.0.118 () {56 vars in 1107 bytes} [Thu Jul 14 15:23:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:59.112267 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cff1418-4b8a-4269-b0be-d458c2a65099 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:59.128138 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-7472be65-1f7a-4e25-93fa-8f4d07b57df6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:23:59.128138 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:59.128138 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:59.128138 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:59.128138 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:59.128138 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:59.128138 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:59.128138 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:59.128138 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:59.128138 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:59.128138 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:59.128138 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:59.128138 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:23:59.128138 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:23:59.128138 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:23:59.129197 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:23:59.129197 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:59.129197 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:59.129197 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:59.129197 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:59.129197 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:59.129197 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:59.129197 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:59.129197 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:59.129197 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:59.129197 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:59.129197 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:59.129197 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:59.129197 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:59.129197 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:59.129197 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:59.129197 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:59.130690 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:23:59.130690 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:23:59.130690 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:23:59.130690 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:23:59.132712 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 296/619] 10.222.0.118 () {56 vars in 1113 bytes} [Thu Jul 14 15:23:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:59.138355 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7472be65-1f7a-4e25-93fa-8f4d07b57df6 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:59.209648 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:59.249269 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7472be65-1f7a-4e25-93fa-8f4d07b57df6 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:59.292994 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595c9e38-a2b4-4a83-aa16-5e0c3b6bc1a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:59.293909 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595c9e38-a2b4-4a83-aa16-5e0c3b6bc1a7 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:59.294349 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595c9e38-a2b4-4a83-aa16-5e0c3b6bc1a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:59.294763 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595c9e38-a2b4-4a83-aa16-5e0c3b6bc1a7 None admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:59.295627 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595c9e38-a2b4-4a83-aa16-5e0c3b6bc1a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:59.296098 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595c9e38-a2b4-4a83-aa16-5e0c3b6bc1a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:59.297644 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595c9e38-a2b4-4a83-aa16-5e0c3b6bc1a7 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:59.311097 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 297/620] 10.222.0.118 () {56 vars in 1114 bytes} [Thu Jul 14 15:23:59 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:59.318794 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595c9e38-a2b4-4a83-aa16-5e0c3b6bc1a7 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:59.334708 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cff1418-4b8a-4269-b0be-d458c2a65099 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:59.374489 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:59.401540 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e283ca77-da93-4d98-9805-22d13ab89bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:59.402256 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e283ca77-da93-4d98-9805-22d13ab89bea None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:59.402548 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e283ca77-da93-4d98-9805-22d13ab89bea None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:59.402814 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e283ca77-da93-4d98-9805-22d13ab89bea None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:59.403577 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e283ca77-da93-4d98-9805-22d13ab89bea None admin] RBAC: Adding query filter params (name=service) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:59.403887 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e283ca77-da93-4d98-9805-22d13ab89bea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:59.405438 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e283ca77-da93-4d98-9805-22d13ab89bea None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:59.416179 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 324/621] 10.222.0.118 () {56 vars in 1108 bytes} [Thu Jul 14 15:23:59 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:23:59.421547 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6eefba-85f7-4156-9cac-0cd084668588 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:59.421547 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6eefba-85f7-4156-9cac-0cd084668588 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:59.421547 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6eefba-85f7-4156-9cac-0cd084668588 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:59.424277 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 325/622] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:23:59 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:23:59.425666 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6eefba-85f7-4156-9cac-0cd084668588 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:59.469781 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595c9e38-a2b4-4a83-aa16-5e0c3b6bc1a7 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:59.498335 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:59.508913 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75450c7-df2e-4e07-8444-0100ac532a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:59.509948 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75450c7-df2e-4e07-8444-0100ac532a00 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:59.510413 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75450c7-df2e-4e07-8444-0100ac532a00 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:59.510877 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75450c7-df2e-4e07-8444-0100ac532a00 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:59.518350 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75450c7-df2e-4e07-8444-0100ac532a00 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:59.520089 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75450c7-df2e-4e07-8444-0100ac532a00 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:59.536091 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-b75450c7-df2e-4e07-8444-0100ac532a00 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:23:59.536091 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:59.536091 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:59.536091 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:59.536091 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:59.536091 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:59.536091 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:59.536091 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:59.536091 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:59.536091 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:59.536091 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:59.536091 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:59.536091 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 15:23:59.536091 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 15:23:59.536091 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 15:23:59.537104 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 15:23:59.537104 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:59.537104 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:59.537104 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:59.537104 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:59.537104 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:59.537104 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:59.537104 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:59.537104 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:59.537104 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:59.537104 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:59.537104 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:59.537104 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:59.537104 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:59.537104 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:59.537104 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:59.537104 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:59.538088 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 15:23:59.538088 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 15:23:59.538088 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:23:59.538088 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:23:59.538088 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:23:59.538088 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:23:59.538088 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:23:59.538088 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:23:59.544595 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6eefba-85f7-4156-9cac-0cd084668588 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:59.545051 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 298/623] 10.222.0.118 () {56 vars in 1116 bytes} [Thu Jul 14 15:23:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:59.546526 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416e8f0d-1c25-40aa-953a-320d3ad10a77 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:59.546952 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416e8f0d-1c25-40aa-953a-320d3ad10a77 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:59.547455 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416e8f0d-1c25-40aa-953a-320d3ad10a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:59.566095 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-416e8f0d-1c25-40aa-953a-320d3ad10a77 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:59.567521 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-416e8f0d-1c25-40aa-953a-320d3ad10a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:59.576708 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a673f80e-337e-432a-90ac-688110e16ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:59.577509 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a673f80e-337e-432a-90ac-688110e16ef5 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:59.578129 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a673f80e-337e-432a-90ac-688110e16ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:59.578248 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a673f80e-337e-432a-90ac-688110e16ef5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:59.589894 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a673f80e-337e-432a-90ac-688110e16ef5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:59.591459 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a673f80e-337e-432a-90ac-688110e16ef5 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:59.610725 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-a673f80e-337e-432a-90ac-688110e16ef5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:23:59.610725 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:59.610725 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:59.610725 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:59.610725 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:59.610725 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:59.610725 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:59.610725 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:59.610725 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:59.610725 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:59.610725 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:59.610725 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:59.610725 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:23:59.610725 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:23:59.610725 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:23:59.611831 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:23:59.611831 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:59.611831 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:59.611831 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:59.611831 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:59.611831 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:59.611831 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:59.611831 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:59.611831 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:59.611831 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:59.611831 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:59.611831 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:59.611831 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:59.611831 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:59.611831 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:59.611831 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:59.611831 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:59.613365 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:23:59.613365 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:23:59.613365 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:23:59.613365 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:23:59.613365 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 326/624] 10.222.0.118 () {56 vars in 1113 bytes} [Thu Jul 14 15:23:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:59.613698 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a673f80e-337e-432a-90ac-688110e16ef5 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:59.642841 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 299/625] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:23:59 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:23:59.643959 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416e8f0d-1c25-40aa-953a-320d3ad10a77 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:59.652157 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:59.733422 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a673f80e-337e-432a-90ac-688110e16ef5 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:59.753626 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416e8f0d-1c25-40aa-953a-320d3ad10a77 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:59.771420 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:59.771588 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bb57ac-f6c1-46ab-9122-6935aba78189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:59.773234 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bb57ac-f6c1-46ab-9122-6935aba78189 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:59.773514 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bb57ac-f6c1-46ab-9122-6935aba78189 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:59.773784 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bb57ac-f6c1-46ab-9122-6935aba78189 None admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:59.774836 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bb57ac-f6c1-46ab-9122-6935aba78189 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:59.775149 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bb57ac-f6c1-46ab-9122-6935aba78189 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:59.777465 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bb57ac-f6c1-46ab-9122-6935aba78189 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:59.792139 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38fd5b5-a64d-416b-80c3-2eea46137f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:59.793005 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38fd5b5-a64d-416b-80c3-2eea46137f28 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:59.793425 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38fd5b5-a64d-416b-80c3-2eea46137f28 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:59.793859 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38fd5b5-a64d-416b-80c3-2eea46137f28 None admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:59.798070 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 327/626] 10.222.0.118 () {56 vars in 1153 bytes} [Thu Jul 14 15:23:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:59.798070 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bb57ac-f6c1-46ab-9122-6935aba78189 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:59.799627 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38fd5b5-a64d-416b-80c3-2eea46137f28 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:59.799885 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38fd5b5-a64d-416b-80c3-2eea46137f28 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:59.801303 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38fd5b5-a64d-416b-80c3-2eea46137f28 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:59.813554 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 300/627] 10.222.0.118 () {56 vars in 1114 bytes} [Thu Jul 14 15:23:59 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:59.814395 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38fd5b5-a64d-416b-80c3-2eea46137f28 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:59.908310 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:59.917440 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bb57ac-f6c1-46ab-9122-6935aba78189 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:59.924071 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38fd5b5-a64d-416b-80c3-2eea46137f28 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:59.954516 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd97895-c4b8-40e5-bfd2-942c9f40894d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:59.956355 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd97895-c4b8-40e5-bfd2-942c9f40894d None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:59.956787 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd97895-c4b8-40e5-bfd2-942c9f40894d None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:59.957205 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd97895-c4b8-40e5-bfd2-942c9f40894d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:59.959908 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e295d36-e642-4de9-99fb-50fa886df51b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:59.960870 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e295d36-e642-4de9-99fb-50fa886df51b None admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:59.961216 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e295d36-e642-4de9-99fb-50fa886df51b None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:59.961555 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e295d36-e642-4de9-99fb-50fa886df51b None admin] PATH_INFO: `/v3/projects/939bf9541f4a4afe86550f749d337680/users/b672a6a601584d2d826147069e90a10f/roles/3185f450429e4bb3b5f289b615f3269b` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:59.970156 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd97895-c4b8-40e5-bfd2-942c9f40894d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:23:59.980439 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-4fd97895-c4b8-40e5-bfd2-942c9f40894d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:23:59.980439 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:59.980439 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:59.980439 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:59.980439 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:59.980439 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:59.980439 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:59.980439 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:59.980439 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:59.980439 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:59.980439 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:59.980439 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:59.980439 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:23:59.980439 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:23:59.980439 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:23:59.980439 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:23:59.981571 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:23:59.981571 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:23:59.981571 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:23:59.981571 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:23:59.981571 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:59.981571 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:59.981571 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:59.981571 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:59.981571 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:59.981571 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:59.981571 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:59.981571 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:59.981571 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:59.981571 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:59.981571 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:59.981571 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:59.982728 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:59.982728 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:59.982728 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:59.982728 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:59.982728 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:23:59.982728 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:23:59.982728 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:23:59.982728 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:23:59.982728 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:23:59.982728 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:23:59.982728 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:23:59.982728 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:23:59.983928 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 328/628] 10.222.0.118 () {56 vars in 1107 bytes} [Thu Jul 14 15:23:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:59.984218 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e295d36-e642-4de9-99fb-50fa886df51b None admin] RBAC: Authorizing `identity:create_grant(project_id=939bf9541f4a4afe86550f749d337680, user_id=b672a6a601584d2d826147069e90a10f, role_id=3185f450429e4bb3b5f289b615f3269b)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:59.984941 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd97895-c4b8-40e5-bfd2-942c9f40894d None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:59.986007 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e295d36-e642-4de9-99fb-50fa886df51b None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:00.003443 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 301/629] 10.222.0.118 () {58 vars in 1444 bytes} [Thu Jul 14 15:23:59 2022] PUT /identity/v3/projects/939bf9541f4a4afe86550f749d337680/users/b672a6a601584d2d826147069e90a10f/roles/3185f450429e4bb3b5f289b615f3269b => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:24:00.004510 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e295d36-e642-4de9-99fb-50fa886df51b None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:00.037999 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:00.121607 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e295d36-e642-4de9-99fb-50fa886df51b None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:00.162046 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c53f6d-4dce-42e2-84f9-45a86f1bed5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:00.164476 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c53f6d-4dce-42e2-84f9-45a86f1bed5d None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:00.164950 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c53f6d-4dce-42e2-84f9-45a86f1bed5d None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:00.165408 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c53f6d-4dce-42e2-84f9-45a86f1bed5d None admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:00.166386 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c53f6d-4dce-42e2-84f9-45a86f1bed5d None admin] RBAC: Adding query filter params (name=service) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:00.167678 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c53f6d-4dce-42e2-84f9-45a86f1bed5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:00.169306 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c53f6d-4dce-42e2-84f9-45a86f1bed5d None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:00.192782 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 302/630] 10.222.0.118 () {56 vars in 1108 bytes} [Thu Jul 14 15:24:00 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:00.198412 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c53f6d-4dce-42e2-84f9-45a86f1bed5d None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:00.216938 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd97895-c4b8-40e5-bfd2-942c9f40894d None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:00.273097 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354a523c-dceb-471b-93ec-9381fb9b7a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:00.274237 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a523c-dceb-471b-93ec-9381fb9b7a1c None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:00.274512 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a523c-dceb-471b-93ec-9381fb9b7a1c None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:00.274783 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a523c-dceb-471b-93ec-9381fb9b7a1c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:00.287296 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354a523c-dceb-471b-93ec-9381fb9b7a1c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:00.289382 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354a523c-dceb-471b-93ec-9381fb9b7a1c None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:00.307304 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-354a523c-dceb-471b-93ec-9381fb9b7a1c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 15:24:00.307304 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:00.307304 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:00.307304 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:00.307304 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:00.307304 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:00.307304 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:00.307304 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:00.307304 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:00.307304 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:00.307304 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:00.307304 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:00.307304 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 15:24:00.307304 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 15:24:00.307304 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 15:24:00.307304 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 15:24:00.308298 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:00.308298 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:00.308298 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 15:24:00.308298 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:24:00.308298 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 15:24:00.308298 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:24:00.308298 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:00.308298 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:00.308298 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:00.308298 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:00.308298 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:00.308298 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:00.308298 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:00.308298 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:00.308298 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:00.308298 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:00.308298 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:00.308298 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:00.309226 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:00.309226 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:00.309226 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 15:24:00.309226 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 15:24:00.309226 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 15:24:00.309226 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 15:24:00.309226 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 15:24:00.309226 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 15:24:00.309226 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 15:24:00.309226 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:24:00.309760 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 329/631] 10.222.0.118 () {56 vars in 1098 bytes} [Thu Jul 14 15:23:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:00.314626 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354a523c-dceb-471b-93ec-9381fb9b7a1c None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:00.324163 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:00.341319 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c53f6d-4dce-42e2-84f9-45a86f1bed5d None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:00.342235 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:00.380149 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0008162c-073f-4a03-bd39-d76bb7122b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:00.381145 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0008162c-073f-4a03-bd39-d76bb7122b6a None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:00.381538 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0008162c-073f-4a03-bd39-d76bb7122b6a None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:00.381819 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0008162c-073f-4a03-bd39-d76bb7122b6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:00.396135 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0008162c-073f-4a03-bd39-d76bb7122b6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:00.397773 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0008162c-073f-4a03-bd39-d76bb7122b6a None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:00.416940 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-0008162c-073f-4a03-bd39-d76bb7122b6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:00.416940 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:00.416940 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:00.416940 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:00.416940 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:00.416940 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:00.416940 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:00.416940 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:00.416940 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:00.416940 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:00.416940 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:00.416940 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:00.416940 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:24:00.416940 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:24:00.416940 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:24:00.418088 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:24:00.418088 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:00.418088 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:00.418088 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:00.418088 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:00.418088 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:00.418088 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:00.418088 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:00.418088 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:00.418088 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:00.418088 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:00.418088 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:00.418088 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:00.418088 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:00.418088 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:00.418088 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:00.418088 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:00.419146 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:24:00.419146 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:24:00.419146 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:00.419146 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:24:00.419146 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 303/632] 10.222.0.118 () {56 vars in 1113 bytes} [Thu Jul 14 15:24:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:24:00.424429 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0008162c-073f-4a03-bd39-d76bb7122b6a None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:00.469118 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354a523c-dceb-471b-93ec-9381fb9b7a1c None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:00.509432 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a6dad2-39b4-4dc0-8186-222b229a2ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:00.510130 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a6dad2-39b4-4dc0-8186-222b229a2ff1 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:00.510406 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a6dad2-39b4-4dc0-8186-222b229a2ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:00.510677 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a6dad2-39b4-4dc0-8186-222b229a2ff1 None admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:00.511535 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a6dad2-39b4-4dc0-8186-222b229a2ff1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:00.511812 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a6dad2-39b4-4dc0-8186-222b229a2ff1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:00.513235 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a6dad2-39b4-4dc0-8186-222b229a2ff1 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:00.533178 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 330/633] 10.222.0.118 () {56 vars in 1138 bytes} [Thu Jul 14 15:24:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:24:00.534836 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db20fbd1-3812-4e75-abdc-604a50302e55 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:00.535125 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db20fbd1-3812-4e75-abdc-604a50302e55 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:00.535397 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db20fbd1-3812-4e75-abdc-604a50302e55 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:00.540428 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 331/634] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:24:00 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:24:00.540428 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff155f6-f45e-4570-9edc-c98d69c5fb7a None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:00.540428 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff155f6-f45e-4570-9edc-c98d69c5fb7a None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:00.540428 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff155f6-f45e-4570-9edc-c98d69c5fb7a None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:00.540428 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 332/635] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:24:00 2022] GET /identity => generated 271 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:24:00.540428 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff155f6-f45e-4570-9edc-c98d69c5fb7a None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:00.563746 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0008162c-073f-4a03-bd39-d76bb7122b6a None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:00.601377 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd3f6be-5b4e-49f8-9306-67a069c2a7c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:00.602318 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd3f6be-5b4e-49f8-9306-67a069c2a7c3 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:00.602757 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd3f6be-5b4e-49f8-9306-67a069c2a7c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:00.603036 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd3f6be-5b4e-49f8-9306-67a069c2a7c3 None admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:00.603837 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd3f6be-5b4e-49f8-9306-67a069c2a7c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:00.604148 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd3f6be-5b4e-49f8-9306-67a069c2a7c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:00.605567 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd3f6be-5b4e-49f8-9306-67a069c2a7c3 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:00.615774 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:00.617240 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:00.625520 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 304/636] 10.222.0.118 () {56 vars in 1114 bytes} [Thu Jul 14 15:24:00 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:00.626809 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad95d219-1659-4a39-becf-bb18ce9e5df4 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:00.627093 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad95d219-1659-4a39-becf-bb18ce9e5df4 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:00.627997 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad95d219-1659-4a39-becf-bb18ce9e5df4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:00.644917 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-ad95d219-1659-4a39-becf-bb18ce9e5df4 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:00.646114 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-ad95d219-1659-4a39-becf-bb18ce9e5df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:00.651534 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff155f6-f45e-4570-9edc-c98d69c5fb7a None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:00.695063 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce4472e-8d28-452e-8f15-ab9d48cd2eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:00.695715 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce4472e-8d28-452e-8f15-ab9d48cd2eb5 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:00.695986 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce4472e-8d28-452e-8f15-ab9d48cd2eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:00.696255 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce4472e-8d28-452e-8f15-ab9d48cd2eb5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:00.730052 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 305/637] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:24:00 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:24:00.730052 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d263d22-04b2-45fb-b0b3-57d9ee1216ec None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:00.730052 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d263d22-04b2-45fb-b0b3-57d9ee1216ec None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:00.730052 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d263d22-04b2-45fb-b0b3-57d9ee1216ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:00.745834 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-6d263d22-04b2-45fb-b0b3-57d9ee1216ec None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:00.747230 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-6d263d22-04b2-45fb-b0b3-57d9ee1216ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:00.784748 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce4472e-8d28-452e-8f15-ab9d48cd2eb5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:00.786260 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce4472e-8d28-452e-8f15-ab9d48cd2eb5 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:00.821506 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 306/638] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:24:00 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:24:00.822182 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d263d22-04b2-45fb-b0b3-57d9ee1216ec None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:00.868386 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:00.887491 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:00.907068 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 333/639] 10.222.0.118 () {58 vars in 1287 bytes} [Thu Jul 14 15:24:00 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 15:24:00.907068 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce4472e-8d28-452e-8f15-ab9d48cd2eb5 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:00.931856 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d263d22-04b2-45fb-b0b3-57d9ee1216ec None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:00.967795 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8f61db-92a2-4abc-883a-01d121526633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:00.968838 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8f61db-92a2-4abc-883a-01d121526633 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:00.969283 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8f61db-92a2-4abc-883a-01d121526633 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:00.969559 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8f61db-92a2-4abc-883a-01d121526633 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:00.977376 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8f61db-92a2-4abc-883a-01d121526633 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:00.978873 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8f61db-92a2-4abc-883a-01d121526633 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:00.998199 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-7b8f61db-92a2-4abc-883a-01d121526633 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 14 15:24:00.998199 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:00.998199 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:00.998199 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:00.998199 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:00.998199 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:00.998199 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:00.998199 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:00.998199 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:00.998199 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:00.998199 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:00.998199 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:00.998199 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 15:24:00.998199 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 15:24:00.998199 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 15:24:00.998199 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 15:24:00.999164 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:00.999164 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:00.999164 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 15:24:00.999164 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:24:00.999164 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 15:24:00.999164 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:24:00.999164 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:00.999164 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:00.999164 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:00.999164 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:00.999164 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:00.999164 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:00.999164 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:00.999164 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:00.999164 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:00.999164 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:00.999164 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:00.999164 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:01.000161 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:01.000161 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:01.000161 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 15:24:01.000161 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 15:24:01.000161 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 15:24:01.000161 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 15:24:01.000161 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 15:24:01.000161 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 15:24:01.000161 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 14 15:24:01.000161 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:24:01.004190 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 307/640] 10.222.0.118 () {56 vars in 1104 bytes} [Thu Jul 14 15:24:00 2022] GET /identity/v3/users/glance => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:01.005043 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8f61db-92a2-4abc-883a-01d121526633 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:01.013808 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce4472e-8d28-452e-8f15-ab9d48cd2eb5 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:01.047587 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60771bfb-f56f-4f6a-a444-26dd5ec121bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:01.048378 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60771bfb-f56f-4f6a-a444-26dd5ec121bb None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:01.048659 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60771bfb-f56f-4f6a-a444-26dd5ec121bb None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:01.048936 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60771bfb-f56f-4f6a-a444-26dd5ec121bb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:01.059703 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60771bfb-f56f-4f6a-a444-26dd5ec121bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:24:01.068073 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-60771bfb-f56f-4f6a-a444-26dd5ec121bb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:24:01.068073 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:01.068073 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:01.068073 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:01.068073 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:01.068073 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:01.068073 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:01.068073 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:01.068073 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:01.068073 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:01.068073 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:01.068073 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:01.068073 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:24:01.068073 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:24:01.068073 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:24:01.068073 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:24:01.068997 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:24:01.068997 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:24:01.068997 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:24:01.068997 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:24:01.068997 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:01.068997 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:01.068997 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:01.068997 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:01.068997 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:01.068997 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:01.068997 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:01.068997 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:01.068997 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:01.068997 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:01.068997 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:01.068997 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:01.069827 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:01.069827 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:01.069827 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:01.069827 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:01.069827 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:24:01.069827 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:24:01.069827 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:24:01.069827 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:24:01.069827 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:24:01.069827 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:24:01.069827 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:24:01.069827 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:24:01.071260 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 334/641] 10.222.0.118 () {56 vars in 1107 bytes} [Thu Jul 14 15:24:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:01.072039 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60771bfb-f56f-4f6a-a444-26dd5ec121bb None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:01.107804 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:01.117250 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8f61db-92a2-4abc-883a-01d121526633 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:01.139845 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:01.157544 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bb9c93-5752-41f6-a528-2796b5a94c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:01.159418 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bb9c93-5752-41f6-a528-2796b5a94c35 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:01.159851 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bb9c93-5752-41f6-a528-2796b5a94c35 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:01.160456 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bb9c93-5752-41f6-a528-2796b5a94c35 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:01.177031 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bb9c93-5752-41f6-a528-2796b5a94c35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:24:01.179499 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60771bfb-f56f-4f6a-a444-26dd5ec121bb None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:01.186864 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-c1bb9c93-5752-41f6-a528-2796b5a94c35 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:24:01.186864 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:01.186864 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:01.186864 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:01.186864 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:01.186864 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:01.186864 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:01.186864 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:01.186864 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:01.186864 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:01.186864 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:01.186864 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:01.186864 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:24:01.186864 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:24:01.186864 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:24:01.186864 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:24:01.188063 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:24:01.188063 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:24:01.188063 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:24:01.188063 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:24:01.188063 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:01.188063 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:01.188063 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:01.188063 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:01.188063 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:01.188063 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:01.188063 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:01.188063 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:01.188063 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:01.188063 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:01.188063 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:01.188063 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:01.189126 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:01.189126 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:01.189126 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:01.189126 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:01.189126 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:24:01.189126 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:24:01.189126 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:24:01.189126 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:24:01.189126 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:24:01.189126 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:24:01.189126 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:24:01.189126 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:24:01.196524 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 308/642] 10.222.0.118 () {56 vars in 1107 bytes} [Thu Jul 14 15:24:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:01.196524 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bb9c93-5752-41f6-a528-2796b5a94c35 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:01.238845 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04255c58-95f1-49df-b1ed-548fa26ed959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:01.239644 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04255c58-95f1-49df-b1ed-548fa26ed959 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:01.239933 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04255c58-95f1-49df-b1ed-548fa26ed959 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:01.240188 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04255c58-95f1-49df-b1ed-548fa26ed959 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:01.251948 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04255c58-95f1-49df-b1ed-548fa26ed959 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:01.253611 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04255c58-95f1-49df-b1ed-548fa26ed959 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:01.271506 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-04255c58-95f1-49df-b1ed-548fa26ed959 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:01.271506 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:01.271506 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:01.271506 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:01.271506 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:01.271506 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:01.271506 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:01.271506 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:01.271506 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:01.271506 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:01.271506 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:01.271506 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:01.271506 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:24:01.271506 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:24:01.271506 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:24:01.272459 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:24:01.272459 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:01.272459 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:01.272459 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:01.272459 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:01.272459 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:01.272459 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:01.272459 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:01.272459 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:01.272459 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:01.272459 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:01.272459 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:01.272459 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:01.272459 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:01.272459 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:01.272459 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:01.272459 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:01.273468 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:24:01.273468 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:24:01.273468 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:01.273468 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:24:01.273468 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 335/643] 10.222.0.118 () {56 vars in 1113 bytes} [Thu Jul 14 15:24:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:01.273468 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04255c58-95f1-49df-b1ed-548fa26ed959 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:01.333207 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bb9c93-5752-41f6-a528-2796b5a94c35 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:01.363804 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:01.373984 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b426de7-918e-43d3-88d7-c4bd13a1134c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:01.374659 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b426de7-918e-43d3-88d7-c4bd13a1134c None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:01.374937 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b426de7-918e-43d3-88d7-c4bd13a1134c None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:01.375207 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b426de7-918e-43d3-88d7-c4bd13a1134c None admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:01.376147 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b426de7-918e-43d3-88d7-c4bd13a1134c None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:01.376456 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b426de7-918e-43d3-88d7-c4bd13a1134c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:01.378053 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b426de7-918e-43d3-88d7-c4bd13a1134c None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:01.379478 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04255c58-95f1-49df-b1ed-548fa26ed959 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:01.397526 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 309/644] 10.222.0.118 () {56 vars in 1142 bytes} [Thu Jul 14 15:24:01 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 374 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:01.398406 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b426de7-918e-43d3-88d7-c4bd13a1134c None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:01.419181 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4afb97-56d0-4c4f-879d-218aec382b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:01.419899 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4afb97-56d0-4c4f-879d-218aec382b06 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:01.420247 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4afb97-56d0-4c4f-879d-218aec382b06 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:01.420600 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4afb97-56d0-4c4f-879d-218aec382b06 None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:01.421359 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4afb97-56d0-4c4f-879d-218aec382b06 None admin] RBAC: Adding query filter params (name=service) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:01.421667 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4afb97-56d0-4c4f-879d-218aec382b06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:01.423199 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4afb97-56d0-4c4f-879d-218aec382b06 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:01.435759 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 336/645] 10.222.0.118 () {56 vars in 1108 bytes} [Thu Jul 14 15:24:01 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:01.435759 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4afb97-56d0-4c4f-879d-218aec382b06 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:01.448164 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:01.521753 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b426de7-918e-43d3-88d7-c4bd13a1134c None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:01.553257 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4afb97-56d0-4c4f-879d-218aec382b06 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:01.559001 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484e4484-f3b1-4065-b31c-dd5912bb32ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:01.559680 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e4484-f3b1-4065-b31c-dd5912bb32ca None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:01.559963 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e4484-f3b1-4065-b31c-dd5912bb32ca None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:01.560238 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e4484-f3b1-4065-b31c-dd5912bb32ca None admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:01.560985 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484e4484-f3b1-4065-b31c-dd5912bb32ca None admin] RBAC: Adding query filter params (name=service) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:01.561294 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484e4484-f3b1-4065-b31c-dd5912bb32ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:01.562717 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484e4484-f3b1-4065-b31c-dd5912bb32ca None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:01.576554 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 310/646] 10.222.0.118 () {56 vars in 1108 bytes} [Thu Jul 14 15:24:01 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:01.577417 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484e4484-f3b1-4065-b31c-dd5912bb32ca None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:01.593380 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22391aa-c7b2-4806-8653-0ce02af301d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:01.594426 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22391aa-c7b2-4806-8653-0ce02af301d7 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:01.594709 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22391aa-c7b2-4806-8653-0ce02af301d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:01.595260 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22391aa-c7b2-4806-8653-0ce02af301d7 None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:01.596001 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22391aa-c7b2-4806-8653-0ce02af301d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:01.596456 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22391aa-c7b2-4806-8653-0ce02af301d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:01.598274 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22391aa-c7b2-4806-8653-0ce02af301d7 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:01.617988 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 337/647] 10.222.0.118 () {56 vars in 1114 bytes} [Thu Jul 14 15:24:01 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:01.617988 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22391aa-c7b2-4806-8653-0ce02af301d7 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:01.625104 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:01.698183 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:01.701219 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484e4484-f3b1-4065-b31c-dd5912bb32ca None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:01.736642 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22391aa-c7b2-4806-8653-0ce02af301d7 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:01.747021 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf91dc07-f738-49a9-a442-c00903239086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:01.748177 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf91dc07-f738-49a9-a442-c00903239086 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:01.748764 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf91dc07-f738-49a9-a442-c00903239086 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:01.749371 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf91dc07-f738-49a9-a442-c00903239086 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:01.782784 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d581c3b9-1b65-4fd7-877f-0eee5c69c26f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:01.783607 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d581c3b9-1b65-4fd7-877f-0eee5c69c26f None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:01.783885 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d581c3b9-1b65-4fd7-877f-0eee5c69c26f None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:01.784160 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d581c3b9-1b65-4fd7-877f-0eee5c69c26f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:01.801017 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d581c3b9-1b65-4fd7-877f-0eee5c69c26f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:01.802520 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d581c3b9-1b65-4fd7-877f-0eee5c69c26f None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:01.821667 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-d581c3b9-1b65-4fd7-877f-0eee5c69c26f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:01.821667 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:01.821667 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:01.821667 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:01.821667 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:01.821667 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:01.821667 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:01.821667 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:01.821667 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:01.821667 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:01.821667 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:01.821667 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:01.821667 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:24:01.821667 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:24:01.821667 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:24:01.822649 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:24:01.822649 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:01.822649 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:01.822649 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:01.822649 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:01.822649 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:01.822649 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:01.822649 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:01.822649 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:01.822649 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:01.822649 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:01.822649 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:01.822649 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:01.822649 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:01.822649 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:01.822649 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:01.822649 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:01.823525 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:24:01.823525 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:24:01.823525 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:01.823525 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:24:01.827646 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 338/648] 10.222.0.118 () {56 vars in 1113 bytes} [Thu Jul 14 15:24:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:01.828519 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d581c3b9-1b65-4fd7-877f-0eee5c69c26f None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:01.831233 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf91dc07-f738-49a9-a442-c00903239086 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:01.833061 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf91dc07-f738-49a9-a442-c00903239086 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:01.896716 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:01.947962 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:01.955826 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d581c3b9-1b65-4fd7-877f-0eee5c69c26f None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:01.957874 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 311/649] 10.222.0.118 () {58 vars in 1287 bytes} [Thu Jul 14 15:24:01 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 15:24:01.958783 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf91dc07-f738-49a9-a442-c00903239086 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:01.994636 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb30aee-d38f-4385-8f83-f8d147f4efba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:01.995562 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb30aee-d38f-4385-8f83-f8d147f4efba None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:01.995966 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb30aee-d38f-4385-8f83-f8d147f4efba None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:01.996332 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb30aee-d38f-4385-8f83-f8d147f4efba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:02.008754 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb30aee-d38f-4385-8f83-f8d147f4efba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:02.010573 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb30aee-d38f-4385-8f83-f8d147f4efba None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:02.029087 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-7cb30aee-d38f-4385-8f83-f8d147f4efba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:02.029087 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:02.029087 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:02.029087 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:02.029087 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:02.029087 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:02.029087 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:02.029087 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:02.029087 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:02.029087 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:02.029087 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:02.029087 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:02.029087 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:24:02.029087 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:24:02.029087 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:24:02.030045 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:24:02.030045 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:02.030045 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:02.030045 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:02.030045 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:02.030045 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:02.030045 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:02.030045 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:02.030045 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:02.030045 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:02.030045 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:02.030045 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:02.030045 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:02.030045 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:02.030045 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:02.030045 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:02.030045 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:02.030963 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:24:02.030963 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:24:02.030963 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:02.030963 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:24:02.030963 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 339/650] 10.222.0.118 () {56 vars in 1113 bytes} [Thu Jul 14 15:24:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:02.031432 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb30aee-d38f-4385-8f83-f8d147f4efba None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:02.062167 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf91dc07-f738-49a9-a442-c00903239086 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:02.098546 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66362af6-1960-4504-a433-82fa2dcf6131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:02.099336 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66362af6-1960-4504-a433-82fa2dcf6131 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:02.099724 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66362af6-1960-4504-a433-82fa2dcf6131 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:02.099998 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66362af6-1960-4504-a433-82fa2dcf6131 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:02.106824 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66362af6-1960-4504-a433-82fa2dcf6131 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:02.108390 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66362af6-1960-4504-a433-82fa2dcf6131 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:02.123561 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-66362af6-1960-4504-a433-82fa2dcf6131 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:24:02.123561 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:02.123561 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:02.123561 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:02.123561 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:02.123561 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:02.123561 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:02.123561 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:02.123561 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:02.123561 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:02.123561 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:02.123561 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:02.123561 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 15:24:02.123561 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 15:24:02.123561 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 15:24:02.124491 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 15:24:02.124491 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:02.124491 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:02.124491 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:02.124491 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:02.124491 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:02.124491 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:02.124491 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:02.124491 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:02.124491 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:02.124491 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:02.124491 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:02.124491 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:02.124491 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:02.124491 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:02.124491 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:02.124491 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:02.125354 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 15:24:02.125354 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 15:24:02.125354 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:24:02.125354 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:24:02.125354 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:24:02.125354 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:24:02.125354 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:24:02.125354 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:24:02.125354 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 312/651] 10.222.0.118 () {56 vars in 1116 bytes} [Thu Jul 14 15:24:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:02.126482 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66362af6-1960-4504-a433-82fa2dcf6131 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:02.140773 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb30aee-d38f-4385-8f83-f8d147f4efba None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:02.152592 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:02.179813 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69c3756-d989-44bb-87df-3fe46c329f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:02.180577 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69c3756-d989-44bb-87df-3fe46c329f3c None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:02.180922 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69c3756-d989-44bb-87df-3fe46c329f3c None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:02.181261 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69c3756-d989-44bb-87df-3fe46c329f3c None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:02.182084 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69c3756-d989-44bb-87df-3fe46c329f3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:02.182395 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69c3756-d989-44bb-87df-3fe46c329f3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:02.183757 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69c3756-d989-44bb-87df-3fe46c329f3c None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:02.189238 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:02.200868 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 340/652] 10.222.0.118 () {56 vars in 1114 bytes} [Thu Jul 14 15:24:02 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:02.200868 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69c3756-d989-44bb-87df-3fe46c329f3c None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:02.238443 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66362af6-1960-4504-a433-82fa2dcf6131 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:02.276475 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bf2c50-8595-43f3-96a9-33aaec5cf0b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:02.277267 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf2c50-8595-43f3-96a9-33aaec5cf0b8 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:02.277544 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf2c50-8595-43f3-96a9-33aaec5cf0b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:02.277815 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf2c50-8595-43f3-96a9-33aaec5cf0b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:02.289877 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bf2c50-8595-43f3-96a9-33aaec5cf0b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:02.291368 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bf2c50-8595-43f3-96a9-33aaec5cf0b8 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:02.305154 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69c3756-d989-44bb-87df-3fe46c329f3c None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:02.309048 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-62bf2c50-8595-43f3-96a9-33aaec5cf0b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:02.309048 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:02.309048 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:02.309048 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:02.309048 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:02.309048 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:02.309048 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:02.309048 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:02.309048 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:02.309048 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:02.309048 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:02.309048 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:02.309048 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:24:02.309048 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:24:02.309048 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:24:02.310164 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:24:02.310164 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:02.310164 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:02.310164 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:02.310164 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:02.310164 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:02.310164 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:02.310164 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:02.310164 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:02.310164 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:02.310164 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:02.310164 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:02.310164 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:02.310164 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:02.310164 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:02.310164 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:02.310164 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:02.311056 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:24:02.311056 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:24:02.311056 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:02.311056 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:24:02.311056 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 313/653] 10.222.0.118 () {56 vars in 1113 bytes} [Thu Jul 14 15:24:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:02.311056 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bf2c50-8595-43f3-96a9-33aaec5cf0b8 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:02.341402 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33f45c0-4892-4a4a-91ae-4367dffbb8a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:02.342091 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33f45c0-4892-4a4a-91ae-4367dffbb8a8 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:02.342373 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33f45c0-4892-4a4a-91ae-4367dffbb8a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:02.342672 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33f45c0-4892-4a4a-91ae-4367dffbb8a8 None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:02.343397 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33f45c0-4892-4a4a-91ae-4367dffbb8a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:02.343702 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33f45c0-4892-4a4a-91ae-4367dffbb8a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:02.345068 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33f45c0-4892-4a4a-91ae-4367dffbb8a8 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:02.358618 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 341/654] 10.222.0.118 () {56 vars in 1114 bytes} [Thu Jul 14 15:24:02 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:02.359440 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33f45c0-4892-4a4a-91ae-4367dffbb8a8 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:02.393033 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:02.413526 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bf2c50-8595-43f3-96a9-33aaec5cf0b8 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:02.428038 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:02.449916 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4372219d-3f89-4e2b-86a8-b74345fea9f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:02.450627 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4372219d-3f89-4e2b-86a8-b74345fea9f2 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:02.450909 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4372219d-3f89-4e2b-86a8-b74345fea9f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:02.451183 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4372219d-3f89-4e2b-86a8-b74345fea9f2 None admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:02.451977 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4372219d-3f89-4e2b-86a8-b74345fea9f2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:02.452283 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4372219d-3f89-4e2b-86a8-b74345fea9f2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:02.453833 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4372219d-3f89-4e2b-86a8-b74345fea9f2 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:02.463298 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33f45c0-4892-4a4a-91ae-4367dffbb8a8 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:02.465766 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 314/655] 10.222.0.118 () {56 vars in 1153 bytes} [Thu Jul 14 15:24:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:02.467040 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f869d8cd-fbb8-416b-bda6-3950e3aba5f0 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:02.467322 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f869d8cd-fbb8-416b-bda6-3950e3aba5f0 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:02.467592 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f869d8cd-fbb8-416b-bda6-3950e3aba5f0 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:02.468993 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 315/656] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:24:02 2022] GET /identity => generated 271 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:24:02.469502 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f869d8cd-fbb8-416b-bda6-3950e3aba5f0 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:02.502858 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdcb696-a445-42c6-a598-c9a7ad5b436c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:02.503568 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdcb696-a445-42c6-a598-c9a7ad5b436c None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:02.503845 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdcb696-a445-42c6-a598-c9a7ad5b436c None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:02.504117 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdcb696-a445-42c6-a598-c9a7ad5b436c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:02.512446 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdcb696-a445-42c6-a598-c9a7ad5b436c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:02.513885 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdcb696-a445-42c6-a598-c9a7ad5b436c None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:02.528172 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-efdcb696-a445-42c6-a598-c9a7ad5b436c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 14 15:24:02.528172 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:02.528172 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:02.528172 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:02.528172 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:02.528172 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:02.528172 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:02.528172 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:02.528172 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:02.528172 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:02.528172 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:02.528172 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:02.528172 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 15:24:02.528172 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 15:24:02.528172 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 15:24:02.528172 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 15:24:02.529149 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:02.529149 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:02.529149 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 15:24:02.529149 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:24:02.529149 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 15:24:02.529149 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:24:02.529149 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:02.529149 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:02.529149 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:02.529149 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:02.529149 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:02.529149 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:02.529149 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:02.529149 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:02.529149 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:02.529149 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:02.529149 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:02.529149 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:02.530139 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:02.530139 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:02.530139 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 15:24:02.530139 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 15:24:02.530139 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 15:24:02.530139 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 15:24:02.530139 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 15:24:02.530139 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 15:24:02.530139 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 14 15:24:02.530139 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:24:02.530139 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 342/657] 10.222.0.118 () {56 vars in 1107 bytes} [Thu Jul 14 15:24:02 2022] GET /identity/v3/users/neutron => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:02.530139 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdcb696-a445-42c6-a598-c9a7ad5b436c None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:02.571905 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f869d8cd-fbb8-416b-bda6-3950e3aba5f0 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:02.604987 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0793b6b4-4916-4745-b64e-9a244c423e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:02.605644 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0793b6b4-4916-4745-b64e-9a244c423e2f None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:02.605929 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0793b6b4-4916-4745-b64e-9a244c423e2f None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:02.606232 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0793b6b4-4916-4745-b64e-9a244c423e2f None admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:02.607192 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0793b6b4-4916-4745-b64e-9a244c423e2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:02.607317 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0793b6b4-4916-4745-b64e-9a244c423e2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:02.608610 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0793b6b4-4916-4745-b64e-9a244c423e2f None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:02.624966 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 316/658] 10.222.0.118 () {56 vars in 1114 bytes} [Thu Jul 14 15:24:02 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:02.624966 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0793b6b4-4916-4745-b64e-9a244c423e2f None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:02.642558 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:02.653314 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdcb696-a445-42c6-a598-c9a7ad5b436c None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:02.657774 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:02.688082 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c83208-15c6-42bf-bc11-917c0b5285a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:02.688868 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c83208-15c6-42bf-bc11-917c0b5285a7 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:02.689146 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c83208-15c6-42bf-bc11-917c0b5285a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:02.689421 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c83208-15c6-42bf-bc11-917c0b5285a7 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:02.696440 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c83208-15c6-42bf-bc11-917c0b5285a7 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:02.697877 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c83208-15c6-42bf-bc11-917c0b5285a7 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:02.712775 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-13c83208-15c6-42bf-bc11-917c0b5285a7 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 15:24:02.712775 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:02.712775 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:02.712775 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:02.712775 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:02.712775 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:02.712775 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:02.712775 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:02.712775 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:02.712775 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:02.712775 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:02.712775 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:02.712775 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 15:24:02.712775 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 15:24:02.712775 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 15:24:02.712775 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 15:24:02.713946 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:02.713946 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:02.713946 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 15:24:02.713946 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:24:02.713946 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 15:24:02.713946 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:24:02.713946 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:02.713946 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:02.713946 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:02.713946 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:02.713946 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:02.713946 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:02.713946 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:02.713946 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:02.713946 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:02.713946 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:02.713946 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:02.713946 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:02.714909 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:02.714909 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:02.714909 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 15:24:02.714909 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 15:24:02.714909 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 15:24:02.714909 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 15:24:02.714909 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 15:24:02.714909 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 15:24:02.714909 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 15:24:02.714909 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:24:02.714909 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 343/659] 10.222.0.118 () {56 vars in 1104 bytes} [Thu Jul 14 15:24:02 2022] GET /identity/v3/users/cinder => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:02.715496 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6fb0ed-863e-4a8e-9f79-eb61575501b7 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:02.715496 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6fb0ed-863e-4a8e-9f79-eb61575501b7 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:02.715846 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6fb0ed-863e-4a8e-9f79-eb61575501b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:02.730773 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0793b6b4-4916-4745-b64e-9a244c423e2f None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:02.734492 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-bc6fb0ed-863e-4a8e-9f79-eb61575501b7 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:02.735695 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-bc6fb0ed-863e-4a8e-9f79-eb61575501b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:02.765461 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aaa9fa-6c67-4dca-b032-3c4bc881192b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:02.766199 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aaa9fa-6c67-4dca-b032-3c4bc881192b None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:02.766485 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aaa9fa-6c67-4dca-b032-3c4bc881192b None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:02.766784 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aaa9fa-6c67-4dca-b032-3c4bc881192b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:02.767616 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aaa9fa-6c67-4dca-b032-3c4bc881192b None admin] RBAC: Adding query filter params (role.id=3185f450429e4bb3b5f289b615f3269b, scope.project.id=939bf9541f4a4afe86550f749d337680, user.id=f0177fc696ea40069902803da09f437c) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:02.768469 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aaa9fa-6c67-4dca-b032-3c4bc881192b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:02.769907 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aaa9fa-6c67-4dca-b032-3c4bc881192b None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:02.775757 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 317/660] 10.222.0.118 () {56 vars in 1379 bytes} [Thu Jul 14 15:24:02 2022] GET /identity/v3/role_assignments?user.id=f0177fc696ea40069902803da09f437c&scope.project.id=939bf9541f4a4afe86550f749d337680&role.id=3185f450429e4bb3b5f289b615f3269b => generated 610 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:02.776537 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aaa9fa-6c67-4dca-b032-3c4bc881192b None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:02.809261 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 344/661] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:24:02 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:24:02.810200 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6fb0ed-863e-4a8e-9f79-eb61575501b7 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:02.896615 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:02.905730 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aaa9fa-6c67-4dca-b032-3c4bc881192b None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:02.914227 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:02.937760 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6fb0ed-863e-4a8e-9f79-eb61575501b7 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:02.959009 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf0c39c-960a-44e9-ad00-b6ee55f07a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:02.959701 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf0c39c-960a-44e9-ad00-b6ee55f07a51 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:02.959981 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf0c39c-960a-44e9-ad00-b6ee55f07a51 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:02.960258 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf0c39c-960a-44e9-ad00-b6ee55f07a51 None admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:02.961111 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf0c39c-960a-44e9-ad00-b6ee55f07a51 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:02.961429 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf0c39c-960a-44e9-ad00-b6ee55f07a51 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:02.962946 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf0c39c-960a-44e9-ad00-b6ee55f07a51 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:02.981739 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ac3597-a9a8-46c6-bf8d-820f584b2f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:02.982579 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ac3597-a9a8-46c6-bf8d-820f584b2f2e None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:02.983376 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ac3597-a9a8-46c6-bf8d-820f584b2f2e None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:02.983516 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 318/662] 10.222.0.118 () {56 vars in 1144 bytes} [Thu Jul 14 15:24:02 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 376 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:02.983609 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ac3597-a9a8-46c6-bf8d-820f584b2f2e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:02.984139 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf0c39c-960a-44e9-ad00-b6ee55f07a51 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:02.992198 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ac3597-a9a8-46c6-bf8d-820f584b2f2e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:02.994331 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ac3597-a9a8-46c6-bf8d-820f584b2f2e None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:03.011171 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-80ac3597-a9a8-46c6-bf8d-820f584b2f2e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:24:03.011171 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:03.011171 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:03.011171 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:03.011171 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:03.011171 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:03.011171 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:03.011171 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:03.011171 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:03.011171 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:03.011171 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:03.011171 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:03.011171 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 15:24:03.011171 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 15:24:03.011171 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 15:24:03.012324 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 15:24:03.012324 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:03.012324 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:03.012324 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:03.012324 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:03.012324 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:03.012324 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:03.012324 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:03.012324 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:03.012324 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:03.012324 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:03.012324 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:03.012324 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:03.012324 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:03.012324 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:03.012324 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:03.012324 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:03.013481 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 15:24:03.013481 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 15:24:03.013481 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:24:03.013481 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:24:03.013481 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:24:03.013481 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:24:03.013481 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:24:03.013481 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:24:03.015399 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 345/663] 10.222.0.118 () {56 vars in 1116 bytes} [Thu Jul 14 15:24:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:03.016275 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ac3597-a9a8-46c6-bf8d-820f584b2f2e None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:03.101310 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf0c39c-960a-44e9-ad00-b6ee55f07a51 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:03.127042 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ac3597-a9a8-46c6-bf8d-820f584b2f2e None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:03.139838 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed8c969-161e-4c94-bce7-c767f38038c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:03.140524 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed8c969-161e-4c94-bce7-c767f38038c9 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:03.140808 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed8c969-161e-4c94-bce7-c767f38038c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:03.141095 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed8c969-161e-4c94-bce7-c767f38038c9 None admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:03.141937 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed8c969-161e-4c94-bce7-c767f38038c9 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:03.142277 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed8c969-161e-4c94-bce7-c767f38038c9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:03.144367 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed8c969-161e-4c94-bce7-c767f38038c9 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:03.168361 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 319/664] 10.222.0.118 () {56 vars in 1142 bytes} [Thu Jul 14 15:24:02 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 374 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:03.168361 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed8c969-161e-4c94-bce7-c767f38038c9 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:03.170689 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3eb393-1aa0-42b2-9dae-5dd5e84b45e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:03.172365 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3eb393-1aa0-42b2-9dae-5dd5e84b45e5 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:03.172658 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3eb393-1aa0-42b2-9dae-5dd5e84b45e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:03.172937 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3eb393-1aa0-42b2-9dae-5dd5e84b45e5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:03.182797 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:03.184529 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:03.185752 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3eb393-1aa0-42b2-9dae-5dd5e84b45e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:24:03.195944 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-3b3eb393-1aa0-42b2-9dae-5dd5e84b45e5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:24:03.195944 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:03.195944 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:03.195944 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:03.195944 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:03.195944 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:03.195944 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:03.195944 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:03.195944 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:03.195944 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:03.195944 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:03.195944 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:03.195944 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:24:03.195944 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:24:03.195944 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:24:03.195944 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:24:03.196921 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:24:03.196921 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:24:03.196921 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:24:03.196921 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:24:03.196921 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:03.196921 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:03.196921 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:03.196921 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:03.196921 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:03.196921 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:03.196921 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:03.196921 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:03.196921 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:03.196921 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:03.196921 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:03.196921 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:03.197747 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:03.197747 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:03.197747 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:03.197747 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:03.197747 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:24:03.197747 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:24:03.197747 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:24:03.197747 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:24:03.197747 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:24:03.197747 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:24:03.197747 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:24:03.197747 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:24:03.202121 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 346/665] 10.222.0.118 () {56 vars in 1107 bytes} [Thu Jul 14 15:24:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:03.202811 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3eb393-1aa0-42b2-9dae-5dd5e84b45e5 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:03.283477 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed8c969-161e-4c94-bce7-c767f38038c9 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:03.323877 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f20c6e-0d56-4295-8a6f-89f4f677165c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:03.324581 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f20c6e-0d56-4295-8a6f-89f4f677165c None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:03.324801 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f20c6e-0d56-4295-8a6f-89f4f677165c None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:03.325068 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f20c6e-0d56-4295-8a6f-89f4f677165c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:03.335798 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3eb393-1aa0-42b2-9dae-5dd5e84b45e5 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:03.370763 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff31c47-b467-4661-aaed-0dc4992b0353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:03.371584 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff31c47-b467-4661-aaed-0dc4992b0353 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:03.371963 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff31c47-b467-4661-aaed-0dc4992b0353 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:03.372331 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff31c47-b467-4661-aaed-0dc4992b0353 None admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:03.373132 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff31c47-b467-4661-aaed-0dc4992b0353 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:03.373444 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff31c47-b467-4661-aaed-0dc4992b0353 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:03.374900 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff31c47-b467-4661-aaed-0dc4992b0353 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:03.388717 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 347/666] 10.222.0.118 () {56 vars in 1153 bytes} [Thu Jul 14 15:24:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:03.389533 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff31c47-b467-4661-aaed-0dc4992b0353 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:03.403761 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f20c6e-0d56-4295-8a6f-89f4f677165c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:03.405427 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f20c6e-0d56-4295-8a6f-89f4f677165c None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:03.420206 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:03.453423 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:03.496401 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff31c47-b467-4661-aaed-0dc4992b0353 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:03.518201 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 320/667] 10.222.0.118 () {58 vars in 1287 bytes} [Thu Jul 14 15:24:03 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 15:24:03.519256 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f20c6e-0d56-4295-8a6f-89f4f677165c None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:03.535881 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11572c9d-d3a0-4de5-a06e-8f3a7b9ccc73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:03.536467 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11572c9d-d3a0-4de5-a06e-8f3a7b9ccc73 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:03.536739 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11572c9d-d3a0-4de5-a06e-8f3a7b9ccc73 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:03.537016 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11572c9d-d3a0-4de5-a06e-8f3a7b9ccc73 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:03.608224 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11572c9d-d3a0-4de5-a06e-8f3a7b9ccc73 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:03.610152 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11572c9d-d3a0-4de5-a06e-8f3a7b9ccc73 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:03.626932 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f20c6e-0d56-4295-8a6f-89f4f677165c None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:03.642406 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:03.668538 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dfb053-f35b-4270-bbf0-51df109e5ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:03.669213 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dfb053-f35b-4270-bbf0-51df109e5ec8 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:03.669496 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dfb053-f35b-4270-bbf0-51df109e5ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:03.669918 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dfb053-f35b-4270-bbf0-51df109e5ec8 None admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:03.671005 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dfb053-f35b-4270-bbf0-51df109e5ec8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:03.671318 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dfb053-f35b-4270-bbf0-51df109e5ec8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:03.672709 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dfb053-f35b-4270-bbf0-51df109e5ec8 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:03.681781 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 321/668] 10.222.0.118 () {56 vars in 1108 bytes} [Thu Jul 14 15:24:03 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:03.682635 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dfb053-f35b-4270-bbf0-51df109e5ec8 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:03.686857 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:03.738178 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 348/669] 10.222.0.118 () {58 vars in 1287 bytes} [Thu Jul 14 15:24:03 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 15:24:03.739029 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11572c9d-d3a0-4de5-a06e-8f3a7b9ccc73 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:03.808911 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dfb053-f35b-4270-bbf0-51df109e5ec8 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:03.845908 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d28adcb-7007-4d3c-9e60-37669bb55697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:03.847102 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d28adcb-7007-4d3c-9e60-37669bb55697 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:03.847271 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11572c9d-d3a0-4de5-a06e-8f3a7b9ccc73 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:03.847370 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d28adcb-7007-4d3c-9e60-37669bb55697 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:03.847639 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d28adcb-7007-4d3c-9e60-37669bb55697 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:03.848471 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d28adcb-7007-4d3c-9e60-37669bb55697 None admin] RBAC: Adding query filter params (role.id=3185f450429e4bb3b5f289b615f3269b, scope.project.id=939bf9541f4a4afe86550f749d337680, user.id=b4336c3d678a4d33b00885def42dfb1f) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:03.848784 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d28adcb-7007-4d3c-9e60-37669bb55697 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:03.850308 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d28adcb-7007-4d3c-9e60-37669bb55697 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:03.856558 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 322/670] 10.222.0.118 () {56 vars in 1379 bytes} [Thu Jul 14 15:24:03 2022] GET /identity/v3/role_assignments?user.id=b4336c3d678a4d33b00885def42dfb1f&scope.project.id=939bf9541f4a4afe86550f749d337680&role.id=3185f450429e4bb3b5f289b615f3269b => generated 610 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:03.857368 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d28adcb-7007-4d3c-9e60-37669bb55697 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:03.902559 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5148ef-69af-4b4d-9d41-2f5f8665995a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:03.903367 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5148ef-69af-4b4d-9d41-2f5f8665995a None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:03.903641 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5148ef-69af-4b4d-9d41-2f5f8665995a None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:03.903910 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5148ef-69af-4b4d-9d41-2f5f8665995a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:03.918667 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:03.918876 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5148ef-69af-4b4d-9d41-2f5f8665995a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:03.920898 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5148ef-69af-4b4d-9d41-2f5f8665995a None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:03.951434 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-4b5148ef-69af-4b4d-9d41-2f5f8665995a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:03.951434 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:03.951434 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:03.951434 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:03.951434 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:03.951434 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:03.951434 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:03.951434 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:03.951434 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:03.951434 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:03.951434 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:03.951434 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:03.951434 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:24:03.951434 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:24:03.951434 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:24:03.952462 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:24:03.952462 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:03.952462 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:03.952462 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:03.952462 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:03.952462 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:03.952462 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:03.952462 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:03.952462 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:03.952462 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:03.952462 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:03.952462 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:03.952462 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:03.952462 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:03.952462 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:03.952462 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:03.952462 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:03.953402 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:24:03.953402 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:24:03.953402 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:03.953402 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:24:03.953402 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 349/671] 10.222.0.118 () {56 vars in 1113 bytes} [Thu Jul 14 15:24:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:03.953402 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5148ef-69af-4b4d-9d41-2f5f8665995a None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:03.975530 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:04.009829 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d28adcb-7007-4d3c-9e60-37669bb55697 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:04.058144 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ff4bb2-1050-4d82-bbed-0a17d3081fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:04.059265 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ff4bb2-1050-4d82-bbed-0a17d3081fa2 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:04.059703 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ff4bb2-1050-4d82-bbed-0a17d3081fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:04.060120 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ff4bb2-1050-4d82-bbed-0a17d3081fa2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:04.073951 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ff4bb2-1050-4d82-bbed-0a17d3081fa2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:04.075470 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ff4bb2-1050-4d82-bbed-0a17d3081fa2 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:04.095801 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-68ff4bb2-1050-4d82-bbed-0a17d3081fa2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:04.095801 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:04.095801 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:04.095801 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:04.095801 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:04.095801 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:04.095801 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:04.095801 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:04.095801 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:04.095801 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:04.095801 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:04.095801 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:04.095801 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:24:04.095801 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:24:04.095801 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:24:04.097269 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:24:04.097269 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:04.097269 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:04.097269 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:04.097269 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:04.097269 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:04.097269 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:04.097269 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:04.097269 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:04.097269 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:04.097269 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:04.097269 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:04.097269 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:04.097269 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:04.097269 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:04.097269 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:04.097269 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:04.098165 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:24:04.098165 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:24:04.098165 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:04.098165 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:24:04.099261 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 323/672] 10.222.0.118 () {56 vars in 1113 bytes} [Thu Jul 14 15:24:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:04.100877 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ff4bb2-1050-4d82-bbed-0a17d3081fa2 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:04.108097 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5148ef-69af-4b4d-9d41-2f5f8665995a None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:04.149616 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3398e33-ff6a-42e3-a46b-6e2e7ea1c11f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:04.150451 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3398e33-ff6a-42e3-a46b-6e2e7ea1c11f None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:04.150726 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3398e33-ff6a-42e3-a46b-6e2e7ea1c11f None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:04.150995 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3398e33-ff6a-42e3-a46b-6e2e7ea1c11f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:04.164322 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3398e33-ff6a-42e3-a46b-6e2e7ea1c11f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:04.166561 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3398e33-ff6a-42e3-a46b-6e2e7ea1c11f None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:04.189533 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-e3398e33-ff6a-42e3-a46b-6e2e7ea1c11f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:04.189533 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:04.189533 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:04.189533 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:04.189533 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:04.189533 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:04.189533 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:04.189533 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:04.189533 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:04.189533 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:04.189533 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:04.189533 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:04.189533 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:24:04.189533 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:24:04.189533 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:24:04.190710 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:24:04.190710 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:04.190710 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:04.190710 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:04.190710 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:04.190710 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:04.190710 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:04.190710 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:04.190710 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:04.190710 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:04.190710 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:04.190710 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:04.190710 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:04.190710 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:04.190710 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:04.190710 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:04.190710 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:04.191878 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:24:04.191878 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:24:04.191878 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:04.191878 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:24:04.191878 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 350/673] 10.222.0.118 () {56 vars in 1113 bytes} [Thu Jul 14 15:24:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:04.191878 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3398e33-ff6a-42e3-a46b-6e2e7ea1c11f None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:04.219791 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:04.232952 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ff4bb2-1050-4d82-bbed-0a17d3081fa2 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:04.271146 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552bef04-073f-4157-a161-6ebd3ea3f0ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:04.272000 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552bef04-073f-4157-a161-6ebd3ea3f0ae None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:04.272350 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552bef04-073f-4157-a161-6ebd3ea3f0ae None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:04.272692 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552bef04-073f-4157-a161-6ebd3ea3f0ae None admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:04.273498 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552bef04-073f-4157-a161-6ebd3ea3f0ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:04.274001 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552bef04-073f-4157-a161-6ebd3ea3f0ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:04.275566 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552bef04-073f-4157-a161-6ebd3ea3f0ae None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:04.282377 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:04.292038 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 324/674] 10.222.0.118 () {56 vars in 1114 bytes} [Thu Jul 14 15:24:04 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:04.297310 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552bef04-073f-4157-a161-6ebd3ea3f0ae None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:04.340125 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3398e33-ff6a-42e3-a46b-6e2e7ea1c11f None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:04.382164 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ff59bb-7189-4384-a632-6af2dbc726da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:04.383131 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ff59bb-7189-4384-a632-6af2dbc726da None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:04.383657 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ff59bb-7189-4384-a632-6af2dbc726da None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:04.383657 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ff59bb-7189-4384-a632-6af2dbc726da None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:04.384650 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ff59bb-7189-4384-a632-6af2dbc726da None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:04.385044 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ff59bb-7189-4384-a632-6af2dbc726da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:04.386805 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ff59bb-7189-4384-a632-6af2dbc726da None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:04.410326 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 351/675] 10.222.0.118 () {56 vars in 1114 bytes} [Thu Jul 14 15:24:04 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:04.411318 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ff59bb-7189-4384-a632-6af2dbc726da None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:04.431498 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552bef04-073f-4157-a161-6ebd3ea3f0ae None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:04.470967 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3a1c25-6c48-4c48-9d8a-b959b791e162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:04.472568 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3a1c25-6c48-4c48-9d8a-b959b791e162 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:04.473086 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3a1c25-6c48-4c48-9d8a-b959b791e162 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:04.473670 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3a1c25-6c48-4c48-9d8a-b959b791e162 None admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:04.474733 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3a1c25-6c48-4c48-9d8a-b959b791e162 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:04.475260 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3a1c25-6c48-4c48-9d8a-b959b791e162 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:04.477099 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3a1c25-6c48-4c48-9d8a-b959b791e162 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:04.490613 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 325/676] 10.222.0.118 () {56 vars in 1114 bytes} [Thu Jul 14 15:24:04 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:04.491919 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3a1c25-6c48-4c48-9d8a-b959b791e162 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:04.523465 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ff59bb-7189-4384-a632-6af2dbc726da None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:04.526412 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:04.551023 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:04.565465 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df9924b-9c56-4157-be4a-02c7d34eb53f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:04.566287 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df9924b-9c56-4157-be4a-02c7d34eb53f None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:04.566563 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df9924b-9c56-4157-be4a-02c7d34eb53f None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:04.566833 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df9924b-9c56-4157-be4a-02c7d34eb53f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:04.579932 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df9924b-9c56-4157-be4a-02c7d34eb53f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:04.581998 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df9924b-9c56-4157-be4a-02c7d34eb53f None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:04.602255 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-4df9924b-9c56-4157-be4a-02c7d34eb53f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:24:04.602255 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:04.602255 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:04.602255 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:04.602255 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:04.602255 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:04.602255 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:04.602255 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:04.602255 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:04.602255 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:04.602255 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:04.602255 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:04.602255 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 15:24:04.602255 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 15:24:04.602255 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 15:24:04.603153 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 15:24:04.603153 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:04.603153 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:04.603153 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:04.603153 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:04.603153 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:04.603153 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:04.603153 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:04.603153 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:04.603153 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:04.603153 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:04.603153 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:04.603153 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:04.603153 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:04.603153 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:04.603153 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:04.603153 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:04.604031 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 15:24:04.604031 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 15:24:04.604031 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:24:04.604031 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:24:04.604031 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:24:04.604031 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:24:04.604031 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:24:04.604031 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:24:04.604031 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 352/677] 10.222.0.118 () {56 vars in 1116 bytes} [Thu Jul 14 15:24:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:04.605003 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df9924b-9c56-4157-be4a-02c7d34eb53f None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:04.610372 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3a1c25-6c48-4c48-9d8a-b959b791e162 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:04.651862 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6697f66c-53a1-482b-80af-08bff9224db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:04.653034 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6697f66c-53a1-482b-80af-08bff9224db4 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:04.653547 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6697f66c-53a1-482b-80af-08bff9224db4 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:04.654085 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6697f66c-53a1-482b-80af-08bff9224db4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:04.663183 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6697f66c-53a1-482b-80af-08bff9224db4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:04.665588 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6697f66c-53a1-482b-80af-08bff9224db4 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:04.681829 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-6697f66c-53a1-482b-80af-08bff9224db4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 14 15:24:04.681829 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:04.681829 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:04.681829 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:04.681829 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:04.681829 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:04.681829 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:04.681829 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:04.681829 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:04.681829 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:04.681829 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:04.681829 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:04.681829 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 15:24:04.681829 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 15:24:04.681829 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 15:24:04.681829 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 15:24:04.683049 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:04.683049 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:04.683049 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 15:24:04.683049 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:24:04.683049 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 15:24:04.683049 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:24:04.683049 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:04.683049 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:04.683049 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:04.683049 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:04.683049 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:04.683049 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:04.683049 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:04.683049 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:04.683049 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:04.683049 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:04.683049 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:04.683049 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:04.684030 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:04.684030 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:04.684030 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 15:24:04.684030 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 15:24:04.684030 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 15:24:04.684030 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 15:24:04.684030 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 15:24:04.684030 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 15:24:04.684030 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 14 15:24:04.684030 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:24:04.686822 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 326/678] 10.222.0.118 () {56 vars in 1101 bytes} [Thu Jul 14 15:24:04 2022] GET /identity/v3/users/swift => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:04.687887 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6697f66c-53a1-482b-80af-08bff9224db4 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:04.739733 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df9924b-9c56-4157-be4a-02c7d34eb53f None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:04.767966 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:04.780789 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3a2f2b-75be-48c1-a075-00ea77631320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:04.781394 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3a2f2b-75be-48c1-a075-00ea77631320 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:04.781683 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3a2f2b-75be-48c1-a075-00ea77631320 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:04.782041 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3a2f2b-75be-48c1-a075-00ea77631320 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:04.790182 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3a2f2b-75be-48c1-a075-00ea77631320 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:04.791712 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3a2f2b-75be-48c1-a075-00ea77631320 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:04.806265 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6697f66c-53a1-482b-80af-08bff9224db4 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:04.806968 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-cd3a2f2b-75be-48c1-a075-00ea77631320 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:24:04.806968 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:04.806968 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:04.806968 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:04.806968 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:04.806968 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:04.806968 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:04.806968 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:04.806968 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:04.806968 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:04.806968 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:04.806968 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:04.806968 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 15:24:04.806968 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 15:24:04.806968 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 15:24:04.807831 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 15:24:04.807831 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:04.807831 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:04.807831 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:04.807831 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:04.807831 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:04.807831 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:04.807831 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:04.807831 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:04.807831 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:04.807831 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:04.807831 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:04.807831 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:04.807831 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:04.807831 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:04.807831 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:04.807831 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:04.808730 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 15:24:04.808730 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 15:24:04.808730 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:24:04.808730 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:24:04.808730 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:24:04.808730 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:24:04.808730 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:24:04.808730 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:24:04.813355 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 353/679] 10.222.0.118 () {56 vars in 1116 bytes} [Thu Jul 14 15:24:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:04.814317 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3a2f2b-75be-48c1-a075-00ea77631320 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:04.849234 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645c9b57-d247-4b75-8218-72606d83a172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:04.850297 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645c9b57-d247-4b75-8218-72606d83a172 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:04.850808 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645c9b57-d247-4b75-8218-72606d83a172 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:04.851284 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645c9b57-d247-4b75-8218-72606d83a172 None admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:04.852440 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645c9b57-d247-4b75-8218-72606d83a172 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:04.853025 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645c9b57-d247-4b75-8218-72606d83a172 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:04.854730 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645c9b57-d247-4b75-8218-72606d83a172 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:04.864133 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:04.869982 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 327/680] 10.222.0.118 () {56 vars in 1153 bytes} [Thu Jul 14 15:24:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:04.871057 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645c9b57-d247-4b75-8218-72606d83a172 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:04.927814 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3a2f2b-75be-48c1-a075-00ea77631320 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:04.965123 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7e1917-83e8-47e6-9eee-06c8d920b4a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:04.966205 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7e1917-83e8-47e6-9eee-06c8d920b4a7 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:04.966671 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7e1917-83e8-47e6-9eee-06c8d920b4a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:04.967102 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7e1917-83e8-47e6-9eee-06c8d920b4a7 None admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:04.968109 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7e1917-83e8-47e6-9eee-06c8d920b4a7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:04.968567 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7e1917-83e8-47e6-9eee-06c8d920b4a7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:04.970177 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7e1917-83e8-47e6-9eee-06c8d920b4a7 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:04.980546 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645c9b57-d247-4b75-8218-72606d83a172 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:04.992432 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 354/681] 10.222.0.118 () {56 vars in 1140 bytes} [Thu Jul 14 15:24:04 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:04.992432 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7e1917-83e8-47e6-9eee-06c8d920b4a7 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:05.017009 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:05.024760 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b61436-2e5a-4893-8f9e-16b3de3a32a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:05.025420 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b61436-2e5a-4893-8f9e-16b3de3a32a9 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:05.025696 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b61436-2e5a-4893-8f9e-16b3de3a32a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:05.025993 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b61436-2e5a-4893-8f9e-16b3de3a32a9 None admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:05.026775 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b61436-2e5a-4893-8f9e-16b3de3a32a9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:05.027330 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b61436-2e5a-4893-8f9e-16b3de3a32a9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:05.028692 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b61436-2e5a-4893-8f9e-16b3de3a32a9 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:05.044955 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 328/682] 10.222.0.118 () {56 vars in 1153 bytes} [Thu Jul 14 15:24:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:05.044955 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549cc79d-77b4-44f0-a518-9c25cc753418 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:05.044955 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549cc79d-77b4-44f0-a518-9c25cc753418 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:05.044955 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549cc79d-77b4-44f0-a518-9c25cc753418 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:05.044955 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 329/683] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:24:05 2022] GET /identity => generated 271 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:24:05.044955 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549cc79d-77b4-44f0-a518-9c25cc753418 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:05.104513 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7e1917-83e8-47e6-9eee-06c8d920b4a7 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:05.106097 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:05.140964 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04a21c6-614d-495c-8132-8ffbf44c9634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:05.141617 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a21c6-614d-495c-8132-8ffbf44c9634 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:05.141895 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a21c6-614d-495c-8132-8ffbf44c9634 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:05.142192 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a21c6-614d-495c-8132-8ffbf44c9634 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:05.143052 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04a21c6-614d-495c-8132-8ffbf44c9634 None admin] RBAC: Adding query filter params (role.id=3185f450429e4bb3b5f289b615f3269b, scope.project.id=939bf9541f4a4afe86550f749d337680, user.id=b650be8114b64df0ac88441f1c50b2cd) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:05.143361 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04a21c6-614d-495c-8132-8ffbf44c9634 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:05.144785 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04a21c6-614d-495c-8132-8ffbf44c9634 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:05.158002 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 355/684] 10.222.0.118 () {56 vars in 1379 bytes} [Thu Jul 14 15:24:04 2022] GET /identity/v3/role_assignments?user.id=b650be8114b64df0ac88441f1c50b2cd&scope.project.id=939bf9541f4a4afe86550f749d337680&role.id=3185f450429e4bb3b5f289b615f3269b => generated 610 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:05.158002 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04a21c6-614d-495c-8132-8ffbf44c9634 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:05.166475 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549cc79d-77b4-44f0-a518-9c25cc753418 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:05.212025 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd44de7-19c5-4247-8df4-f4521332f46f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:05.212887 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd44de7-19c5-4247-8df4-f4521332f46f None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:05.213242 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd44de7-19c5-4247-8df4-f4521332f46f None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:05.213588 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd44de7-19c5-4247-8df4-f4521332f46f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:05.284953 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04a21c6-614d-495c-8132-8ffbf44c9634 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:05.293180 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:05.306626 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd44de7-19c5-4247-8df4-f4521332f46f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:05.308109 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd44de7-19c5-4247-8df4-f4521332f46f None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:05.324754 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d6cd7e-62ee-4310-873d-ed5f0931e3fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:05.325416 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d6cd7e-62ee-4310-873d-ed5f0931e3fb None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:05.325696 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d6cd7e-62ee-4310-873d-ed5f0931e3fb None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:05.326061 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d6cd7e-62ee-4310-873d-ed5f0931e3fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:05.326842 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d6cd7e-62ee-4310-873d-ed5f0931e3fb None admin] RBAC: Adding query filter params (role.id=3185f450429e4bb3b5f289b615f3269b, scope.project.id=939bf9541f4a4afe86550f749d337680, user.id=ea647438ea1c438987f28cbe39c3ff2f) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:05.327153 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d6cd7e-62ee-4310-873d-ed5f0931e3fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:05.328614 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d6cd7e-62ee-4310-873d-ed5f0931e3fb None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:05.335018 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 356/685] 10.222.0.118 () {56 vars in 1379 bytes} [Thu Jul 14 15:24:05 2022] GET /identity/v3/role_assignments?user.id=ea647438ea1c438987f28cbe39c3ff2f&scope.project.id=939bf9541f4a4afe86550f749d337680&role.id=3185f450429e4bb3b5f289b615f3269b => generated 610 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:05.336299 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8ab352-1a46-40ca-8b6f-72e5fa2388e9 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:05.336589 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8ab352-1a46-40ca-8b6f-72e5fa2388e9 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:05.336866 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8ab352-1a46-40ca-8b6f-72e5fa2388e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:05.354760 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-4a8ab352-1a46-40ca-8b6f-72e5fa2388e9 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:05.355896 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-4a8ab352-1a46-40ca-8b6f-72e5fa2388e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:05.393532 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:05.443887 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 330/686] 10.222.0.118 () {58 vars in 1287 bytes} [Thu Jul 14 15:24:05 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 15:24:05.450344 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd44de7-19c5-4247-8df4-f4521332f46f None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:05.452402 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 357/687] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:24:05 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:24:05.476702 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8ab352-1a46-40ca-8b6f-72e5fa2388e9 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:05.553546 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:05.562012 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd44de7-19c5-4247-8df4-f4521332f46f None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:05.603956 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8ab352-1a46-40ca-8b6f-72e5fa2388e9 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:05.604709 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eee7c47-64f4-4e76-b69c-67d8a2e3bb82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:05.605829 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eee7c47-64f4-4e76-b69c-67d8a2e3bb82 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:05.606130 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eee7c47-64f4-4e76-b69c-67d8a2e3bb82 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:05.607297 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eee7c47-64f4-4e76-b69c-67d8a2e3bb82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:05.620428 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eee7c47-64f4-4e76-b69c-67d8a2e3bb82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:05.622585 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eee7c47-64f4-4e76-b69c-67d8a2e3bb82 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:05.644251 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39bbb2c-4479-47df-b080-a9b1b2e61773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:05.645047 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39bbb2c-4479-47df-b080-a9b1b2e61773 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:05.645324 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39bbb2c-4479-47df-b080-a9b1b2e61773 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:05.645592 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39bbb2c-4479-47df-b080-a9b1b2e61773 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:05.646235 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-2eee7c47-64f4-4e76-b69c-67d8a2e3bb82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:05.646235 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:05.646235 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:05.646235 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:05.646235 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:05.646235 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:05.646235 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:05.646235 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:05.646235 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:05.646235 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:05.646235 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:05.646235 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:05.646235 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:24:05.646235 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:24:05.646235 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:24:05.647119 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:24:05.647119 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:05.647119 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:05.647119 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:05.647119 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:05.647119 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:05.647119 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:05.647119 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:05.647119 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:05.647119 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:05.647119 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:05.647119 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:05.647119 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:05.647119 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:05.647119 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:05.647119 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:05.647119 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:05.647995 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:24:05.647995 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:24:05.647995 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:05.647995 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:24:05.648218 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 331/688] 10.222.0.118 () {56 vars in 1113 bytes} [Thu Jul 14 15:24:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:05.653636 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eee7c47-64f4-4e76-b69c-67d8a2e3bb82 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:05.663612 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39bbb2c-4479-47df-b080-a9b1b2e61773 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:24:05.671279 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-d39bbb2c-4479-47df-b080-a9b1b2e61773 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:24:05.671279 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:05.671279 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:05.671279 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:05.671279 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:05.671279 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:05.671279 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:05.671279 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:05.671279 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:05.671279 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:05.671279 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:05.671279 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:05.671279 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:24:05.671279 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:24:05.671279 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:24:05.671279 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:24:05.672250 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:24:05.672250 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:24:05.672250 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:24:05.672250 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:24:05.672250 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:05.672250 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:05.672250 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:05.672250 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:05.672250 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:05.672250 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:05.672250 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:05.672250 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:05.672250 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:05.672250 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:05.672250 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:05.672250 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:05.673079 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:05.673079 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:05.673079 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:05.673079 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:05.673079 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:24:05.673079 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:24:05.673079 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:24:05.673079 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:24:05.673079 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:24:05.673079 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:24:05.673079 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:24:05.673079 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:24:05.673079 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 358/689] 10.222.0.118 () {56 vars in 1101 bytes} [Thu Jul 14 15:24:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:24:05.679007 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39bbb2c-4479-47df-b080-a9b1b2e61773 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:05.718406 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:05.790057 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eee7c47-64f4-4e76-b69c-67d8a2e3bb82 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:05.822376 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39bbb2c-4479-47df-b080-a9b1b2e61773 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:05.864441 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae9dee6-71c9-4c51-879f-b371356c0b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:05.865483 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae9dee6-71c9-4c51-879f-b371356c0b18 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:05.865991 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae9dee6-71c9-4c51-879f-b371356c0b18 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:05.866474 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae9dee6-71c9-4c51-879f-b371356c0b18 None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:05.867635 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae9dee6-71c9-4c51-879f-b371356c0b18 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:05.868175 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae9dee6-71c9-4c51-879f-b371356c0b18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:05.869769 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae9dee6-71c9-4c51-879f-b371356c0b18 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:05.880136 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 359/690] 10.222.0.118 () {56 vars in 1104 bytes} [Thu Jul 14 15:24:05 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:24:05.886841 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceac47c-773e-4af0-acb3-c8bf3b0a3d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:05.887515 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceac47c-773e-4af0-acb3-c8bf3b0a3d44 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:05.887799 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceac47c-773e-4af0-acb3-c8bf3b0a3d44 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:05.888078 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceac47c-773e-4af0-acb3-c8bf3b0a3d44 None admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:05.888814 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bceac47c-773e-4af0-acb3-c8bf3b0a3d44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:05.889120 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bceac47c-773e-4af0-acb3-c8bf3b0a3d44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:05.889360 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae9dee6-71c9-4c51-879f-b371356c0b18 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:05.891988 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bceac47c-773e-4af0-acb3-c8bf3b0a3d44 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:05.905328 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 332/691] 10.222.0.118 () {56 vars in 1114 bytes} [Thu Jul 14 15:24:05 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:24:05.913665 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceac47c-773e-4af0-acb3-c8bf3b0a3d44 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:05.917886 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:05.992068 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:06.026750 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae9dee6-71c9-4c51-879f-b371356c0b18 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:06.070732 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f29a4c-981f-482c-ad4f-cc0b99e50106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:06.071915 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f29a4c-981f-482c-ad4f-cc0b99e50106 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:06.072617 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f29a4c-981f-482c-ad4f-cc0b99e50106 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:06.074221 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f29a4c-981f-482c-ad4f-cc0b99e50106 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:06.097111 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f29a4c-981f-482c-ad4f-cc0b99e50106 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:06.100029 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f29a4c-981f-482c-ad4f-cc0b99e50106 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:06.119353 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceac47c-773e-4af0-acb3-c8bf3b0a3d44 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:06.135754 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-04f29a4c-981f-482c-ad4f-cc0b99e50106 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:06.135754 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:06.135754 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:06.135754 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:06.135754 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:06.135754 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:06.135754 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:06.135754 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:06.135754 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:06.135754 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:06.135754 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:06.135754 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:06.135754 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:24:06.135754 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:24:06.135754 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:24:06.136746 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:24:06.136746 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:06.136746 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:06.136746 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:06.136746 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:06.136746 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:06.136746 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:06.136746 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:06.136746 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:06.136746 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:06.136746 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:06.136746 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:06.136746 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:06.136746 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:06.136746 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:06.136746 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:06.136746 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:06.137624 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:24:06.137624 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:24:06.137624 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:06.137624 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:24:06.144317 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 360/692] 10.222.0.118 () {56 vars in 1113 bytes} [Thu Jul 14 15:24:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:06.150015 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f29a4c-981f-482c-ad4f-cc0b99e50106 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:06.192615 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36d516a-fa4c-4602-ab64-cc553e9ff748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:06.193602 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36d516a-fa4c-4602-ab64-cc553e9ff748 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:06.194001 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36d516a-fa4c-4602-ab64-cc553e9ff748 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:06.194389 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36d516a-fa4c-4602-ab64-cc553e9ff748 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:06.211000 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36d516a-fa4c-4602-ab64-cc553e9ff748 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:06.214382 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36d516a-fa4c-4602-ab64-cc553e9ff748 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:06.233784 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-a36d516a-fa4c-4602-ab64-cc553e9ff748 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:24:06.233784 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:06.233784 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:06.233784 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:06.233784 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:06.233784 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:06.233784 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:06.233784 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:06.233784 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:06.233784 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:06.233784 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:06.233784 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:06.233784 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 15:24:06.233784 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 15:24:06.233784 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 15:24:06.234760 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 15:24:06.234760 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:06.234760 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:06.234760 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:06.234760 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:06.234760 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:06.234760 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:06.234760 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:06.234760 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:06.234760 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:06.234760 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:06.234760 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:06.234760 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:06.234760 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:06.234760 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:06.234760 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:06.234760 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:06.235627 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 15:24:06.235627 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 15:24:06.235627 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:24:06.235627 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:24:06.235627 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:24:06.235627 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:24:06.235627 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:24:06.235627 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:24:06.238214 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 333/693] 10.222.0.118 () {56 vars in 1116 bytes} [Thu Jul 14 15:24:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:06.239811 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913581d9-ad81-4527-b96b-2b0b11fdd880 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:06.240315 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913581d9-ad81-4527-b96b-2b0b11fdd880 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:06.240790 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913581d9-ad81-4527-b96b-2b0b11fdd880 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:06.242513 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 334/694] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:24:06 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:24:06.247881 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913581d9-ad81-4527-b96b-2b0b11fdd880 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:06.282944 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f29a4c-981f-482c-ad4f-cc0b99e50106 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:06.321363 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fbabad-8ec2-4a5f-9eba-3b51c72b8e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:06.322066 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fbabad-8ec2-4a5f-9eba-3b51c72b8e46 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:06.322349 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fbabad-8ec2-4a5f-9eba-3b51c72b8e46 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:06.322629 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fbabad-8ec2-4a5f-9eba-3b51c72b8e46 None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:06.323352 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fbabad-8ec2-4a5f-9eba-3b51c72b8e46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:06.323660 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fbabad-8ec2-4a5f-9eba-3b51c72b8e46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:06.325172 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fbabad-8ec2-4a5f-9eba-3b51c72b8e46 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:06.327003 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:06.333441 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:06.348045 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 361/695] 10.222.0.118 () {56 vars in 1114 bytes} [Thu Jul 14 15:24:06 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:06.348045 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b50fd-0c55-4828-9021-094c3115deaf None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:06.348045 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b50fd-0c55-4828-9021-094c3115deaf None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:06.348045 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b50fd-0c55-4828-9021-094c3115deaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:06.366284 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-a65b50fd-0c55-4828-9021-094c3115deaf None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:06.367481 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-a65b50fd-0c55-4828-9021-094c3115deaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:06.396751 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913581d9-ad81-4527-b96b-2b0b11fdd880 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:06.443087 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 362/696] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:24:06 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:24:06.444118 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65b50fd-0c55-4828-9021-094c3115deaf None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:06.458956 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f84873-6890-43fa-a3ce-6b254776802d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:06.459633 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f84873-6890-43fa-a3ce-6b254776802d None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:06.459963 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f84873-6890-43fa-a3ce-6b254776802d None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:06.460241 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f84873-6890-43fa-a3ce-6b254776802d None admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:06.461041 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f84873-6890-43fa-a3ce-6b254776802d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:06.461349 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f84873-6890-43fa-a3ce-6b254776802d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:06.464672 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f84873-6890-43fa-a3ce-6b254776802d None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:06.481835 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 335/697] 10.222.0.118 () {56 vars in 1153 bytes} [Thu Jul 14 15:24:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:06.482780 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f84873-6890-43fa-a3ce-6b254776802d None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:06.575123 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65b50fd-0c55-4828-9021-094c3115deaf None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:06.609816 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f84873-6890-43fa-a3ce-6b254776802d None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:06.615135 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:06.630831 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd42673-2ff7-44d2-a75a-48542fef2f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:06.631630 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd42673-2ff7-44d2-a75a-48542fef2f54 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:06.631909 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd42673-2ff7-44d2-a75a-48542fef2f54 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:06.632182 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd42673-2ff7-44d2-a75a-48542fef2f54 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:06.635570 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:06.644723 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd42673-2ff7-44d2-a75a-48542fef2f54 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:06.646577 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd42673-2ff7-44d2-a75a-48542fef2f54 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:06.649089 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18ca388-8511-403d-a9ad-6fe29ff806a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:06.649926 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18ca388-8511-403d-a9ad-6fe29ff806a2 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:06.650257 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18ca388-8511-403d-a9ad-6fe29ff806a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:06.650528 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18ca388-8511-403d-a9ad-6fe29ff806a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:06.661713 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18ca388-8511-403d-a9ad-6fe29ff806a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:06.663256 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18ca388-8511-403d-a9ad-6fe29ff806a2 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:06.663366 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-5bd42673-2ff7-44d2-a75a-48542fef2f54 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 15:24:06.663366 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:06.663366 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:06.663366 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:06.663366 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:06.663366 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:06.663366 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:06.663366 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:06.663366 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:06.663366 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:06.663366 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:06.663366 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:06.663366 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 15:24:06.663366 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 15:24:06.663366 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 15:24:06.663366 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 15:24:06.664276 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:06.664276 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:06.664276 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 15:24:06.664276 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:24:06.664276 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 15:24:06.664276 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:24:06.664276 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:06.664276 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:06.664276 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:06.664276 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:06.664276 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:06.664276 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:06.664276 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:06.664276 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:06.664276 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:06.664276 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:06.664276 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:06.664276 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:06.665196 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:06.665196 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:06.665196 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 15:24:06.665196 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 15:24:06.665196 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 15:24:06.665196 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 15:24:06.665196 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 15:24:06.665196 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 15:24:06.665196 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 15:24:06.665196 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:24:06.665196 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 363/698] 10.222.0.118 () {56 vars in 1098 bytes} [Thu Jul 14 15:24:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:06.665768 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd42673-2ff7-44d2-a75a-48542fef2f54 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:06.690960 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-b18ca388-8511-403d-a9ad-6fe29ff806a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:06.690960 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:06.690960 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:06.690960 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:06.690960 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:06.690960 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:06.690960 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:06.690960 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:06.690960 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:06.690960 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:06.690960 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:06.690960 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:06.690960 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:24:06.690960 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:24:06.690960 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:24:06.693039 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:24:06.693039 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:06.693039 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:06.693039 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:06.693039 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:06.693039 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:06.693039 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:06.693039 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:06.693039 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:06.693039 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:06.693039 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:06.693039 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:06.693039 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:06.693039 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:06.693039 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:06.693039 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:06.693039 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:06.695209 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:24:06.695209 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:24:06.695209 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:06.695209 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:24:06.695209 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 336/699] 10.222.0.118 () {56 vars in 1113 bytes} [Thu Jul 14 15:24:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:06.695209 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18ca388-8511-403d-a9ad-6fe29ff806a2 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:06.786184 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd42673-2ff7-44d2-a75a-48542fef2f54 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:06.822245 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06614f33-78cc-4147-9d10-f7a99e589da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:06.823228 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06614f33-78cc-4147-9d10-f7a99e589da0 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:06.823822 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06614f33-78cc-4147-9d10-f7a99e589da0 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:06.824309 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06614f33-78cc-4147-9d10-f7a99e589da0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:06.825330 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06614f33-78cc-4147-9d10-f7a99e589da0 None admin] RBAC: Adding query filter params (role.id=3185f450429e4bb3b5f289b615f3269b, scope.project.id=939bf9541f4a4afe86550f749d337680, user.id=b672a6a601584d2d826147069e90a10f) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:06.825836 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06614f33-78cc-4147-9d10-f7a99e589da0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:06.827751 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06614f33-78cc-4147-9d10-f7a99e589da0 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:06.835901 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 364/700] 10.222.0.118 () {56 vars in 1379 bytes} [Thu Jul 14 15:24:06 2022] GET /identity/v3/role_assignments?user.id=b672a6a601584d2d826147069e90a10f&scope.project.id=939bf9541f4a4afe86550f749d337680&role.id=3185f450429e4bb3b5f289b615f3269b => generated 610 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:06.837120 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06614f33-78cc-4147-9d10-f7a99e589da0 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:06.837228 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18ca388-8511-403d-a9ad-6fe29ff806a2 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:06.892163 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47645fae-6098-4f1b-b98f-3be97906731b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:06.893897 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47645fae-6098-4f1b-b98f-3be97906731b None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:06.894647 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47645fae-6098-4f1b-b98f-3be97906731b None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:06.896187 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47645fae-6098-4f1b-b98f-3be97906731b None admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:06.898837 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47645fae-6098-4f1b-b98f-3be97906731b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:06.899769 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47645fae-6098-4f1b-b98f-3be97906731b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:06.902758 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47645fae-6098-4f1b-b98f-3be97906731b None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:06.908027 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:06.946161 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 337/701] 10.222.0.118 () {56 vars in 1138 bytes} [Thu Jul 14 15:24:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:06.951966 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47645fae-6098-4f1b-b98f-3be97906731b None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:06.980440 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06614f33-78cc-4147-9d10-f7a99e589da0 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:07.022466 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:07.056694 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57388ec7-409e-48d5-b699-1abc3e9e19b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:07.057705 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57388ec7-409e-48d5-b699-1abc3e9e19b7 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:07.058238 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57388ec7-409e-48d5-b699-1abc3e9e19b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:07.058721 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57388ec7-409e-48d5-b699-1abc3e9e19b7 None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:07.060336 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57388ec7-409e-48d5-b699-1abc3e9e19b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:07.062331 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57388ec7-409e-48d5-b699-1abc3e9e19b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:07.064032 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57388ec7-409e-48d5-b699-1abc3e9e19b7 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:07.086005 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 365/702] 10.222.0.118 () {56 vars in 1114 bytes} [Thu Jul 14 15:24:06 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:07.088230 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57388ec7-409e-48d5-b699-1abc3e9e19b7 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:07.128331 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47645fae-6098-4f1b-b98f-3be97906731b None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:07.172750 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa5c258-46a1-435d-b91e-4a5856a646e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:07.173855 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa5c258-46a1-435d-b91e-4a5856a646e4 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:07.174404 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa5c258-46a1-435d-b91e-4a5856a646e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:07.174871 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa5c258-46a1-435d-b91e-4a5856a646e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:07.216038 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57388ec7-409e-48d5-b699-1abc3e9e19b7 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:07.227779 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:07.256638 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa5c258-46a1-435d-b91e-4a5856a646e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:07.258621 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa5c258-46a1-435d-b91e-4a5856a646e4 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:07.262578 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef41eb0a-d8bb-4c11-a24c-b4b8e55004ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:07.263489 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef41eb0a-d8bb-4c11-a24c-b4b8e55004ab None admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:07.263959 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef41eb0a-d8bb-4c11-a24c-b4b8e55004ab None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:07.264487 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef41eb0a-d8bb-4c11-a24c-b4b8e55004ab None admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:07.265409 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef41eb0a-d8bb-4c11-a24c-b4b8e55004ab None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:07.267157 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef41eb0a-d8bb-4c11-a24c-b4b8e55004ab None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:07.294136 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 366/703] 10.222.0.118 () {60 vars in 1137 bytes} [Thu Jul 14 15:24:07 2022] POST /identity/v3/users => generated 255 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:24:07.294813 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:07.388204 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 338/704] 10.222.0.118 () {58 vars in 1287 bytes} [Thu Jul 14 15:24:06 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 15:24:07.391228 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef41eb0a-d8bb-4c11-a24c-b4b8e55004ab None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:07.510664 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef41eb0a-d8bb-4c11-a24c-b4b8e55004ab None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:07.550983 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ab8d29-b905-4bc0-a314-c4818ba05d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:07.552208 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ab8d29-b905-4bc0-a314-c4818ba05d5c None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:07.552699 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ab8d29-b905-4bc0-a314-c4818ba05d5c None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:07.553223 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ab8d29-b905-4bc0-a314-c4818ba05d5c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:07.568997 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ab8d29-b905-4bc0-a314-c4818ba05d5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:07.570878 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ab8d29-b905-4bc0-a314-c4818ba05d5c None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:07.588917 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-70ab8d29-b905-4bc0-a314-c4818ba05d5c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:07.588917 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:07.588917 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:07.588917 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:07.588917 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:07.588917 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:07.588917 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:07.588917 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:07.588917 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:07.588917 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:07.588917 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:07.588917 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:07.588917 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:24:07.588917 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:24:07.588917 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:24:07.589864 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:24:07.589864 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:07.589864 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:07.589864 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:07.589864 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:07.589864 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:07.589864 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:07.589864 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:07.589864 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:07.589864 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:07.589864 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:07.589864 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:07.589864 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:07.589864 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:07.589864 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:07.589864 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:07.589864 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:07.590773 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:24:07.590773 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:24:07.590773 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:07.590773 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:24:07.594372 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da92cee-745d-4053-9549-8eb49ee6ba60 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:07.598533 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 367/705] 10.222.0.118 () {56 vars in 1113 bytes} [Thu Jul 14 15:24:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:24:07.600825 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da92cee-745d-4053-9549-8eb49ee6ba60 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:07.600825 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da92cee-745d-4053-9549-8eb49ee6ba60 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:07.602662 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 339/706] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:24:07 2022] GET /identity => generated 271 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 14 15:24:07.602852 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ab8d29-b905-4bc0-a314-c4818ba05d5c None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:07.606681 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7876347-c6ca-4430-b219-7e5cf130bdc0 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:07.607158 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7876347-c6ca-4430-b219-7e5cf130bdc0 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:07.607606 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7876347-c6ca-4430-b219-7e5cf130bdc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:07.623646 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:07.627279 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-f7876347-c6ca-4430-b219-7e5cf130bdc0 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:07.628486 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-f7876347-c6ca-4430-b219-7e5cf130bdc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:07.726883 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 340/707] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:24:07 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 15:24:07.736190 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ab8d29-b905-4bc0-a314-c4818ba05d5c None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:07.752811 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7876347-c6ca-4430-b219-7e5cf130bdc0 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:07.773506 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d6685c-179a-4af1-9475-7724a62783fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:07.774538 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d6685c-179a-4af1-9475-7724a62783fb None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:07.775021 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d6685c-179a-4af1-9475-7724a62783fb None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:07.775520 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d6685c-179a-4af1-9475-7724a62783fb None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:07.776466 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d6685c-179a-4af1-9475-7724a62783fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:07.776978 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d6685c-179a-4af1-9475-7724a62783fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:07.778592 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d6685c-179a-4af1-9475-7724a62783fb None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:07.794206 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 368/708] 10.222.0.118 () {56 vars in 1114 bytes} [Thu Jul 14 15:24:07 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:07.800314 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d6685c-179a-4af1-9475-7724a62783fb None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:07.849834 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:07.926987 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7876347-c6ca-4430-b219-7e5cf130bdc0 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:07.978856 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eae2076-d801-4254-aac3-23c6873e72bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:07.979675 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eae2076-d801-4254-aac3-23c6873e72bb None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:07.979958 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eae2076-d801-4254-aac3-23c6873e72bb None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:07.980234 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eae2076-d801-4254-aac3-23c6873e72bb None admin] PATH_INFO: `/v3/services/network` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:07.980512 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:07.980897 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eae2076-d801-4254-aac3-23c6873e72bb None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:07.982309 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eae2076-d801-4254-aac3-23c6873e72bb None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:07.996374 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-4eae2076-d801-4254-aac3-23c6873e72bb None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 15:24:07.996374 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:07.996374 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 15:24:07.996374 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 15:24:07.996374 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 15:24:07.996374 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 15:24:07.996374 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 15:24:07.996374 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:24:07.996374 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 15:24:07.996374 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:24:07.996374 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 15:24:07.996374 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:24:07.996374 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:07.996374 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:07.996374 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:07.996374 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:07.996374 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:07.997611 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:07.997611 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:07.997611 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:07.997611 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:07.997611 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:07.997611 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:07.997611 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 15:24:07.997611 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 15:24:07.997611 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 15:24:07.997611 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 15:24:07.997611 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:07.997611 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:07.997611 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:07.997611 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:07.997611 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:07.997611 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:07.998531 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:07.998531 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:07.998531 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:07.998531 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:07.998531 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:07.998531 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:07.998531 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:07.998531 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:07.998531 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:07.998531 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:07.998531 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 15:24:07.998531 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:24:07.998531 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 15:24:07.998531 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:24:07.998531 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 341/709] 10.222.0.118 () {56 vars in 1116 bytes} [Thu Jul 14 15:24:07 2022] GET /identity/v3/services/network => generated 88 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:24:07.999332 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf49e23-64da-40a7-b00a-65c2929d8223 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:07.999406 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf49e23-64da-40a7-b00a-65c2929d8223 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:07.999638 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf49e23-64da-40a7-b00a-65c2929d8223 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:08.001144 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 342/710] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:24:07 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:24:08.006536 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf49e23-64da-40a7-b00a-65c2929d8223 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:08.014267 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d6685c-179a-4af1-9475-7724a62783fb None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:08.052549 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c315308-ed08-49c0-a868-567f8110be6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:08.053399 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c315308-ed08-49c0-a868-567f8110be6d None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:08.053775 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c315308-ed08-49c0-a868-567f8110be6d None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:08.054170 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c315308-ed08-49c0-a868-567f8110be6d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:08.061681 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c315308-ed08-49c0-a868-567f8110be6d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:08.063376 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c315308-ed08-49c0-a868-567f8110be6d None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:08.078641 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-4c315308-ed08-49c0-a868-567f8110be6d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:24:08.078641 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:08.078641 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:08.078641 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:08.078641 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:08.078641 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:08.078641 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:08.078641 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:08.078641 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:08.078641 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:08.078641 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:08.078641 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:08.078641 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 15:24:08.078641 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 15:24:08.078641 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 15:24:08.079606 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 15:24:08.079606 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:08.079606 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:08.079606 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:08.079606 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:08.079606 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:08.079606 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:08.079606 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:08.079606 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:08.079606 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:08.079606 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:08.079606 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:08.079606 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:08.079606 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:08.079606 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:08.079606 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:08.079606 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:08.081076 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 15:24:08.081076 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 15:24:08.081076 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:24:08.081076 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:24:08.081076 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:24:08.081076 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:24:08.081076 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:24:08.081076 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:24:08.082172 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 369/711] 10.222.0.118 () {56 vars in 1116 bytes} [Thu Jul 14 15:24:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:08.083900 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c0350-b2d3-4789-b2a9-bd3714a867fd None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:08.085009 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c0350-b2d3-4789-b2a9-bd3714a867fd None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:08.085501 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c0350-b2d3-4789-b2a9-bd3714a867fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:08.105291 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-854c0350-b2d3-4789-b2a9-bd3714a867fd None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:08.106350 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-854c0350-b2d3-4789-b2a9-bd3714a867fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:08.133759 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf49e23-64da-40a7-b00a-65c2929d8223 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:08.161948 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:08.172472 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa0e03e-0412-4491-9e1c-e026eb8f9acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:08.173468 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa0e03e-0412-4491-9e1c-e026eb8f9acc None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:08.174013 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa0e03e-0412-4491-9e1c-e026eb8f9acc None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:08.174493 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa0e03e-0412-4491-9e1c-e026eb8f9acc None admin] PATH_INFO: `/v3/services` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:08.175416 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa0e03e-0412-4491-9e1c-e026eb8f9acc None admin] RBAC: Adding query filter params (name=network) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:08.175941 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa0e03e-0412-4491-9e1c-e026eb8f9acc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:08.177600 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa0e03e-0412-4491-9e1c-e026eb8f9acc None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:08.186311 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 343/713] 10.222.0.118 () {56 vars in 1117 bytes} [Thu Jul 14 15:24:08 2022] GET /identity/v3/services?name=network => generated 125 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:24:08.186467 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 370/713] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:24:08 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:24:08.187730 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854c0350-b2d3-4789-b2a9-bd3714a867fd None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:08.189208 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa0e03e-0412-4491-9e1c-e026eb8f9acc None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:08.271728 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:08.297753 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa0e03e-0412-4491-9e1c-e026eb8f9acc None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:08.320720 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854c0350-b2d3-4789-b2a9-bd3714a867fd None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:08.335715 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa27a74-b394-426a-935b-58bc74e2867b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:08.336775 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa27a74-b394-426a-935b-58bc74e2867b None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:08.337251 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa27a74-b394-426a-935b-58bc74e2867b None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:08.337719 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa27a74-b394-426a-935b-58bc74e2867b None admin] PATH_INFO: `/v3/services` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:08.338648 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa27a74-b394-426a-935b-58bc74e2867b None admin] RBAC: Adding query filter params (type=network) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:08.339196 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa27a74-b394-426a-935b-58bc74e2867b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:08.340788 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa27a74-b394-426a-935b-58bc74e2867b None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:08.354106 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 344/714] 10.222.0.118 () {56 vars in 1117 bytes} [Thu Jul 14 15:24:08 2022] GET /identity/v3/services?type=network => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:24:08.355471 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa27a74-b394-426a-935b-58bc74e2867b None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:08.365425 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a279b7d-07df-4f81-891e-4a84143cdef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:08.373993 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a279b7d-07df-4f81-891e-4a84143cdef2 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:08.373993 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a279b7d-07df-4f81-891e-4a84143cdef2 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:08.373993 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a279b7d-07df-4f81-891e-4a84143cdef2 None admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:08.373993 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a279b7d-07df-4f81-891e-4a84143cdef2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:08.373993 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a279b7d-07df-4f81-891e-4a84143cdef2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:08.373993 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a279b7d-07df-4f81-891e-4a84143cdef2 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:08.382953 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 371/715] 10.222.0.118 () {56 vars in 1153 bytes} [Thu Jul 14 15:24:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:08.393993 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a279b7d-07df-4f81-891e-4a84143cdef2 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:08.451539 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:08.498795 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a279b7d-07df-4f81-891e-4a84143cdef2 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:08.526439 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:08.538202 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa27a74-b394-426a-935b-58bc74e2867b None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:08.546837 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa5593c-793d-48c1-b7c3-d5dba8a0dec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:08.547767 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa5593c-793d-48c1-b7c3-d5dba8a0dec3 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:08.548198 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa5593c-793d-48c1-b7c3-d5dba8a0dec3 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:08.548618 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa5593c-793d-48c1-b7c3-d5dba8a0dec3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:08.550238 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa5593c-793d-48c1-b7c3-d5dba8a0dec3 None admin] RBAC: Adding query filter params (role.id=3b880cef7dcf4baf87b50f8610c0c56e, scope.project.id=939bf9541f4a4afe86550f749d337680, user.id=f0177fc696ea40069902803da09f437c) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:08.550738 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa5593c-793d-48c1-b7c3-d5dba8a0dec3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:08.552355 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa5593c-793d-48c1-b7c3-d5dba8a0dec3 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:08.565362 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 372/716] 10.222.0.118 () {56 vars in 1379 bytes} [Thu Jul 14 15:24:08 2022] GET /identity/v3/role_assignments?user.id=f0177fc696ea40069902803da09f437c&scope.project.id=939bf9541f4a4afe86550f749d337680&role.id=3b880cef7dcf4baf87b50f8610c0c56e => generated 260 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:24:08.592102 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04ea930-b4dd-4c01-b280-151ad86082b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:08.593245 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04ea930-b4dd-4c01-b280-151ad86082b3 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:08.593691 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04ea930-b4dd-4c01-b280-151ad86082b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:08.594142 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04ea930-b4dd-4c01-b280-151ad86082b3 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:08.594964 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04ea930-b4dd-4c01-b280-151ad86082b3 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:08.597081 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04ea930-b4dd-4c01-b280-151ad86082b3 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:08.610795 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-d04ea930-b4dd-4c01-b280-151ad86082b3 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 15:24:08.610795 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:08.610795 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 15:24:08.610795 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 15:24:08.610795 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 15:24:08.610795 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 15:24:08.610795 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 15:24:08.610795 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:24:08.610795 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 15:24:08.610795 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:24:08.610795 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 15:24:08.610795 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:24:08.610795 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:08.610795 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:08.610795 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:08.610795 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:08.613136 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:08.613136 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:08.613136 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:08.613136 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:08.613136 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:08.613136 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:08.613136 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:08.613136 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 15:24:08.613136 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 15:24:08.613136 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 15:24:08.613136 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 15:24:08.613136 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:08.613136 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:08.613136 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:08.613136 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:08.613136 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:08.614286 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:08.614286 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:08.614286 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:08.614286 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:08.614286 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:08.614286 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:08.614286 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:08.614286 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:08.614286 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:08.614286 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:08.614286 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:08.614286 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 15:24:08.614286 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:24:08.614286 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 15:24:08.614286 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:24:08.621729 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 345/717] 10.222.0.118 () {56 vars in 1134 bytes} [Thu Jul 14 15:24:08 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:08.627933 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa5593c-793d-48c1-b7c3-d5dba8a0dec3 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:08.751751 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa5593c-793d-48c1-b7c3-d5dba8a0dec3 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:08.804117 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc3aa03-8e7e-4018-bc08-e866adb679d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:08.805116 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc3aa03-8e7e-4018-bc08-e866adb679d1 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:08.805606 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc3aa03-8e7e-4018-bc08-e866adb679d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:08.806082 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc3aa03-8e7e-4018-bc08-e866adb679d1 None admin] PATH_INFO: `/v3/services` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:08.806988 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc3aa03-8e7e-4018-bc08-e866adb679d1 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:08.807469 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc3aa03-8e7e-4018-bc08-e866adb679d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:08.809045 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc3aa03-8e7e-4018-bc08-e866adb679d1 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:08.816701 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 373/718] 10.222.0.118 () {56 vars in 1129 bytes} [Thu Jul 14 15:24:08 2022] GET /identity/v3/services?name=block-storage => generated 131 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:08.822601 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04ea930-b4dd-4c01-b280-151ad86082b3 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:08.927348 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04ea930-b4dd-4c01-b280-151ad86082b3 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:08.952199 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:08.970604 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793102a5-1f59-413b-a558-712021ace62a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:08.971850 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793102a5-1f59-413b-a558-712021ace62a None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:08.972131 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793102a5-1f59-413b-a558-712021ace62a None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:08.972403 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793102a5-1f59-413b-a558-712021ace62a None admin] PATH_INFO: `/v3/services` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:08.973114 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793102a5-1f59-413b-a558-712021ace62a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:08.973418 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793102a5-1f59-413b-a558-712021ace62a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:08.974821 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793102a5-1f59-413b-a558-712021ace62a None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:08.979818 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 346/719] 10.222.0.118 () {56 vars in 1129 bytes} [Thu Jul 14 15:24:08 2022] GET /identity/v3/services?type=block-storage => generated 131 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:09.667608 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebefd79-d365-4959-b084-08d8f640a2f3 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:09.668470 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebefd79-d365-4959-b084-08d8f640a2f3 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:09.668913 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebefd79-d365-4959-b084-08d8f640a2f3 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:09.670720 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 374/720] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:24:09 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:24:09.676350 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef53fd32-6077-4af5-9bf5-9155de52e365 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:09.677101 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef53fd32-6077-4af5-9bf5-9155de52e365 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:09.677522 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef53fd32-6077-4af5-9bf5-9155de52e365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:09.713669 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-ef53fd32-6077-4af5-9bf5-9155de52e365 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:09.715556 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-ef53fd32-6077-4af5-9bf5-9155de52e365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:09.789804 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 347/721] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:24:09 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:24:09.825811 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebefd79-d365-4959-b084-08d8f640a2f3 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:09.900622 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:09.905235 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52190f6-9392-4d78-86e1-2db5d5d4f191 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:09.905524 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52190f6-9392-4d78-86e1-2db5d5d4f191 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:09.905800 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52190f6-9392-4d78-86e1-2db5d5d4f191 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:09.907483 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 348/722] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:24:09 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:24:09.913166 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97b13db-fcb6-401c-b793-801f0342a3f2 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:09.913449 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97b13db-fcb6-401c-b793-801f0342a3f2 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:09.913731 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97b13db-fcb6-401c-b793-801f0342a3f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:09.931009 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-f97b13db-fcb6-401c-b793-801f0342a3f2 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:09.932127 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-f97b13db-fcb6-401c-b793-801f0342a3f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:09.972816 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebefd79-d365-4959-b084-08d8f640a2f3 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:10.048787 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7135ac-dd1a-4e80-b8d5-cb8821557679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:10.050906 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7135ac-dd1a-4e80-b8d5-cb8821557679 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:10.051187 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7135ac-dd1a-4e80-b8d5-cb8821557679 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:10.051459 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7135ac-dd1a-4e80-b8d5-cb8821557679 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:10.059767 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 349/723] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:24:09 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:24:10.065639 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7135ac-dd1a-4e80-b8d5-cb8821557679 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:24:10.073615 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-ee7135ac-dd1a-4e80-b8d5-cb8821557679 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:24:10.073615 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:10.073615 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:10.073615 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:10.073615 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:10.073615 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:10.073615 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:10.073615 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:10.073615 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:10.073615 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:10.073615 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:10.073615 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:10.073615 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:24:10.073615 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:24:10.073615 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:24:10.073615 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:24:10.074544 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:24:10.074544 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:24:10.074544 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:24:10.074544 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:24:10.074544 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:10.074544 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:10.074544 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:10.074544 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:10.074544 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:10.074544 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:10.074544 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:10.074544 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:10.074544 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:10.074544 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:10.074544 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:10.074544 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:10.075364 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:10.075364 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:10.075364 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:10.075364 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:10.075364 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:24:10.075364 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:24:10.075364 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:24:10.075364 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:24:10.075364 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:24:10.075364 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:24:10.075364 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:24:10.075364 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:24:10.078099 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 375/724] 10.222.0.118 () {56 vars in 1101 bytes} [Thu Jul 14 15:24:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:10.083841 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97b13db-fcb6-401c-b793-801f0342a3f2 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:10.102652 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7135ac-dd1a-4e80-b8d5-cb8821557679 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:10.166345 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:10.242261 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97b13db-fcb6-401c-b793-801f0342a3f2 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:10.308724 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7135ac-dd1a-4e80-b8d5-cb8821557679 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:10.318643 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4918857a-ccf7-4499-9018-8990582d69c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:10.319585 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4918857a-ccf7-4499-9018-8990582d69c3 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:10.320071 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4918857a-ccf7-4499-9018-8990582d69c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:10.320568 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4918857a-ccf7-4499-9018-8990582d69c3 None admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:10.321541 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4918857a-ccf7-4499-9018-8990582d69c3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:10.322079 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4918857a-ccf7-4499-9018-8990582d69c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:10.323693 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4918857a-ccf7-4499-9018-8990582d69c3 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:10.326330 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:10.344285 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 350/725] 10.222.0.118 () {56 vars in 1104 bytes} [Thu Jul 14 15:24:10 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:10.344729 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b695533f-f11f-4d82-b29f-1540e531a2d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:10.345602 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b695533f-f11f-4d82-b29f-1540e531a2d0 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:10.346584 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b695533f-f11f-4d82-b29f-1540e531a2d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:10.346934 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b695533f-f11f-4d82-b29f-1540e531a2d0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:10.354945 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4918857a-ccf7-4499-9018-8990582d69c3 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:10.359001 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b695533f-f11f-4d82-b29f-1540e531a2d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:24:10.367970 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-b695533f-f11f-4d82-b29f-1540e531a2d0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:24:10.367970 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:10.367970 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:10.367970 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:10.367970 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:10.367970 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:10.367970 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:10.367970 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:10.367970 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:10.367970 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:10.367970 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:10.367970 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:10.367970 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:24:10.367970 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:24:10.367970 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:24:10.367970 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:24:10.368973 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:24:10.368973 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:24:10.368973 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:24:10.368973 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:24:10.368973 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:10.368973 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:10.368973 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:10.368973 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:10.368973 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:10.368973 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:10.368973 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:10.368973 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:10.368973 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:10.368973 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:10.368973 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:10.368973 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:10.369827 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:10.369827 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:10.369827 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:10.369827 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:10.369827 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:24:10.369827 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:24:10.369827 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:24:10.369827 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:24:10.369827 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:24:10.369827 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:24:10.369827 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:24:10.369827 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:24:10.369827 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 376/726] 10.222.0.118 () {56 vars in 1107 bytes} [Thu Jul 14 15:24:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:10.378899 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b695533f-f11f-4d82-b29f-1540e531a2d0 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:10.503771 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b695533f-f11f-4d82-b29f-1540e531a2d0 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:10.550417 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4918857a-ccf7-4499-9018-8990582d69c3 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:10.566962 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c8b013-a753-4eba-bc4b-d073f58139ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:10.567773 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c8b013-a753-4eba-bc4b-d073f58139ee None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:10.568147 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c8b013-a753-4eba-bc4b-d073f58139ee None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:10.568513 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c8b013-a753-4eba-bc4b-d073f58139ee None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:10.568911 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:10.569699 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c8b013-a753-4eba-bc4b-d073f58139ee None admin] RBAC: Adding query filter params (name=service) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:10.569835 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c8b013-a753-4eba-bc4b-d073f58139ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:10.571461 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c8b013-a753-4eba-bc4b-d073f58139ee None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:10.583974 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 377/727] 10.222.0.118 () {56 vars in 1108 bytes} [Thu Jul 14 15:24:10 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:10.591010 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c8b013-a753-4eba-bc4b-d073f58139ee None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:10.632324 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd30e438-4c08-4218-be28-48901c3e667f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:10.633229 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd30e438-4c08-4218-be28-48901c3e667f None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:10.633609 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd30e438-4c08-4218-be28-48901c3e667f None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:10.634349 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:10.642189 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd30e438-4c08-4218-be28-48901c3e667f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:10.675789 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd30e438-4c08-4218-be28-48901c3e667f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:10.677452 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd30e438-4c08-4218-be28-48901c3e667f None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:10.704638 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c8b013-a753-4eba-bc4b-d073f58139ee None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:10.738516 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-dd30e438-4c08-4218-be28-48901c3e667f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:10.738516 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:10.738516 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:10.738516 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:10.738516 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:10.738516 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:10.738516 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:10.738516 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:10.738516 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:10.738516 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:10.738516 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:10.738516 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:10.738516 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:24:10.738516 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:24:10.738516 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:24:10.739662 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:24:10.739662 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:10.739662 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:10.739662 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:10.739662 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:10.739662 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:10.739662 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:10.739662 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:10.739662 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:10.739662 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:10.739662 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:10.739662 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:10.739662 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:10.739662 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:10.739662 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:10.739662 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:10.739662 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:10.740647 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:24:10.740647 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:24:10.740647 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:10.740647 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:24:10.740647 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 351/728] 10.222.0.118 () {56 vars in 1113 bytes} [Thu Jul 14 15:24:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 385 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:10.745799 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd30e438-4c08-4218-be28-48901c3e667f None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:10.757303 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a40918-9a15-4ff0-b84e-547ecf578aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:10.758392 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a40918-9a15-4ff0-b84e-547ecf578aa3 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:10.758811 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a40918-9a15-4ff0-b84e-547ecf578aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:10.759221 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a40918-9a15-4ff0-b84e-547ecf578aa3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:10.770891 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a40918-9a15-4ff0-b84e-547ecf578aa3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:10.772931 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a40918-9a15-4ff0-b84e-547ecf578aa3 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:10.791498 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-21a40918-9a15-4ff0-b84e-547ecf578aa3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:10.791498 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:10.791498 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:10.791498 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:10.791498 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:10.791498 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:10.791498 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:10.791498 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:10.791498 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:10.791498 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:10.791498 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:10.791498 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:10.791498 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:24:10.791498 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:24:10.791498 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:24:10.792579 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:24:10.792579 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:10.792579 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:10.792579 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:10.792579 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:10.792579 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:10.792579 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:10.792579 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:10.792579 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:10.792579 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:10.792579 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:10.792579 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:10.792579 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:10.792579 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:10.792579 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:10.792579 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:10.792579 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:10.793636 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:24:10.793636 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:24:10.793636 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:10.793636 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:24:10.795919 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 378/729] 10.222.0.118 () {56 vars in 1113 bytes} [Thu Jul 14 15:24:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:10.802442 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a40918-9a15-4ff0-b84e-547ecf578aa3 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:10.898390 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:10.909472 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a40918-9a15-4ff0-b84e-547ecf578aa3 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:10.965326 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e02612-e664-4282-ae72-6a2c56efbf90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:10.966305 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e02612-e664-4282-ae72-6a2c56efbf90 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:10.970048 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e02612-e664-4282-ae72-6a2c56efbf90 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:10.970481 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e02612-e664-4282-ae72-6a2c56efbf90 None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:10.971969 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e02612-e664-4282-ae72-6a2c56efbf90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:10.973806 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e02612-e664-4282-ae72-6a2c56efbf90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:10.975368 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e02612-e664-4282-ae72-6a2c56efbf90 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:11.008556 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 379/730] 10.222.0.118 () {56 vars in 1114 bytes} [Thu Jul 14 15:24:10 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:24:11.010363 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6731fa7-bf8b-43f2-91f6-5c887be5ffbb None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:11.010790 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6731fa7-bf8b-43f2-91f6-5c887be5ffbb None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:11.011203 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6731fa7-bf8b-43f2-91f6-5c887be5ffbb None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:11.014204 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 380/731] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:24:11 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:24:11.021453 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6731fa7-bf8b-43f2-91f6-5c887be5ffbb None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:11.033009 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd30e438-4c08-4218-be28-48901c3e667f None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:11.069241 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19578a75-276d-4cda-8a63-7fc9b75df324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:11.070163 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19578a75-276d-4cda-8a63-7fc9b75df324 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:11.070445 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19578a75-276d-4cda-8a63-7fc9b75df324 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:11.070715 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19578a75-276d-4cda-8a63-7fc9b75df324 None admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:11.071435 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19578a75-276d-4cda-8a63-7fc9b75df324 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:11.071742 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19578a75-276d-4cda-8a63-7fc9b75df324 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:11.073117 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19578a75-276d-4cda-8a63-7fc9b75df324 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:11.091047 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 352/732] 10.222.0.118 () {56 vars in 1114 bytes} [Thu Jul 14 15:24:10 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:11.091047 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf17c1f-bd70-44db-a860-e4a73bec30cc None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:11.091047 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf17c1f-bd70-44db-a860-e4a73bec30cc None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:11.091047 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf17c1f-bd70-44db-a860-e4a73bec30cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:11.105366 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-baf17c1f-bd70-44db-a860-e4a73bec30cc None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:11.106584 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-baf17c1f-bd70-44db-a860-e4a73bec30cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:11.118140 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:11.132778 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6731fa7-bf8b-43f2-91f6-5c887be5ffbb None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:11.171198 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7482b28c-3a43-4f3d-b2d7-ac3a88b0d4f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:11.172004 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7482b28c-3a43-4f3d-b2d7-ac3a88b0d4f6 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:11.172278 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7482b28c-3a43-4f3d-b2d7-ac3a88b0d4f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:11.172548 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7482b28c-3a43-4f3d-b2d7-ac3a88b0d4f6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:11.179741 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7482b28c-3a43-4f3d-b2d7-ac3a88b0d4f6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:11.181172 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7482b28c-3a43-4f3d-b2d7-ac3a88b0d4f6 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:11.182096 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 353/733] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:24:11 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:24:11.184362 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5579728b-b202-4d60-abd2-619b660a3d66 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:11.184883 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5579728b-b202-4d60-abd2-619b660a3d66 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:11.185402 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5579728b-b202-4d60-abd2-619b660a3d66 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:11.191524 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 354/734] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:24:11 2022] GET /identity => generated 271 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:24:11.192636 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5579728b-b202-4d60-abd2-619b660a3d66 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:11.200209 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-7482b28c-3a43-4f3d-b2d7-ac3a88b0d4f6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 15:24:11.200209 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:11.200209 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:11.200209 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:11.200209 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:11.200209 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:11.200209 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:11.200209 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:11.200209 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:11.200209 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:11.200209 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:11.200209 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:11.200209 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 15:24:11.200209 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 15:24:11.200209 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 15:24:11.200209 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 15:24:11.201353 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:11.201353 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:11.201353 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 15:24:11.201353 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:24:11.201353 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 15:24:11.201353 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:24:11.201353 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:11.201353 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:11.201353 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:11.201353 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:11.201353 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:11.201353 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:11.201353 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:11.201353 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:11.201353 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:11.201353 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:11.201353 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:11.201353 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:11.202497 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:11.202497 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:11.202497 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 15:24:11.202497 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 15:24:11.202497 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 15:24:11.202497 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 15:24:11.202497 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 15:24:11.202497 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 15:24:11.202497 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 15:24:11.202497 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:24:11.203073 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 381/735] 10.222.0.118 () {56 vars in 1122 bytes} [Thu Jul 14 15:24:11 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:11.204050 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a20f746-49f8-463c-98ce-7bf2cc2f5fc6 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:11.204331 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a20f746-49f8-463c-98ce-7bf2cc2f5fc6 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:11.204691 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a20f746-49f8-463c-98ce-7bf2cc2f5fc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:11.223198 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-2a20f746-49f8-463c-98ce-7bf2cc2f5fc6 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:11.224388 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-2a20f746-49f8-463c-98ce-7bf2cc2f5fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:11.226480 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:11.294773 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 382/736] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:24:11 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:24:11.295867 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a20f746-49f8-463c-98ce-7bf2cc2f5fc6 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:11.327210 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5579728b-b202-4d60-abd2-619b660a3d66 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:11.370147 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5248206c-06a1-4ddc-bf1c-9f4a27b00671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:11.371496 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5248206c-06a1-4ddc-bf1c-9f4a27b00671 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:11.372000 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5248206c-06a1-4ddc-bf1c-9f4a27b00671 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:11.372504 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5248206c-06a1-4ddc-bf1c-9f4a27b00671 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:11.385686 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5248206c-06a1-4ddc-bf1c-9f4a27b00671 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:11.388420 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5248206c-06a1-4ddc-bf1c-9f4a27b00671 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:11.405447 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-5248206c-06a1-4ddc-bf1c-9f4a27b00671 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 14 15:24:11.405447 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:11.405447 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:11.405447 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:11.405447 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:11.405447 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:11.405447 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:11.405447 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:11.405447 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:11.405447 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:11.405447 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:11.405447 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:11.405447 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 15:24:11.405447 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 15:24:11.405447 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 15:24:11.405447 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 15:24:11.406681 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:11.406681 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:11.406681 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 15:24:11.406681 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:24:11.406681 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 15:24:11.406681 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:24:11.406681 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:11.406681 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:11.406681 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:11.406681 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:11.406681 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:11.406681 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:11.406681 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:11.406681 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:11.406681 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:11.406681 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:11.406681 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:11.406681 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:11.407630 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:11.407630 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:11.407630 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 15:24:11.407630 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 15:24:11.407630 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 15:24:11.407630 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 15:24:11.407630 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 15:24:11.407630 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 15:24:11.407630 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 14 15:24:11.407630 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:24:11.407630 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 355/737] 10.222.0.118 () {56 vars in 1101 bytes} [Thu Jul 14 15:24:11 2022] GET /identity/v3/users/swift => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:11.408770 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5248206c-06a1-4ddc-bf1c-9f4a27b00671 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:11.418617 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:11.422260 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a20f746-49f8-463c-98ce-7bf2cc2f5fc6 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:11.459773 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48100821-c876-4f61-9c06-8f3e6a99e1c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:11.460433 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48100821-c876-4f61-9c06-8f3e6a99e1c2 None admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:11.460709 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48100821-c876-4f61-9c06-8f3e6a99e1c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:11.460978 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48100821-c876-4f61-9c06-8f3e6a99e1c2 None admin] PATH_INFO: `/v3/services` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:11.461698 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48100821-c876-4f61-9c06-8f3e6a99e1c2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:11.463080 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48100821-c876-4f61-9c06-8f3e6a99e1c2 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:11.474222 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:11.483371 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 383/738] 10.222.0.118 () {60 vars in 1146 bytes} [Thu Jul 14 15:24:11 2022] POST /identity/v3/services => generated 241 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:24:11.484719 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48100821-c876-4f61-9c06-8f3e6a99e1c2 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:11.525058 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5248206c-06a1-4ddc-bf1c-9f4a27b00671 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:11.574682 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389b8a4d-6ce7-4564-86fb-a4b61b3ed9f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:11.575625 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389b8a4d-6ce7-4564-86fb-a4b61b3ed9f5 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:11.576002 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389b8a4d-6ce7-4564-86fb-a4b61b3ed9f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:11.576939 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389b8a4d-6ce7-4564-86fb-a4b61b3ed9f5 None admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:11.577640 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389b8a4d-6ce7-4564-86fb-a4b61b3ed9f5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:11.578100 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389b8a4d-6ce7-4564-86fb-a4b61b3ed9f5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:11.579733 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389b8a4d-6ce7-4564-86fb-a4b61b3ed9f5 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:11.602864 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 356/739] 10.222.0.118 () {56 vars in 1154 bytes} [Thu Jul 14 15:24:11 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 386 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:11.604048 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389b8a4d-6ce7-4564-86fb-a4b61b3ed9f5 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:11.621420 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48100821-c876-4f61-9c06-8f3e6a99e1c2 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:11.668312 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942d9cb4-198f-464f-a84c-c4cbbb9c9486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:11.669366 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942d9cb4-198f-464f-a84c-c4cbbb9c9486 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:11.669641 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942d9cb4-198f-464f-a84c-c4cbbb9c9486 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:11.669911 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942d9cb4-198f-464f-a84c-c4cbbb9c9486 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:11.683138 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942d9cb4-198f-464f-a84c-c4cbbb9c9486 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:24:11.684310 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:11.691484 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-942d9cb4-198f-464f-a84c-c4cbbb9c9486 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:24:11.691484 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:11.691484 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:11.691484 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:11.691484 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:11.691484 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:11.691484 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:11.691484 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:11.691484 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:11.691484 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:11.691484 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:11.691484 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:11.691484 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:24:11.691484 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:24:11.691484 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:24:11.691484 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:24:11.692622 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:24:11.692622 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:24:11.692622 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:24:11.692622 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:24:11.692622 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:11.692622 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:11.692622 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:11.692622 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:11.692622 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:11.692622 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:11.692622 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:11.692622 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:11.692622 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:11.692622 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:11.692622 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:11.692622 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:11.693685 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:11.693685 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:11.693685 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:11.693685 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:11.693685 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:24:11.693685 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:24:11.693685 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:24:11.693685 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:24:11.693685 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:24:11.693685 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:24:11.693685 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:24:11.693685 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:24:11.693685 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 384/740] 10.222.0.118 () {56 vars in 1101 bytes} [Thu Jul 14 15:24:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:11.694525 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942d9cb4-198f-464f-a84c-c4cbbb9c9486 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:11.736467 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389b8a4d-6ce7-4564-86fb-a4b61b3ed9f5 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:11.757152 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:11.773097 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70802306-5570-4317-be91-ca2859e8ee82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:11.773781 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70802306-5570-4317-be91-ca2859e8ee82 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:11.774087 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70802306-5570-4317-be91-ca2859e8ee82 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:11.774360 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70802306-5570-4317-be91-ca2859e8ee82 None admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:11.775201 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70802306-5570-4317-be91-ca2859e8ee82 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:11.775511 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70802306-5570-4317-be91-ca2859e8ee82 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:11.776945 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70802306-5570-4317-be91-ca2859e8ee82 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:11.795524 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 357/741] 10.222.0.118 () {56 vars in 1140 bytes} [Thu Jul 14 15:24:11 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 372 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:11.797264 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf976f9f-8332-44bd-a93a-3036fb3de6f8 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:11.797820 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf976f9f-8332-44bd-a93a-3036fb3de6f8 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:11.797931 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf976f9f-8332-44bd-a93a-3036fb3de6f8 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:11.799431 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 358/742] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:24:11 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:24:11.804084 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf976f9f-8332-44bd-a93a-3036fb3de6f8 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:11.809405 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942d9cb4-198f-464f-a84c-c4cbbb9c9486 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:11.844995 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be483778-6cec-4aa9-8251-f85ef7a82469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:11.845555 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be483778-6cec-4aa9-8251-f85ef7a82469 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:11.846416 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be483778-6cec-4aa9-8251-f85ef7a82469 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:11.846687 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be483778-6cec-4aa9-8251-f85ef7a82469 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:11.915477 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf976f9f-8332-44bd-a93a-3036fb3de6f8 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:11.918391 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be483778-6cec-4aa9-8251-f85ef7a82469 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:11.919667 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be483778-6cec-4aa9-8251-f85ef7a82469 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:11.934712 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:11.953577 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e45d6e-79b7-496c-bca2-dfcc6ffc8cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:11.954458 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e45d6e-79b7-496c-bca2-dfcc6ffc8cf9 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:11.954738 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e45d6e-79b7-496c-bca2-dfcc6ffc8cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:11.955583 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e45d6e-79b7-496c-bca2-dfcc6ffc8cf9 None admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:11.956502 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e45d6e-79b7-496c-bca2-dfcc6ffc8cf9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:11.957642 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e45d6e-79b7-496c-bca2-dfcc6ffc8cf9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:11.959124 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e45d6e-79b7-496c-bca2-dfcc6ffc8cf9 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:11.977059 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 359/743] 10.222.0.118 () {56 vars in 1104 bytes} [Thu Jul 14 15:24:11 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:11.977059 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e45d6e-79b7-496c-bca2-dfcc6ffc8cf9 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:11.987050 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:12.039612 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 385/744] 10.222.0.118 () {58 vars in 1287 bytes} [Thu Jul 14 15:24:11 2022] GET /identity/v3/auth/tokens => generated 899 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 15:24:12.039612 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f946c-9cc6-42c0-8ef7-c43d4691f74e None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:12.039612 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f946c-9cc6-42c0-8ef7-c43d4691f74e None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:12.039612 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f946c-9cc6-42c0-8ef7-c43d4691f74e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:12.053251 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-5e0f946c-9cc6-42c0-8ef7-c43d4691f74e None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:12.054480 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-5e0f946c-9cc6-42c0-8ef7-c43d4691f74e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:12.088608 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e45d6e-79b7-496c-bca2-dfcc6ffc8cf9 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:12.123445 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f33150f-12cd-40b0-80b0-d7433c1d5bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:12.124098 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f33150f-12cd-40b0-80b0-d7433c1d5bea None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:12.124379 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f33150f-12cd-40b0-80b0-d7433c1d5bea None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:12.124647 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f33150f-12cd-40b0-80b0-d7433c1d5bea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:12.134392 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 386/745] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:24:12 2022] POST /identity/v3/auth/tokens => generated 899 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:24:12.135017 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0f946c-9cc6-42c0-8ef7-c43d4691f74e None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:12.179139 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:12.200976 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f33150f-12cd-40b0-80b0-d7433c1d5bea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:12.202659 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f33150f-12cd-40b0-80b0-d7433c1d5bea None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:12.228360 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:12.241214 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0f946c-9cc6-42c0-8ef7-c43d4691f74e None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:12.280651 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb4a1f5-ce19-4c8e-996e-3e5b3b119ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:12.281437 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb4a1f5-ce19-4c8e-996e-3e5b3b119ee7 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:12.281711 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb4a1f5-ce19-4c8e-996e-3e5b3b119ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:12.282089 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb4a1f5-ce19-4c8e-996e-3e5b3b119ee7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:12.292883 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb4a1f5-ce19-4c8e-996e-3e5b3b119ee7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:12.294341 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb4a1f5-ce19-4c8e-996e-3e5b3b119ee7 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:12.310505 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 360/746] 10.222.0.118 () {58 vars in 1287 bytes} [Thu Jul 14 15:24:11 2022] GET /identity/v3/auth/tokens => generated 899 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 15:24:12.311343 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f33150f-12cd-40b0-80b0-d7433c1d5bea None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:12.312680 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-0cb4a1f5-ce19-4c8e-996e-3e5b3b119ee7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:12.312680 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:12.312680 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:12.312680 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:12.312680 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:12.312680 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:12.312680 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:12.312680 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:12.312680 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:12.312680 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:12.312680 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:12.312680 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:12.312680 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:24:12.312680 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:24:12.312680 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:24:12.313538 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:24:12.313538 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:12.313538 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:12.313538 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:12.313538 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:12.313538 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:12.313538 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:12.313538 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:12.313538 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:12.313538 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:12.313538 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:12.313538 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:12.313538 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:12.313538 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:12.313538 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:12.313538 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:12.313538 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:12.314959 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:24:12.314959 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:24:12.314959 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:12.314959 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:24:12.318210 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 387/747] 10.222.0.118 () {56 vars in 1113 bytes} [Thu Jul 14 15:24:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:12.318974 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb4a1f5-ce19-4c8e-996e-3e5b3b119ee7 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:12.405877 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:12.425953 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f33150f-12cd-40b0-80b0-d7433c1d5bea None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:12.432422 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb4a1f5-ce19-4c8e-996e-3e5b3b119ee7 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:12.464769 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3adeec-4789-4996-b7c2-f50e02e7ee74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:12.465616 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3adeec-4789-4996-b7c2-f50e02e7ee74 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:12.465901 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3adeec-4789-4996-b7c2-f50e02e7ee74 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:12.466224 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3adeec-4789-4996-b7c2-f50e02e7ee74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:12.469316 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491504f9-783a-4c1c-a26c-2cbc892ea42a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:12.469990 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491504f9-783a-4c1c-a26c-2cbc892ea42a None admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:12.470273 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491504f9-783a-4c1c-a26c-2cbc892ea42a None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:12.470543 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491504f9-783a-4c1c-a26c-2cbc892ea42a None admin] PATH_INFO: `/v3/services` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:12.471287 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491504f9-783a-4c1c-a26c-2cbc892ea42a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:12.472749 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491504f9-783a-4c1c-a26c-2cbc892ea42a None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:12.476517 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3adeec-4789-4996-b7c2-f50e02e7ee74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:12.478244 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3adeec-4789-4996-b7c2-f50e02e7ee74 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:12.482856 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:12.498385 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 388/748] 10.222.0.118 () {60 vars in 1146 bytes} [Thu Jul 14 15:24:12 2022] POST /identity/v3/services => generated 252 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:24:12.499266 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-5d3adeec-4789-4996-b7c2-f50e02e7ee74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:12.499266 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:12.499266 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:12.499266 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:12.499266 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:12.499266 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:12.499266 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:12.499266 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:12.499266 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:12.499266 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:12.499266 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:12.499266 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:12.499266 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:24:12.499266 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:24:12.499266 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:24:12.500143 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:24:12.500143 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:12.500143 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:12.500143 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:12.500143 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:12.500143 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:12.500143 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:12.500143 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:12.500143 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:12.500143 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:12.500143 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:12.500143 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:12.500143 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:12.500143 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:12.500143 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:12.500143 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:12.500143 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:12.501012 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:24:12.501012 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:24:12.501012 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:12.501012 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:24:12.501012 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 361/749] 10.222.0.118 () {56 vars in 1113 bytes} [Thu Jul 14 15:24:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:12.501725 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3adeec-4789-4996-b7c2-f50e02e7ee74 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:12.503140 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491504f9-783a-4c1c-a26c-2cbc892ea42a None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:12.621648 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3adeec-4789-4996-b7c2-f50e02e7ee74 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:12.662548 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:12.669087 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491504f9-783a-4c1c-a26c-2cbc892ea42a None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:12.671337 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3807050f-da43-480f-85a7-eeb32178db74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:12.672178 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3807050f-da43-480f-85a7-eeb32178db74 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:12.672625 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3807050f-da43-480f-85a7-eeb32178db74 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:12.673038 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3807050f-da43-480f-85a7-eeb32178db74 None admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:12.674579 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3807050f-da43-480f-85a7-eeb32178db74 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:12.675029 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3807050f-da43-480f-85a7-eeb32178db74 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:12.676588 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3807050f-da43-480f-85a7-eeb32178db74 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:12.692829 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 362/750] 10.222.0.118 () {56 vars in 1114 bytes} [Thu Jul 14 15:24:12 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:12.693591 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3807050f-da43-480f-85a7-eeb32178db74 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:12.727947 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cad5638-41b9-4adf-993b-12a59a005a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:12.728827 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad5638-41b9-4adf-993b-12a59a005a47 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:12.729170 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad5638-41b9-4adf-993b-12a59a005a47 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:12.729507 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad5638-41b9-4adf-993b-12a59a005a47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:12.741661 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cad5638-41b9-4adf-993b-12a59a005a47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:12.743242 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cad5638-41b9-4adf-993b-12a59a005a47 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:12.763080 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-0cad5638-41b9-4adf-993b-12a59a005a47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:12.763080 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:12.763080 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:12.763080 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:12.763080 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:12.763080 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:12.763080 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:12.763080 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:12.763080 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:12.763080 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:12.763080 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:12.763080 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:12.763080 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:24:12.763080 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:24:12.763080 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:24:12.764612 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:24:12.764612 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:12.764612 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:12.764612 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:12.764612 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:12.764612 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:12.764612 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:12.764612 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:12.764612 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:12.764612 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:12.764612 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:12.764612 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:12.764612 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:12.764612 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:12.764612 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:12.764612 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:12.764612 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:12.765707 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:24:12.765707 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:24:12.765707 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:12.765707 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:24:12.766437 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 389/751] 10.222.0.118 () {56 vars in 1113 bytes} [Thu Jul 14 15:24:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:12.767286 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cad5638-41b9-4adf-993b-12a59a005a47 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:12.822533 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:12.825410 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3807050f-da43-480f-85a7-eeb32178db74 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:12.868968 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49945781-6198-4cc0-a266-52f2e5ed33f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:12.870182 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49945781-6198-4cc0-a266-52f2e5ed33f0 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:12.870615 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49945781-6198-4cc0-a266-52f2e5ed33f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:12.871039 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49945781-6198-4cc0-a266-52f2e5ed33f0 None admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:12.872377 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49945781-6198-4cc0-a266-52f2e5ed33f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:12.872869 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49945781-6198-4cc0-a266-52f2e5ed33f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:12.874811 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49945781-6198-4cc0-a266-52f2e5ed33f0 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:12.881773 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cad5638-41b9-4adf-993b-12a59a005a47 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:12.890711 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 363/752] 10.222.0.118 () {56 vars in 1114 bytes} [Thu Jul 14 15:24:12 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:12.891935 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49945781-6198-4cc0-a266-52f2e5ed33f0 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:12.920153 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289a36ef-a479-418c-b51b-f97854620e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:12.921040 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289a36ef-a479-418c-b51b-f97854620e1d None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:12.921439 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289a36ef-a479-418c-b51b-f97854620e1d None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:12.921794 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289a36ef-a479-418c-b51b-f97854620e1d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:12.930236 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289a36ef-a479-418c-b51b-f97854620e1d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:12.932017 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289a36ef-a479-418c-b51b-f97854620e1d None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:12.947206 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-289a36ef-a479-418c-b51b-f97854620e1d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 15:24:12.947206 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:12.947206 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:12.947206 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:12.947206 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:12.947206 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:12.947206 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:12.947206 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:12.947206 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:12.947206 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:12.947206 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:12.947206 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:12.947206 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 15:24:12.947206 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 15:24:12.947206 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 15:24:12.947206 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 15:24:12.948402 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:12.948402 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:12.948402 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 15:24:12.948402 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:24:12.948402 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 15:24:12.948402 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:24:12.948402 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:12.948402 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:12.948402 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:12.948402 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:12.948402 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:12.948402 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:12.948402 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:12.948402 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:12.948402 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:12.948402 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:12.948402 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:12.948402 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:12.949563 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:12.949563 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:12.949563 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 15:24:12.949563 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 15:24:12.949563 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 15:24:12.949563 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 15:24:12.949563 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 15:24:12.949563 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 15:24:12.949563 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 15:24:12.949563 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:24:12.951570 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 390/753] 10.222.0.118 () {56 vars in 1098 bytes} [Thu Jul 14 15:24:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:12.952532 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289a36ef-a479-418c-b51b-f97854620e1d None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:12.955109 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:13.025696 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49945781-6198-4cc0-a266-52f2e5ed33f0 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:13.061666 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfcc73b-05d4-4c00-9734-b8cb6350d36d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:13.062505 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfcc73b-05d4-4c00-9734-b8cb6350d36d None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:13.062883 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfcc73b-05d4-4c00-9734-b8cb6350d36d None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:13.063316 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfcc73b-05d4-4c00-9734-b8cb6350d36d None admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:13.064218 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfcc73b-05d4-4c00-9734-b8cb6350d36d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:13.065192 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfcc73b-05d4-4c00-9734-b8cb6350d36d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:13.066700 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfcc73b-05d4-4c00-9734-b8cb6350d36d None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:13.079264 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 364/754] 10.222.0.118 () {56 vars in 1114 bytes} [Thu Jul 14 15:24:12 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:13.080755 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfcc73b-05d4-4c00-9734-b8cb6350d36d None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:13.083022 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289a36ef-a479-418c-b51b-f97854620e1d None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:13.095124 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:13.122821 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335ab929-0348-4f18-85ef-ab01a3850a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:13.123816 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335ab929-0348-4f18-85ef-ab01a3850a6b None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:13.124205 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335ab929-0348-4f18-85ef-ab01a3850a6b None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:13.124624 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335ab929-0348-4f18-85ef-ab01a3850a6b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:13.132648 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335ab929-0348-4f18-85ef-ab01a3850a6b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:13.134248 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335ab929-0348-4f18-85ef-ab01a3850a6b None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:13.148316 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-335ab929-0348-4f18-85ef-ab01a3850a6b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:24:13.148316 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:13.148316 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:13.148316 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:13.148316 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:13.148316 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:13.148316 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:13.148316 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:13.148316 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:13.148316 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:13.148316 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:13.148316 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:13.148316 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 15:24:13.148316 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 15:24:13.148316 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 15:24:13.149403 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 15:24:13.149403 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:13.149403 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:13.149403 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:13.149403 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:13.149403 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:13.149403 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:13.149403 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:13.149403 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:13.149403 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:13.149403 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:13.149403 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:13.149403 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:13.149403 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:13.149403 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:13.149403 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:13.149403 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:13.150559 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 15:24:13.150559 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 15:24:13.150559 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:24:13.150559 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:24:13.150559 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:24:13.150559 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:24:13.150559 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:24:13.150559 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:24:13.152356 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 391/755] 10.222.0.118 () {56 vars in 1116 bytes} [Thu Jul 14 15:24:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:13.153276 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335ab929-0348-4f18-85ef-ab01a3850a6b None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:13.207143 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfcc73b-05d4-4c00-9734-b8cb6350d36d None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:13.217159 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:13.245461 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0588d433-19e5-4c52-a22f-6e0804128ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:13.246276 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0588d433-19e5-4c52-a22f-6e0804128ae0 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:13.246622 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0588d433-19e5-4c52-a22f-6e0804128ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:13.246915 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0588d433-19e5-4c52-a22f-6e0804128ae0 None admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:13.247937 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0588d433-19e5-4c52-a22f-6e0804128ae0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:13.248307 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0588d433-19e5-4c52-a22f-6e0804128ae0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:13.249849 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0588d433-19e5-4c52-a22f-6e0804128ae0 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:13.275903 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 365/756] 10.222.0.118 () {56 vars in 1138 bytes} [Thu Jul 14 15:24:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:13.277297 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0588d433-19e5-4c52-a22f-6e0804128ae0 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:13.290678 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335ab929-0348-4f18-85ef-ab01a3850a6b None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:13.334131 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940d973f-0cc0-422e-8385-86b2492eaf50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:13.334930 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940d973f-0cc0-422e-8385-86b2492eaf50 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:13.335208 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940d973f-0cc0-422e-8385-86b2492eaf50 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:13.335480 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940d973f-0cc0-422e-8385-86b2492eaf50 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:13.343853 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940d973f-0cc0-422e-8385-86b2492eaf50 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:13.345847 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940d973f-0cc0-422e-8385-86b2492eaf50 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:13.364360 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-940d973f-0cc0-422e-8385-86b2492eaf50 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:24:13.364360 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:13.364360 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:13.364360 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:13.364360 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:13.364360 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:13.364360 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:13.364360 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:13.364360 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:13.364360 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:13.364360 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:13.364360 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:13.364360 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 15:24:13.364360 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 15:24:13.364360 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 15:24:13.365308 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 15:24:13.365308 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:13.365308 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:13.365308 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:13.365308 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:13.365308 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:13.365308 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:13.365308 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:13.365308 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:13.365308 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:13.365308 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:13.365308 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:13.365308 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:13.365308 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:13.365308 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:13.365308 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:13.365308 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:13.366211 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 15:24:13.366211 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 15:24:13.366211 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:24:13.366211 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:24:13.366211 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:24:13.366211 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:24:13.366211 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:24:13.366211 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:24:13.366211 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 392/757] 10.222.0.118 () {56 vars in 1116 bytes} [Thu Jul 14 15:24:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:13.367407 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940d973f-0cc0-422e-8385-86b2492eaf50 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:13.404816 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:13.417236 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0588d433-19e5-4c52-a22f-6e0804128ae0 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:13.463175 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909c15c6-0c84-4a44-be35-38461babe3ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:13.464654 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c15c6-0c84-4a44-be35-38461babe3ad None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:13.465154 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c15c6-0c84-4a44-be35-38461babe3ad None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:13.465647 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c15c6-0c84-4a44-be35-38461babe3ad None admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:13.467103 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909c15c6-0c84-4a44-be35-38461babe3ad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:13.467610 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909c15c6-0c84-4a44-be35-38461babe3ad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:13.469923 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909c15c6-0c84-4a44-be35-38461babe3ad None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:13.485919 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 366/758] 10.222.0.118 () {56 vars in 1153 bytes} [Thu Jul 14 15:24:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:13.487654 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909c15c6-0c84-4a44-be35-38461babe3ad None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:13.499105 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940d973f-0cc0-422e-8385-86b2492eaf50 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:13.523551 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:13.542549 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a936d1c-556d-42e6-ab7b-12798f904fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:13.543351 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a936d1c-556d-42e6-ab7b-12798f904fd3 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:13.543631 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a936d1c-556d-42e6-ab7b-12798f904fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:13.543907 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a936d1c-556d-42e6-ab7b-12798f904fd3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:13.558553 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a936d1c-556d-42e6-ab7b-12798f904fd3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:13.560444 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a936d1c-556d-42e6-ab7b-12798f904fd3 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:13.584310 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-1a936d1c-556d-42e6-ab7b-12798f904fd3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:13.584310 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:13.584310 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:13.584310 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:13.584310 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:13.584310 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:13.584310 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:13.584310 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:13.584310 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:13.584310 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:13.584310 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:13.584310 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:13.584310 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:24:13.584310 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:24:13.584310 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:24:13.585257 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:24:13.585257 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:13.585257 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:13.585257 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:13.585257 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:13.585257 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:13.585257 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:13.585257 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:13.585257 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:13.585257 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:13.585257 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:13.585257 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:13.585257 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:13.585257 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:13.585257 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:13.585257 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:13.585257 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:13.586167 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:24:13.586167 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:24:13.586167 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:13.586167 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:24:13.590035 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 393/759] 10.222.0.118 () {56 vars in 1113 bytes} [Thu Jul 14 15:24:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:13.591108 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a936d1c-556d-42e6-ab7b-12798f904fd3 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:13.619592 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909c15c6-0c84-4a44-be35-38461babe3ad None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:13.656498 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebd4603-0bd5-4248-9fc8-311f7ed6ccb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:13.657612 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebd4603-0bd5-4248-9fc8-311f7ed6ccb2 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:13.658644 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebd4603-0bd5-4248-9fc8-311f7ed6ccb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:13.659120 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebd4603-0bd5-4248-9fc8-311f7ed6ccb2 None admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:13.660109 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebd4603-0bd5-4248-9fc8-311f7ed6ccb2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:13.660691 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebd4603-0bd5-4248-9fc8-311f7ed6ccb2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:13.662454 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebd4603-0bd5-4248-9fc8-311f7ed6ccb2 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:13.677164 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 367/760] 10.222.0.118 () {56 vars in 1153 bytes} [Thu Jul 14 15:24:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:13.678078 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebd4603-0bd5-4248-9fc8-311f7ed6ccb2 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:13.687279 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:13.715341 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a936d1c-556d-42e6-ab7b-12798f904fd3 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:13.756083 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd29b837-ba75-4943-8b62-f1a31ec794ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:13.756740 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd29b837-ba75-4943-8b62-f1a31ec794ba None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:13.757022 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd29b837-ba75-4943-8b62-f1a31ec794ba None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:13.758006 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd29b837-ba75-4943-8b62-f1a31ec794ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:13.758152 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd29b837-ba75-4943-8b62-f1a31ec794ba None admin] RBAC: Adding query filter params (role.id=3185f450429e4bb3b5f289b615f3269b, scope.project.id=939bf9541f4a4afe86550f749d337680, user.id=f7ad5ae70939416e8157693e02997a58) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:13.758468 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd29b837-ba75-4943-8b62-f1a31ec794ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:13.759910 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd29b837-ba75-4943-8b62-f1a31ec794ba None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:13.765676 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 394/761] 10.222.0.118 () {56 vars in 1379 bytes} [Thu Jul 14 15:24:13 2022] GET /identity/v3/role_assignments?user.id=f7ad5ae70939416e8157693e02997a58&scope.project.id=939bf9541f4a4afe86550f749d337680&role.id=3185f450429e4bb3b5f289b615f3269b => generated 260 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:13.767212 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150275df-89b6-4fe7-9db1-92033b1f0b07 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:13.767557 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150275df-89b6-4fe7-9db1-92033b1f0b07 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:13.767836 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150275df-89b6-4fe7-9db1-92033b1f0b07 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:13.769325 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 395/762] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:24:13 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:24:13.769912 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150275df-89b6-4fe7-9db1-92033b1f0b07 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:13.789657 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:13.815820 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebd4603-0bd5-4248-9fc8-311f7ed6ccb2 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:13.863380 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e146af8a-d667-4ef0-977f-ef81f2a7af3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:13.864221 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e146af8a-d667-4ef0-977f-ef81f2a7af3e None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:13.864638 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e146af8a-d667-4ef0-977f-ef81f2a7af3e None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:13.865041 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e146af8a-d667-4ef0-977f-ef81f2a7af3e None admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:13.866027 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e146af8a-d667-4ef0-977f-ef81f2a7af3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:13.866381 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e146af8a-d667-4ef0-977f-ef81f2a7af3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:13.867926 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e146af8a-d667-4ef0-977f-ef81f2a7af3e None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:13.881509 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 368/763] 10.222.0.118 () {56 vars in 1114 bytes} [Thu Jul 14 15:24:13 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:13.883092 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da216482-19ae-417f-9404-e73e897cce8c None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:13.883784 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da216482-19ae-417f-9404-e73e897cce8c None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:13.883784 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da216482-19ae-417f-9404-e73e897cce8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:13.900093 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150275df-89b6-4fe7-9db1-92033b1f0b07 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:13.902237 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-da216482-19ae-417f-9404-e73e897cce8c None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:13.903968 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-da216482-19ae-417f-9404-e73e897cce8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:13.952338 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2bd907-908a-4ef4-9cb9-a3cae44db722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:13.953182 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2bd907-908a-4ef4-9cb9-a3cae44db722 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:13.953703 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2bd907-908a-4ef4-9cb9-a3cae44db722 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:13.954130 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2bd907-908a-4ef4-9cb9-a3cae44db722 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:13.955657 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2bd907-908a-4ef4-9cb9-a3cae44db722 None admin] RBAC: Adding query filter params (role.id=3b880cef7dcf4baf87b50f8610c0c56e, scope.project.id=939bf9541f4a4afe86550f749d337680, user.id=b672a6a601584d2d826147069e90a10f) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:13.956071 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2bd907-908a-4ef4-9cb9-a3cae44db722 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:13.958226 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2bd907-908a-4ef4-9cb9-a3cae44db722 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:13.974073 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 396/764] 10.222.0.118 () {56 vars in 1379 bytes} [Thu Jul 14 15:24:13 2022] GET /identity/v3/role_assignments?user.id=b672a6a601584d2d826147069e90a10f&scope.project.id=939bf9541f4a4afe86550f749d337680&role.id=3b880cef7dcf4baf87b50f8610c0c56e => generated 260 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:13.974073 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2bd907-908a-4ef4-9cb9-a3cae44db722 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:13.989833 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:14.016501 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 369/765] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:24:13 2022] POST /identity/v3/auth/tokens => generated 1003 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:24:14.064465 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da216482-19ae-417f-9404-e73e897cce8c None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:14.168105 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:14.172284 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2bd907-908a-4ef4-9cb9-a3cae44db722 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:14.184270 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da216482-19ae-417f-9404-e73e897cce8c None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:14.220419 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731ed87a-9e93-4a72-b139-43decf1efd47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:14.221825 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731ed87a-9e93-4a72-b139-43decf1efd47 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:14.222126 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731ed87a-9e93-4a72-b139-43decf1efd47 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:14.222395 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731ed87a-9e93-4a72-b139-43decf1efd47 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:14.232175 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731ed87a-9e93-4a72-b139-43decf1efd47 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:14.233781 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731ed87a-9e93-4a72-b139-43decf1efd47 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:14.238815 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b5aa33-89f8-4b60-bb4f-9ca885d2ebaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:14.240237 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b5aa33-89f8-4b60-bb4f-9ca885d2ebaf None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:14.240733 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b5aa33-89f8-4b60-bb4f-9ca885d2ebaf None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:14.241213 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b5aa33-89f8-4b60-bb4f-9ca885d2ebaf None admin] PATH_INFO: `/v3/services/network` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:14.242132 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b5aa33-89f8-4b60-bb4f-9ca885d2ebaf None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:14.244015 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b5aa33-89f8-4b60-bb4f-9ca885d2ebaf None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:14.256641 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-e6b5aa33-89f8-4b60-bb4f-9ca885d2ebaf None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 15:24:14.256641 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:14.256641 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 15:24:14.256641 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 15:24:14.256641 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 15:24:14.256641 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 15:24:14.256641 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 15:24:14.256641 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:24:14.256641 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 15:24:14.256641 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:24:14.256641 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 15:24:14.256641 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:24:14.256641 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:14.256641 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:14.256641 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:14.256641 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:14.256641 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:14.257644 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:14.257644 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:14.257644 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:14.257644 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:14.257644 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:14.257644 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:14.257644 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 15:24:14.257644 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 15:24:14.257644 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 15:24:14.257644 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 15:24:14.257644 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:14.257644 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:14.257644 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:14.257644 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:14.257644 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:14.257644 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:14.258491 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:14.258491 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:14.258491 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:14.258491 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:14.258491 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:14.258491 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:14.258491 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:14.258491 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:14.258491 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:14.258491 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:14.258491 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 15:24:14.258491 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:24:14.258491 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 15:24:14.258491 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:24:14.259296 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-731ed87a-9e93-4a72-b139-43decf1efd47 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:24:14.259296 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:14.259296 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:14.259296 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:14.259296 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:14.259296 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:14.259296 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:14.259296 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:14.259296 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:14.259296 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:14.259296 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:14.259296 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:14.259296 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 15:24:14.259296 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 15:24:14.259296 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 15:24:14.260053 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 15:24:14.260053 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:14.260053 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:14.260053 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:14.260053 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:14.260053 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:14.260053 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:14.260053 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:14.260053 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:14.260053 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:14.260053 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:14.260053 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:14.260053 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:14.260053 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:14.260053 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:14.260053 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:14.260053 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:14.260902 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 15:24:14.260902 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 15:24:14.260902 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:24:14.260902 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:24:14.260902 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:24:14.260902 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:24:14.260902 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:24:14.260902 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:24:14.260902 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 397/766] 10.222.0.118 () {56 vars in 1116 bytes} [Thu Jul 14 15:24:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:14.263742 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 370/767] 10.222.0.118 () {56 vars in 1116 bytes} [Thu Jul 14 15:24:14 2022] GET /identity/v3/services/network => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:24:14.270083 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731ed87a-9e93-4a72-b139-43decf1efd47 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:14.271230 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b5aa33-89f8-4b60-bb4f-9ca885d2ebaf None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:14.386807 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b5aa33-89f8-4b60-bb4f-9ca885d2ebaf None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:14.430388 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55946eff-07ae-4953-92fb-cbb317e81df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:14.432477 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55946eff-07ae-4953-92fb-cbb317e81df9 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:14.438385 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55946eff-07ae-4953-92fb-cbb317e81df9 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:14.438666 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55946eff-07ae-4953-92fb-cbb317e81df9 None admin] PATH_INFO: `/v3/services` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:14.440223 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55946eff-07ae-4953-92fb-cbb317e81df9 None admin] RBAC: Adding query filter params (name=network) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:14.440335 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55946eff-07ae-4953-92fb-cbb317e81df9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:14.441702 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55946eff-07ae-4953-92fb-cbb317e81df9 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:14.451566 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:14.456920 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 371/768] 10.222.0.118 () {56 vars in 1117 bytes} [Thu Jul 14 15:24:14 2022] GET /identity/v3/services?name=network => generated 125 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:14.462259 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55946eff-07ae-4953-92fb-cbb317e81df9 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:14.476601 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:14.493164 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731ed87a-9e93-4a72-b139-43decf1efd47 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:14.531456 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4052f0-9a8d-4145-ae3f-ad3a34bd8cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:14.532121 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4052f0-9a8d-4145-ae3f-ad3a34bd8cd3 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:14.532397 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4052f0-9a8d-4145-ae3f-ad3a34bd8cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:14.532667 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4052f0-9a8d-4145-ae3f-ad3a34bd8cd3 None admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:14.533486 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4052f0-9a8d-4145-ae3f-ad3a34bd8cd3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:14.533793 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4052f0-9a8d-4145-ae3f-ad3a34bd8cd3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:14.535246 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4052f0-9a8d-4145-ae3f-ad3a34bd8cd3 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:14.562075 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 398/769] 10.222.0.118 () {56 vars in 1153 bytes} [Thu Jul 14 15:24:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:14.568992 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4052f0-9a8d-4145-ae3f-ad3a34bd8cd3 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:14.642181 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55946eff-07ae-4953-92fb-cbb317e81df9 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:14.675157 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4052f0-9a8d-4145-ae3f-ad3a34bd8cd3 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:14.706755 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:14.712553 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0c9ef7-cd8e-4f75-a276-15b112a15cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:14.713890 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c9ef7-cd8e-4f75-a276-15b112a15cc6 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:14.714482 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c9ef7-cd8e-4f75-a276-15b112a15cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:14.715022 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c9ef7-cd8e-4f75-a276-15b112a15cc6 None admin] PATH_INFO: `/v3/services` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:14.716369 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0c9ef7-cd8e-4f75-a276-15b112a15cc6 None admin] RBAC: Adding query filter params (type=network) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:14.716959 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0c9ef7-cd8e-4f75-a276-15b112a15cc6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:14.718834 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0c9ef7-cd8e-4f75-a276-15b112a15cc6 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:14.729278 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 372/770] 10.222.0.118 () {56 vars in 1117 bytes} [Thu Jul 14 15:24:14 2022] GET /identity/v3/services?type=network => generated 352 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:14.730501 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0c9ef7-cd8e-4f75-a276-15b112a15cc6 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:14.732205 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d083b56a-f157-4c29-99e5-a3c9e264add0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:14.733179 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d083b56a-f157-4c29-99e5-a3c9e264add0 None admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:14.733451 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d083b56a-f157-4c29-99e5-a3c9e264add0 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:14.733771 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d083b56a-f157-4c29-99e5-a3c9e264add0 None admin] PATH_INFO: `/v3/projects/939bf9541f4a4afe86550f749d337680/users/f0177fc696ea40069902803da09f437c/roles/3b880cef7dcf4baf87b50f8610c0c56e` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:14.735814 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d083b56a-f157-4c29-99e5-a3c9e264add0 None admin] RBAC: Authorizing `identity:create_grant(project_id=939bf9541f4a4afe86550f749d337680, user_id=f0177fc696ea40069902803da09f437c, role_id=3b880cef7dcf4baf87b50f8610c0c56e)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:14.737819 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d083b56a-f157-4c29-99e5-a3c9e264add0 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:14.754325 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 399/771] 10.222.0.118 () {58 vars in 1444 bytes} [Thu Jul 14 15:24:14 2022] PUT /identity/v3/projects/939bf9541f4a4afe86550f749d337680/users/f0177fc696ea40069902803da09f437c/roles/3b880cef7dcf4baf87b50f8610c0c56e => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:24:14.756230 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bfc5dc-e0d1-4c2c-aab9-7567814a5c12 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:14.756548 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bfc5dc-e0d1-4c2c-aab9-7567814a5c12 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:14.756903 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bfc5dc-e0d1-4c2c-aab9-7567814a5c12 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:14.758457 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 400/772] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:24:14 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:24:14.765465 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23ed7ce-9025-4e65-868d-aa7bfc3e28d0 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:14.765888 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23ed7ce-9025-4e65-868d-aa7bfc3e28d0 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:14.766475 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23ed7ce-9025-4e65-868d-aa7bfc3e28d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:14.789672 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-b23ed7ce-9025-4e65-868d-aa7bfc3e28d0 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:14.791086 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-b23ed7ce-9025-4e65-868d-aa7bfc3e28d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:14.806933 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:14.845059 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0c9ef7-cd8e-4f75-a276-15b112a15cc6 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:14.872929 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 401/773] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:24:14 2022] POST /identity/v3/auth/tokens => generated 1003 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:24:14.894820 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e3bc03-4b30-42bf-888b-1b4e60af8a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:14.895614 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e3bc03-4b30-42bf-888b-1b4e60af8a69 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:14.895900 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e3bc03-4b30-42bf-888b-1b4e60af8a69 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:14.896180 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e3bc03-4b30-42bf-888b-1b4e60af8a69 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:14.897020 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e3bc03-4b30-42bf-888b-1b4e60af8a69 None admin] RBAC: Adding query filter params (interface=public, service_id=80717f41039f4973bb18734beb02b6ff, region_id=RegionOne) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:14.897337 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e3bc03-4b30-42bf-888b-1b4e60af8a69 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:14.898806 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e3bc03-4b30-42bf-888b-1b4e60af8a69 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:14.911053 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 373/774] 10.222.0.118 () {56 vars in 1256 bytes} [Thu Jul 14 15:24:14 2022] GET /identity/v3/endpoints?service_id=80717f41039f4973bb18734beb02b6ff&interface=public®ion_id=RegionOne => generated 195 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:24:14.913850 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23ed7ce-9025-4e65-868d-aa7bfc3e28d0 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:14.919568 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e3bc03-4b30-42bf-888b-1b4e60af8a69 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:15.027252 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23ed7ce-9025-4e65-868d-aa7bfc3e28d0 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:15.045658 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e3bc03-4b30-42bf-888b-1b4e60af8a69 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:15.046013 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:15.068089 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0861b6-50d4-49cf-baf3-2404da54f196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:15.068760 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0861b6-50d4-49cf-baf3-2404da54f196 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:15.069037 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0861b6-50d4-49cf-baf3-2404da54f196 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:15.069304 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0861b6-50d4-49cf-baf3-2404da54f196 None admin] PATH_INFO: `/v3/services` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:15.070160 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0861b6-50d4-49cf-baf3-2404da54f196 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:15.071535 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0861b6-50d4-49cf-baf3-2404da54f196 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:15.077599 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 402/775] 10.222.0.118 () {56 vars in 1092 bytes} [Thu Jul 14 15:24:14 2022] GET /identity/v3/services => generated 776 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:15.088150 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:15.100704 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7e4d63-f19b-467b-804a-61d9a12bc639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:15.101546 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7e4d63-f19b-467b-804a-61d9a12bc639 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:15.101823 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7e4d63-f19b-467b-804a-61d9a12bc639 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:15.102127 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7e4d63-f19b-467b-804a-61d9a12bc639 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:15.102800 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7e4d63-f19b-467b-804a-61d9a12bc639 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:15.104227 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7e4d63-f19b-467b-804a-61d9a12bc639 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:15.124033 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-cc7e4d63-f19b-467b-804a-61d9a12bc639 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 15:24:15.124033 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:15.124033 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 15:24:15.124033 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 15:24:15.124033 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 15:24:15.124033 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 15:24:15.124033 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 15:24:15.124033 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:24:15.124033 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 15:24:15.124033 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:24:15.124033 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 15:24:15.124033 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:24:15.124033 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:15.124033 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:15.124033 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:15.124033 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:15.125037 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:15.125037 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:15.125037 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:15.125037 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:15.125037 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:15.125037 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:15.125037 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:15.125037 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 15:24:15.125037 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 15:24:15.125037 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 15:24:15.125037 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 15:24:15.125037 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:15.125037 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:15.125037 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:15.125037 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:15.125037 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:15.125871 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:15.125871 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:15.125871 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:15.125871 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:15.125871 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:15.125871 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:15.125871 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:15.125871 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:15.125871 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:15.125871 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:15.125871 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:15.125871 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 15:24:15.125871 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:24:15.125871 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 15:24:15.125871 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:24:15.125871 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 374/776] 10.222.0.118 () {56 vars in 1134 bytes} [Thu Jul 14 15:24:14 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:24:15.132042 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0861b6-50d4-49cf-baf3-2404da54f196 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:15.280354 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0861b6-50d4-49cf-baf3-2404da54f196 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:15.319146 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dabaa5-4da0-4689-a5a0-1aaff7d191be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:15.319816 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dabaa5-4da0-4689-a5a0-1aaff7d191be None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:15.320096 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dabaa5-4da0-4689-a5a0-1aaff7d191be None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:15.320370 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dabaa5-4da0-4689-a5a0-1aaff7d191be None admin] PATH_INFO: `/v3/services` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:15.321090 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dabaa5-4da0-4689-a5a0-1aaff7d191be None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:15.321397 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dabaa5-4da0-4689-a5a0-1aaff7d191be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:15.322795 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dabaa5-4da0-4689-a5a0-1aaff7d191be None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:15.331150 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 403/777] 10.222.0.118 () {56 vars in 1129 bytes} [Thu Jul 14 15:24:15 2022] GET /identity/v3/services?name=block-storage => generated 131 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:15.335072 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7e4d63-f19b-467b-804a-61d9a12bc639 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:15.451202 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7e4d63-f19b-467b-804a-61d9a12bc639 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:15.488782 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae0193b-34d2-42b2-9f33-016f10ee26a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:15.489801 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae0193b-34d2-42b2-9f33-016f10ee26a4 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:15.490289 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae0193b-34d2-42b2-9f33-016f10ee26a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:15.490742 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae0193b-34d2-42b2-9f33-016f10ee26a4 None admin] PATH_INFO: `/v3/services` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:15.491632 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae0193b-34d2-42b2-9f33-016f10ee26a4 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:15.492137 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae0193b-34d2-42b2-9f33-016f10ee26a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:15.493721 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae0193b-34d2-42b2-9f33-016f10ee26a4 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:15.504289 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 375/778] 10.222.0.118 () {56 vars in 1129 bytes} [Thu Jul 14 15:24:15 2022] GET /identity/v3/services?type=block-storage => generated 369 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:15.506182 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dabaa5-4da0-4689-a5a0-1aaff7d191be None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:15.557120 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:15.616709 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dabaa5-4da0-4689-a5a0-1aaff7d191be None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:15.652992 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c974b87a-0664-472c-bba3-052e53dd5692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:15.654007 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c974b87a-0664-472c-bba3-052e53dd5692 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:15.654473 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c974b87a-0664-472c-bba3-052e53dd5692 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:15.654930 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c974b87a-0664-472c-bba3-052e53dd5692 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:15.655897 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c974b87a-0664-472c-bba3-052e53dd5692 None admin] RBAC: Adding query filter params (interface=public, service_id=e48b976d5f724310901928f71fda932d, region_id=RegionOne) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:15.656389 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c974b87a-0664-472c-bba3-052e53dd5692 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:15.658095 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c974b87a-0664-472c-bba3-052e53dd5692 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:15.670093 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 404/779] 10.222.0.118 () {56 vars in 1256 bytes} [Thu Jul 14 15:24:15 2022] GET /identity/v3/endpoints?service_id=e48b976d5f724310901928f71fda932d&interface=public®ion_id=RegionOne => generated 195 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:15.672203 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae0193b-34d2-42b2-9f33-016f10ee26a4 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:15.735502 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:15.780290 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae0193b-34d2-42b2-9f33-016f10ee26a4 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:15.816336 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ddc026-a5da-4249-b72c-065e92dd35fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:15.816940 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ddc026-a5da-4249-b72c-065e92dd35fd None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:15.817226 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ddc026-a5da-4249-b72c-065e92dd35fd None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:15.817491 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ddc026-a5da-4249-b72c-065e92dd35fd None admin] PATH_INFO: `/v3/services` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:15.818217 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ddc026-a5da-4249-b72c-065e92dd35fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:15.819613 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ddc026-a5da-4249-b72c-065e92dd35fd None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:15.830114 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 376/780] 10.222.0.118 () {56 vars in 1092 bytes} [Thu Jul 14 15:24:15 2022] GET /identity/v3/services => generated 776 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:16.098243 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a215f08a-141d-4b4a-a1a4-477587142f77 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:16.098733 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a215f08a-141d-4b4a-a1a4-477587142f77 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:16.098733 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a215f08a-141d-4b4a-a1a4-477587142f77 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:16.100424 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 405/781] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:24:16 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:24:16.105486 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e777a2e2-8ad3-4221-a7a9-ae46c89b6317 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:16.105775 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e777a2e2-8ad3-4221-a7a9-ae46c89b6317 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:16.106087 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e777a2e2-8ad3-4221-a7a9-ae46c89b6317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:16.127286 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-e777a2e2-8ad3-4221-a7a9-ae46c89b6317 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:16.128497 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-e777a2e2-8ad3-4221-a7a9-ae46c89b6317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:16.214750 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 377/782] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:24:16 2022] POST /identity/v3/auth/tokens => generated 1003 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:24:16.255695 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a215f08a-141d-4b4a-a1a4-477587142f77 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:16.393357 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a215f08a-141d-4b4a-a1a4-477587142f77 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:16.409483 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:16.438811 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a811ff5e-33fe-4de6-ac16-757477bb1a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:16.439643 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a811ff5e-33fe-4de6-ac16-757477bb1a40 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:16.439926 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a811ff5e-33fe-4de6-ac16-757477bb1a40 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:16.440196 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a811ff5e-33fe-4de6-ac16-757477bb1a40 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:16.462887 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a811ff5e-33fe-4de6-ac16-757477bb1a40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:24:16.470568 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-a811ff5e-33fe-4de6-ac16-757477bb1a40 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:24:16.470568 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:16.470568 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:16.470568 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:16.470568 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:16.470568 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:16.470568 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:16.470568 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:16.470568 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:16.470568 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:16.470568 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:16.470568 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:16.470568 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:24:16.470568 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:24:16.470568 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:24:16.470568 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:24:16.472030 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:24:16.472030 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:24:16.472030 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:24:16.472030 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:24:16.472030 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:16.472030 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:16.472030 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:16.472030 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:16.472030 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:16.472030 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:16.472030 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:16.472030 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:16.472030 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:16.472030 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:16.472030 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:16.472030 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:16.472899 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:16.472899 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:16.472899 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:16.472899 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:16.472899 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:24:16.472899 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:24:16.472899 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:24:16.472899 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:24:16.472899 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:24:16.472899 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:24:16.472899 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:24:16.472899 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:24:16.472899 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 406/783] 10.222.0.118 () {56 vars in 1107 bytes} [Thu Jul 14 15:24:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:16.478510 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e777a2e2-8ad3-4221-a7a9-ae46c89b6317 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:16.551599 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:16.565941 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b5fbb-f4b5-472d-917d-f00c2f7a046c None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:16.566268 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b5fbb-f4b5-472d-917d-f00c2f7a046c None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:16.566520 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b5fbb-f4b5-472d-917d-f00c2f7a046c None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:16.568153 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 407/784] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:24:16 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:24:16.575256 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb66d09-a220-441d-8a46-3f61bf8729ac None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:16.575547 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb66d09-a220-441d-8a46-3f61bf8729ac None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:16.575824 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb66d09-a220-441d-8a46-3f61bf8729ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:16.601001 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e777a2e2-8ad3-4221-a7a9-ae46c89b6317 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:16.614986 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-0fb66d09-a220-441d-8a46-3f61bf8729ac None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:16.616211 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-0fb66d09-a220-441d-8a46-3f61bf8729ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:16.667989 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3658e82b-d0a3-4258-8004-5836d03174e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:16.668683 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3658e82b-d0a3-4258-8004-5836d03174e5 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:16.668968 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3658e82b-d0a3-4258-8004-5836d03174e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:16.669233 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3658e82b-d0a3-4258-8004-5836d03174e5 None admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:16.670007 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3658e82b-d0a3-4258-8004-5836d03174e5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:16.670300 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3658e82b-d0a3-4258-8004-5836d03174e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:16.671685 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3658e82b-d0a3-4258-8004-5836d03174e5 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:16.688546 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 408/785] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:24:16 2022] POST /identity/v3/auth/tokens => generated 1003 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 15:24:16.692138 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 378/786] 10.222.0.118 () {56 vars in 1108 bytes} [Thu Jul 14 15:24:16 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:16.697653 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb66d09-a220-441d-8a46-3f61bf8729ac None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:16.735482 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3658e82b-d0a3-4258-8004-5836d03174e5 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:16.803929 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb66d09-a220-441d-8a46-3f61bf8729ac None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:16.814124 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:16.869494 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4288f7-38d7-43ec-9503-8c76959108bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:16.870327 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4288f7-38d7-43ec-9503-8c76959108bd None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:16.870608 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4288f7-38d7-43ec-9503-8c76959108bd None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:16.870984 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4288f7-38d7-43ec-9503-8c76959108bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:16.881158 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3658e82b-d0a3-4258-8004-5836d03174e5 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:16.892222 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4288f7-38d7-43ec-9503-8c76959108bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:16.893750 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4288f7-38d7-43ec-9503-8c76959108bd None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:16.901099 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:16.925442 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-6a4288f7-38d7-43ec-9503-8c76959108bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:16.925442 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:16.925442 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:16.925442 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:16.925442 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:16.925442 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:16.925442 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:16.925442 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:16.925442 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:16.925442 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:16.925442 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:16.925442 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:16.925442 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:24:16.925442 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:24:16.925442 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:24:16.926373 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:24:16.926373 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:16.926373 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:16.926373 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:16.926373 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:16.926373 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:16.926373 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:16.926373 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:16.926373 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:16.926373 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:16.926373 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:16.926373 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:16.926373 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:16.926373 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:16.926373 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:16.926373 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:16.926373 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:16.927247 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:24:16.927247 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:24:16.927247 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:16.927247 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:24:16.929170 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 409/787] 10.222.0.118 () {56 vars in 1113 bytes} [Thu Jul 14 15:24:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:24:16.932033 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34844091-7cfc-42f3-bb66-23ad847972b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:16.932918 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34844091-7cfc-42f3-bb66-23ad847972b6 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:16.933199 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34844091-7cfc-42f3-bb66-23ad847972b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:16.933473 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34844091-7cfc-42f3-bb66-23ad847972b6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:16.934804 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4288f7-38d7-43ec-9503-8c76959108bd None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:16.958348 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34844091-7cfc-42f3-bb66-23ad847972b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:24:16.969097 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-34844091-7cfc-42f3-bb66-23ad847972b6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:24:16.969097 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:16.969097 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:16.969097 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:16.969097 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:16.969097 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:16.969097 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:16.969097 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:16.969097 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:16.969097 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:16.969097 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:16.969097 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:16.969097 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:24:16.969097 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:24:16.969097 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:24:16.969097 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:24:16.970074 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:24:16.970074 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:24:16.970074 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:24:16.970074 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:24:16.970074 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:16.970074 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:16.970074 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:16.970074 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:16.970074 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:16.970074 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:16.970074 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:16.970074 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:16.970074 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:16.970074 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:16.970074 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:16.970074 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:16.971479 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:16.971479 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:16.971479 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:16.971479 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:16.971479 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:24:16.971479 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:24:16.971479 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:24:16.971479 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:24:16.971479 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:24:16.971479 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:24:16.971479 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:24:16.971479 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:24:16.971479 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 379/788] 10.222.0.118 () {56 vars in 1101 bytes} [Thu Jul 14 15:24:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:16.978284 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34844091-7cfc-42f3-bb66-23ad847972b6 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:17.112365 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4288f7-38d7-43ec-9503-8c76959108bd None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:17.160456 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34844091-7cfc-42f3-bb66-23ad847972b6 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:17.173364 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48c71e4-fbe3-48fd-9088-d266333d2f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:17.174103 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48c71e4-fbe3-48fd-9088-d266333d2f2c None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:17.174382 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48c71e4-fbe3-48fd-9088-d266333d2f2c None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:17.174654 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48c71e4-fbe3-48fd-9088-d266333d2f2c None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:17.175386 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48c71e4-fbe3-48fd-9088-d266333d2f2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:17.175741 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48c71e4-fbe3-48fd-9088-d266333d2f2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:17.177056 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48c71e4-fbe3-48fd-9088-d266333d2f2c None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:17.201022 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 410/789] 10.222.0.118 () {56 vars in 1114 bytes} [Thu Jul 14 15:24:16 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:17.206526 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48c71e4-fbe3-48fd-9088-d266333d2f2c None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:17.232374 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a4ed2c-0a02-480b-89a3-084331fbc4e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:17.233058 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a4ed2c-0a02-480b-89a3-084331fbc4e9 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:17.233336 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a4ed2c-0a02-480b-89a3-084331fbc4e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:17.233613 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a4ed2c-0a02-480b-89a3-084331fbc4e9 None admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:17.233886 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:17.234708 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a4ed2c-0a02-480b-89a3-084331fbc4e9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:17.234708 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a4ed2c-0a02-480b-89a3-084331fbc4e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:17.238356 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a4ed2c-0a02-480b-89a3-084331fbc4e9 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:17.256252 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 380/790] 10.222.0.118 () {56 vars in 1104 bytes} [Thu Jul 14 15:24:16 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:17.262993 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a4ed2c-0a02-480b-89a3-084331fbc4e9 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:17.315590 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:17.399819 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48c71e4-fbe3-48fd-9088-d266333d2f2c None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:17.430873 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a4ed2c-0a02-480b-89a3-084331fbc4e9 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:17.444250 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c12efff-7b55-4aaa-998a-35cf0875406c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:17.445436 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c12efff-7b55-4aaa-998a-35cf0875406c None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:17.445932 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c12efff-7b55-4aaa-998a-35cf0875406c None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:17.446326 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c12efff-7b55-4aaa-998a-35cf0875406c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:17.454364 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c12efff-7b55-4aaa-998a-35cf0875406c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:17.456022 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c12efff-7b55-4aaa-998a-35cf0875406c None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:17.469855 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2f1d70-f0b1-4aca-8f01-b895c7948773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:17.471477 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2f1d70-f0b1-4aca-8f01-b895c7948773 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:17.471897 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2f1d70-f0b1-4aca-8f01-b895c7948773 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:17.472309 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2f1d70-f0b1-4aca-8f01-b895c7948773 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:17.472803 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-5c12efff-7b55-4aaa-998a-35cf0875406c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 15:24:17.472803 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:17.472803 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:17.472803 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:17.472803 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:17.472803 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:17.472803 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:17.472803 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:17.472803 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:17.472803 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:17.472803 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:17.472803 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:17.472803 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 15:24:17.472803 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 15:24:17.472803 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 15:24:17.472803 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 15:24:17.474088 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:17.474088 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:17.474088 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 15:24:17.474088 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:24:17.474088 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 15:24:17.474088 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:24:17.474088 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:17.474088 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:17.474088 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:17.474088 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:17.474088 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:17.474088 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:17.474088 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:17.474088 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:17.474088 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:17.474088 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:17.474088 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:17.474088 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:17.475245 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:17.475245 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:17.475245 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 15:24:17.475245 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 15:24:17.475245 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 15:24:17.475245 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 15:24:17.475245 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 15:24:17.475245 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 15:24:17.475245 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 15:24:17.475245 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:24:17.477296 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 411/791] 10.222.0.118 () {56 vars in 1122 bytes} [Thu Jul 14 15:24:17 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:17.482008 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d51a77c-f0fb-4f8b-aa8f-7236d2b45221 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:17.482008 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d51a77c-f0fb-4f8b-aa8f-7236d2b45221 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:17.482008 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d51a77c-f0fb-4f8b-aa8f-7236d2b45221 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:17.482008 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 412/792] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:24:17 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:24:17.483104 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d51a77c-f0fb-4f8b-aa8f-7236d2b45221 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:17.494353 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2f1d70-f0b1-4aca-8f01-b895c7948773 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:17.496782 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2f1d70-f0b1-4aca-8f01-b895c7948773 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:17.520844 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-2f2f1d70-f0b1-4aca-8f01-b895c7948773 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:17.520844 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:17.520844 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:17.520844 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:17.520844 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:17.520844 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:17.520844 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:17.520844 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:17.520844 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:17.520844 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:17.520844 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:17.520844 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:17.520844 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:24:17.520844 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:24:17.520844 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:24:17.521942 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:24:17.521942 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:17.521942 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:17.521942 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:17.521942 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:17.521942 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:17.521942 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:17.521942 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:17.521942 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:17.521942 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:17.521942 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:17.521942 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:17.521942 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:17.521942 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:17.521942 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:17.521942 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:17.521942 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:17.523037 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:24:17.523037 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:24:17.523037 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:17.523037 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:24:17.525982 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 381/793] 10.222.0.118 () {56 vars in 1113 bytes} [Thu Jul 14 15:24:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:17.526092 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acccd026-1441-4222-9e93-d9a72e06ac54 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:17.526385 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acccd026-1441-4222-9e93-d9a72e06ac54 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:17.526661 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acccd026-1441-4222-9e93-d9a72e06ac54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:17.548147 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-acccd026-1441-4222-9e93-d9a72e06ac54 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:17.550063 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-acccd026-1441-4222-9e93-d9a72e06ac54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:17.561710 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:17.597629 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d51a77c-f0fb-4f8b-aa8f-7236d2b45221 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:17.633077 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f083e639-a3e2-4f22-a80b-afbbd2bd9012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:17.633863 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f083e639-a3e2-4f22-a80b-afbbd2bd9012 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:17.634237 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f083e639-a3e2-4f22-a80b-afbbd2bd9012 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:17.634578 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f083e639-a3e2-4f22-a80b-afbbd2bd9012 None admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:17.635475 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f083e639-a3e2-4f22-a80b-afbbd2bd9012 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:17.635844 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f083e639-a3e2-4f22-a80b-afbbd2bd9012 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:17.637321 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f083e639-a3e2-4f22-a80b-afbbd2bd9012 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:17.640953 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 382/794] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:24:17 2022] POST /identity/v3/auth/tokens => generated 1003 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:24:17.642070 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acccd026-1441-4222-9e93-d9a72e06ac54 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:17.657890 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 413/795] 10.222.0.118 () {56 vars in 1154 bytes} [Thu Jul 14 15:24:17 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 386 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:17.663400 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f083e639-a3e2-4f22-a80b-afbbd2bd9012 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:17.667715 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:17.780783 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acccd026-1441-4222-9e93-d9a72e06ac54 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:17.781101 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f083e639-a3e2-4f22-a80b-afbbd2bd9012 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:17.811603 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:17.819512 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c739a0-d24c-4bbb-92ff-f7a873bb68b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:17.819706 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23283620-f360-430d-9ed7-f22dcbea17b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:17.820298 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c739a0-d24c-4bbb-92ff-f7a873bb68b1 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:17.820573 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c739a0-d24c-4bbb-92ff-f7a873bb68b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:17.820841 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c739a0-d24c-4bbb-92ff-f7a873bb68b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:17.821245 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23283620-f360-430d-9ed7-f22dcbea17b3 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:17.821729 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23283620-f360-430d-9ed7-f22dcbea17b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:17.822219 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23283620-f360-430d-9ed7-f22dcbea17b3 None admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:17.823133 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23283620-f360-430d-9ed7-f22dcbea17b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:17.823630 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23283620-f360-430d-9ed7-f22dcbea17b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:17.825212 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23283620-f360-430d-9ed7-f22dcbea17b3 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:17.831736 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c739a0-d24c-4bbb-92ff-f7a873bb68b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:17.833250 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c739a0-d24c-4bbb-92ff-f7a873bb68b1 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:17.838243 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 383/796] 10.222.0.118 () {56 vars in 1114 bytes} [Thu Jul 14 15:24:17 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:17.839366 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23283620-f360-430d-9ed7-f22dcbea17b3 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:17.851601 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-52c739a0-d24c-4bbb-92ff-f7a873bb68b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:17.851601 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:17.851601 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:17.851601 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:17.851601 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:17.851601 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:17.851601 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:17.851601 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:17.851601 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:17.851601 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:17.851601 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:17.851601 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:17.851601 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:24:17.851601 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:24:17.851601 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:24:17.852544 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:24:17.852544 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:17.852544 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:17.852544 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:17.852544 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:17.852544 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:17.852544 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:17.852544 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:17.852544 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:17.852544 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:17.852544 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:17.852544 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:17.852544 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:17.852544 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:17.852544 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:17.852544 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:17.852544 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:17.853698 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:24:17.853698 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:24:17.853698 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:17.853698 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:24:17.853698 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 414/797] 10.222.0.118 () {56 vars in 1113 bytes} [Thu Jul 14 15:24:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:24:17.858466 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e5de79-9ab9-47a7-b1b5-64aebef86779 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:17.858743 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e5de79-9ab9-47a7-b1b5-64aebef86779 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:17.859010 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e5de79-9ab9-47a7-b1b5-64aebef86779 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:17.862013 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 415/798] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:24:17 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:24:17.862013 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e5de79-9ab9-47a7-b1b5-64aebef86779 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:17.926245 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:17.947627 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23283620-f360-430d-9ed7-f22dcbea17b3 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:17.967198 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e5de79-9ab9-47a7-b1b5-64aebef86779 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:17.985827 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72767765-cc97-4743-9b6b-f661790a1cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:17.987103 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72767765-cc97-4743-9b6b-f661790a1cb9 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:17.987383 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72767765-cc97-4743-9b6b-f661790a1cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:17.987652 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72767765-cc97-4743-9b6b-f661790a1cb9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:17.997878 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72767765-cc97-4743-9b6b-f661790a1cb9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:24:18.005933 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87648b85-aaa6-4233-bddc-0e9e9b73261f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:18.006346 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-72767765-cc97-4743-9b6b-f661790a1cb9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:24:18.006346 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:18.006346 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:18.006346 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:18.006346 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:18.006346 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:18.006346 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:18.006346 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:18.006346 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:18.006346 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:18.006346 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:18.006346 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:18.006346 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:24:18.006346 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:24:18.006346 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:24:18.006346 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:24:18.007395 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:24:18.007395 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:24:18.007395 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:24:18.007395 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:24:18.007395 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:18.007395 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:18.007395 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:18.007395 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:18.007395 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:18.007395 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:18.007395 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:18.007395 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:18.007395 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:18.007395 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:18.007395 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:18.007395 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:18.008257 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:18.008257 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:18.008257 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:18.008257 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:18.008257 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:24:18.008257 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:24:18.008257 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:24:18.008257 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:24:18.008257 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:24:18.008257 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:24:18.008257 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:24:18.008257 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:24:18.008257 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 384/799] 10.222.0.118 () {56 vars in 1101 bytes} [Thu Jul 14 15:24:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:18.008925 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72767765-cc97-4743-9b6b-f661790a1cb9 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:18.009660 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87648b85-aaa6-4233-bddc-0e9e9b73261f None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:18.009934 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87648b85-aaa6-4233-bddc-0e9e9b73261f None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:18.010230 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87648b85-aaa6-4233-bddc-0e9e9b73261f None admin] PATH_INFO: `/v3/users/swift` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:18.021669 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87648b85-aaa6-4233-bddc-0e9e9b73261f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:18.023167 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87648b85-aaa6-4233-bddc-0e9e9b73261f None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:18.038540 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-87648b85-aaa6-4233-bddc-0e9e9b73261f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 14 15:24:18.038540 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:18.038540 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:18.038540 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:18.038540 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:18.038540 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:18.038540 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:18.038540 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:18.038540 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:18.038540 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:18.038540 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:18.038540 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:18.038540 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 15:24:18.038540 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 15:24:18.038540 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 15:24:18.038540 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 15:24:18.039783 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:18.039783 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:18.039783 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 15:24:18.039783 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:24:18.039783 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 15:24:18.039783 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:24:18.039783 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:18.039783 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:18.039783 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:18.039783 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:18.039783 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:18.039783 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:18.039783 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:18.039783 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:18.039783 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:18.039783 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:18.039783 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:18.039783 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:18.041124 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:18.041124 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:18.041124 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 15:24:18.041124 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 15:24:18.041124 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 15:24:18.041124 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 15:24:18.041124 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 15:24:18.041124 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 15:24:18.041124 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 14 15:24:18.041124 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:24:18.041124 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 416/800] 10.222.0.118 () {56 vars in 1101 bytes} [Thu Jul 14 15:24:17 2022] GET /identity/v3/users/swift => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:18.041124 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ea62a4-ccbf-41e4-9711-b5c052af138b None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:18.041777 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ea62a4-ccbf-41e4-9711-b5c052af138b None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:18.041777 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ea62a4-ccbf-41e4-9711-b5c052af138b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:18.058925 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-31ea62a4-ccbf-41e4-9711-b5c052af138b None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:18.060100 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-31ea62a4-ccbf-41e4-9711-b5c052af138b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:18.097723 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:18.130832 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72767765-cc97-4743-9b6b-f661790a1cb9 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:18.132166 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 417/801] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:24:18 2022] POST /identity/v3/auth/tokens => generated 1003 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:24:18.132837 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ea62a4-ccbf-41e4-9711-b5c052af138b None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:18.179181 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd0e3fe-725a-4943-976a-38da9f885c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:18.179854 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd0e3fe-725a-4943-976a-38da9f885c4d None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:18.180134 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd0e3fe-725a-4943-976a-38da9f885c4d None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:18.180409 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd0e3fe-725a-4943-976a-38da9f885c4d None admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:18.181500 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd0e3fe-725a-4943-976a-38da9f885c4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:18.181805 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd0e3fe-725a-4943-976a-38da9f885c4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:18.183524 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd0e3fe-725a-4943-976a-38da9f885c4d None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:18.193068 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:18.201912 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 385/802] 10.222.0.118 () {56 vars in 1114 bytes} [Thu Jul 14 15:24:18 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:18.202793 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd0e3fe-725a-4943-976a-38da9f885c4d None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:18.243856 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ea62a4-ccbf-41e4-9711-b5c052af138b None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:18.280067 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5e8b8f-e03f-4060-8395-05f85a0f3e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:18.281081 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5e8b8f-e03f-4060-8395-05f85a0f3e59 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:18.281081 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5e8b8f-e03f-4060-8395-05f85a0f3e59 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:18.281289 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5e8b8f-e03f-4060-8395-05f85a0f3e59 None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:18.282391 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5e8b8f-e03f-4060-8395-05f85a0f3e59 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:18.282705 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5e8b8f-e03f-4060-8395-05f85a0f3e59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:18.284615 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5e8b8f-e03f-4060-8395-05f85a0f3e59 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:18.297921 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 418/803] 10.222.0.118 () {56 vars in 1104 bytes} [Thu Jul 14 15:24:18 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:18.297921 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5e8b8f-e03f-4060-8395-05f85a0f3e59 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:18.318112 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd0e3fe-725a-4943-976a-38da9f885c4d None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:18.333929 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:18.353533 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e484f3-471a-442b-a178-8e9911207f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:18.354227 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e484f3-471a-442b-a178-8e9911207f85 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:18.354505 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e484f3-471a-442b-a178-8e9911207f85 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:18.354774 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e484f3-471a-442b-a178-8e9911207f85 None admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:18.355600 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e484f3-471a-442b-a178-8e9911207f85 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:18.355930 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e484f3-471a-442b-a178-8e9911207f85 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:18.357327 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e484f3-471a-442b-a178-8e9911207f85 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:18.374798 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 386/804] 10.222.0.118 () {56 vars in 1140 bytes} [Thu Jul 14 15:24:18 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 372 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:18.375594 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e484f3-471a-442b-a178-8e9911207f85 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:18.405319 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5e8b8f-e03f-4060-8395-05f85a0f3e59 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:18.432311 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:18.440315 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e84f3cc-f3fd-410b-a072-6cba2b552621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:18.441105 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e84f3cc-f3fd-410b-a072-6cba2b552621 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:18.441381 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e84f3cc-f3fd-410b-a072-6cba2b552621 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:18.441660 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e84f3cc-f3fd-410b-a072-6cba2b552621 None admin] PATH_INFO: `/v3/services/network` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:18.442344 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e84f3cc-f3fd-410b-a072-6cba2b552621 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:18.443751 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e84f3cc-f3fd-410b-a072-6cba2b552621 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:18.457515 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-1e84f3cc-f3fd-410b-a072-6cba2b552621 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 15:24:18.457515 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:18.457515 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 15:24:18.457515 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 15:24:18.457515 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 15:24:18.457515 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 15:24:18.457515 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 15:24:18.457515 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:24:18.457515 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 15:24:18.457515 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:24:18.457515 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 15:24:18.457515 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:24:18.457515 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:18.457515 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:18.457515 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:18.457515 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:18.457515 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:18.458718 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:18.458718 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:18.458718 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:18.458718 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:18.458718 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:18.458718 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:18.458718 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 15:24:18.458718 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 15:24:18.458718 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 15:24:18.458718 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 15:24:18.458718 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:18.458718 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:18.458718 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:18.458718 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:18.458718 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:18.458718 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:18.459721 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:18.459721 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:18.459721 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:18.459721 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:18.459721 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:18.459721 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:18.459721 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:18.459721 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:18.459721 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:18.459721 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:18.459721 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 15:24:18.459721 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:24:18.459721 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 15:24:18.459721 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:24:18.459721 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 419/805] 10.222.0.118 () {56 vars in 1116 bytes} [Thu Jul 14 15:24:18 2022] GET /identity/v3/services/network => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:18.460651 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e84f3cc-f3fd-410b-a072-6cba2b552621 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:18.476621 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e484f3-471a-442b-a178-8e9911207f85 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:18.510133 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7971e1b-ac4c-42d4-8eb5-af8eb808fc68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:18.510846 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7971e1b-ac4c-42d4-8eb5-af8eb808fc68 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:18.511124 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7971e1b-ac4c-42d4-8eb5-af8eb808fc68 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:18.511392 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7971e1b-ac4c-42d4-8eb5-af8eb808fc68 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:18.518340 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7971e1b-ac4c-42d4-8eb5-af8eb808fc68 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:18.519774 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7971e1b-ac4c-42d4-8eb5-af8eb808fc68 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:18.533819 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-d7971e1b-ac4c-42d4-8eb5-af8eb808fc68 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:24:18.533819 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:18.533819 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:18.533819 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:18.533819 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:18.533819 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:18.533819 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:18.533819 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:18.533819 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:18.533819 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:18.533819 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:18.533819 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:18.533819 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 15:24:18.533819 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 15:24:18.533819 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 15:24:18.534805 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 15:24:18.534805 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:18.534805 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:18.534805 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:18.534805 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:18.534805 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:18.534805 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:18.534805 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:18.534805 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:18.534805 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:18.534805 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:18.534805 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:18.534805 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:18.534805 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:18.534805 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:18.534805 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:18.534805 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:18.535684 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 15:24:18.535684 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 15:24:18.535684 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:24:18.535684 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:24:18.535684 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:24:18.535684 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:24:18.535684 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:24:18.535684 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:24:18.535684 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 387/806] 10.222.0.118 () {56 vars in 1116 bytes} [Thu Jul 14 15:24:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:18.536497 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a83846d-042e-4153-a617-07d82c81e0d3 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:18.536671 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a83846d-042e-4153-a617-07d82c81e0d3 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:18.536910 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a83846d-042e-4153-a617-07d82c81e0d3 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:18.538296 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 388/807] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:24:18 2022] GET /identity => generated 271 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:24:18.538851 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a83846d-042e-4153-a617-07d82c81e0d3 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:18.561434 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:18.565289 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e84f3cc-f3fd-410b-a072-6cba2b552621 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:18.599870 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c657777-d194-4303-b0c9-63c6a3b5b26c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:18.600647 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c657777-d194-4303-b0c9-63c6a3b5b26c None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:18.600921 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c657777-d194-4303-b0c9-63c6a3b5b26c None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:18.601191 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c657777-d194-4303-b0c9-63c6a3b5b26c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:18.611483 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c657777-d194-4303-b0c9-63c6a3b5b26c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:18.612918 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c657777-d194-4303-b0c9-63c6a3b5b26c None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:18.630011 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-2c657777-d194-4303-b0c9-63c6a3b5b26c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:18.630011 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:18.630011 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:18.630011 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:18.630011 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:18.630011 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:18.630011 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:18.630011 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:18.630011 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:18.630011 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:18.630011 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:18.630011 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:18.630011 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:24:18.630011 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:24:18.630011 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:24:18.631294 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:24:18.631294 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:18.631294 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:18.631294 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:18.631294 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:18.631294 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:18.631294 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:18.631294 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:18.631294 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:18.631294 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:18.631294 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:18.631294 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:18.631294 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:18.631294 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:18.631294 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:18.631294 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:18.631294 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:18.632343 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:24:18.632343 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:24:18.632343 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:18.632343 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:24:18.632343 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 420/808] 10.222.0.118 () {56 vars in 1113 bytes} [Thu Jul 14 15:24:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:18.632343 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c657777-d194-4303-b0c9-63c6a3b5b26c None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:18.641173 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a83846d-042e-4153-a617-07d82c81e0d3 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:18.659398 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:18.677263 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fc34b1-a9e9-4237-8121-d5796eee730b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:18.678091 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fc34b1-a9e9-4237-8121-d5796eee730b None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:18.678369 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fc34b1-a9e9-4237-8121-d5796eee730b None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:18.678643 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fc34b1-a9e9-4237-8121-d5796eee730b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:18.689242 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fc34b1-a9e9-4237-8121-d5796eee730b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:18.690827 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fc34b1-a9e9-4237-8121-d5796eee730b None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:18.707915 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-a8fc34b1-a9e9-4237-8121-d5796eee730b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:18.707915 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:18.707915 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:18.707915 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:18.707915 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:18.707915 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:18.707915 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:18.707915 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:18.707915 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:18.707915 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:18.707915 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:18.707915 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:18.707915 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:24:18.707915 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:24:18.707915 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:24:18.709068 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:24:18.709068 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:18.709068 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:18.709068 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:18.709068 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:18.709068 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:18.709068 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:18.709068 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:18.709068 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:18.709068 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:18.709068 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:18.709068 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:18.709068 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:18.709068 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:18.709068 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:18.709068 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:18.709068 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:18.710156 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:24:18.710156 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:24:18.710156 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:18.710156 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:24:18.710156 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 389/809] 10.222.0.118 () {56 vars in 1113 bytes} [Thu Jul 14 15:24:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:18.710156 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fc34b1-a9e9-4237-8121-d5796eee730b None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:18.739623 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c657777-d194-4303-b0c9-63c6a3b5b26c None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:18.774950 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e889d264-e019-4e1d-b724-0b0b4d8d9c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:18.775702 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e889d264-e019-4e1d-b724-0b0b4d8d9c96 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:18.775980 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e889d264-e019-4e1d-b724-0b0b4d8d9c96 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:18.776252 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e889d264-e019-4e1d-b724-0b0b4d8d9c96 None admin] PATH_INFO: `/v3/services` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:18.776993 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e889d264-e019-4e1d-b724-0b0b4d8d9c96 None admin] RBAC: Adding query filter params (name=network) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:18.777297 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e889d264-e019-4e1d-b724-0b0b4d8d9c96 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:18.779077 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e889d264-e019-4e1d-b724-0b0b4d8d9c96 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:18.784589 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 421/810] 10.222.0.118 () {56 vars in 1117 bytes} [Thu Jul 14 15:24:18 2022] GET /identity/v3/services?name=network => generated 125 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:18.786155 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0272c29a-d717-4889-8836-3f58a11d19b2 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:18.786441 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0272c29a-d717-4889-8836-3f58a11d19b2 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:18.786712 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0272c29a-d717-4889-8836-3f58a11d19b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:18.802754 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-0272c29a-d717-4889-8836-3f58a11d19b2 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:18.803971 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-0272c29a-d717-4889-8836-3f58a11d19b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:18.813202 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:18.815385 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fc34b1-a9e9-4237-8121-d5796eee730b None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:18.848361 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdf88df-532b-4d3f-9bd7-2330f7df29c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:18.849016 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf88df-532b-4d3f-9bd7-2330f7df29c5 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:18.849288 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf88df-532b-4d3f-9bd7-2330f7df29c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:18.849558 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf88df-532b-4d3f-9bd7-2330f7df29c5 None admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:18.850369 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdf88df-532b-4d3f-9bd7-2330f7df29c5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:18.850672 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdf88df-532b-4d3f-9bd7-2330f7df29c5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:18.852101 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdf88df-532b-4d3f-9bd7-2330f7df29c5 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:18.863948 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 390/811] 10.222.0.118 () {56 vars in 1153 bytes} [Thu Jul 14 15:24:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:18.864810 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdf88df-532b-4d3f-9bd7-2330f7df29c5 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:18.875227 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 422/812] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:24:18 2022] POST /identity/v3/auth/tokens => generated 1003 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:24:18.876061 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0272c29a-d717-4889-8836-3f58a11d19b2 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:18.899773 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:18.968946 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdf88df-532b-4d3f-9bd7-2330f7df29c5 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:18.981022 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0272c29a-d717-4889-8836-3f58a11d19b2 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:19.004086 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c7aa1b-7789-4a6f-bd13-60ebdca9a9df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:19.004804 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c7aa1b-7789-4a6f-bd13-60ebdca9a9df None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:19.005354 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c7aa1b-7789-4a6f-bd13-60ebdca9a9df None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:19.005662 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c7aa1b-7789-4a6f-bd13-60ebdca9a9df None admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:19.006478 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c7aa1b-7789-4a6f-bd13-60ebdca9a9df None admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:19.006810 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c7aa1b-7789-4a6f-bd13-60ebdca9a9df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:19.008300 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c7aa1b-7789-4a6f-bd13-60ebdca9a9df None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:19.016458 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f8e210-ac63-48a8-95a8-900e0a204352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:19.017125 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f8e210-ac63-48a8-95a8-900e0a204352 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:19.017995 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f8e210-ac63-48a8-95a8-900e0a204352 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:19.018273 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f8e210-ac63-48a8-95a8-900e0a204352 None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:19.018995 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f8e210-ac63-48a8-95a8-900e0a204352 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:19.019299 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f8e210-ac63-48a8-95a8-900e0a204352 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:19.020468 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 391/813] 10.222.0.118 () {56 vars in 1114 bytes} [Thu Jul 14 15:24:18 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:19.020657 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f8e210-ac63-48a8-95a8-900e0a204352 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:19.021273 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c7aa1b-7789-4a6f-bd13-60ebdca9a9df None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:19.036703 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 423/814] 10.222.0.118 () {56 vars in 1114 bytes} [Thu Jul 14 15:24:18 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:19.036703 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f8e210-ac63-48a8-95a8-900e0a204352 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:19.040573 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:19.121951 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:19.133148 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c7aa1b-7789-4a6f-bd13-60ebdca9a9df None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:19.140732 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f8e210-ac63-48a8-95a8-900e0a204352 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:19.166723 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302c5dfa-3d68-4817-804e-88534dd84571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:19.167387 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302c5dfa-3d68-4817-804e-88534dd84571 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:19.167667 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302c5dfa-3d68-4817-804e-88534dd84571 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:19.167942 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302c5dfa-3d68-4817-804e-88534dd84571 None admin] PATH_INFO: `/v3/services` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:19.168648 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302c5dfa-3d68-4817-804e-88534dd84571 None admin] RBAC: Adding query filter params (type=network) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:19.168953 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302c5dfa-3d68-4817-804e-88534dd84571 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:19.170354 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302c5dfa-3d68-4817-804e-88534dd84571 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:19.173820 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564b3514-85e4-4eca-92f5-b1cdf5d6d6c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:19.174743 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564b3514-85e4-4eca-92f5-b1cdf5d6d6c2 None admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:19.175029 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564b3514-85e4-4eca-92f5-b1cdf5d6d6c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:19.175277 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 392/815] 10.222.0.118 () {56 vars in 1117 bytes} [Thu Jul 14 15:24:19 2022] GET /identity/v3/services?type=network => generated 352 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:19.175422 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564b3514-85e4-4eca-92f5-b1cdf5d6d6c2 None admin] PATH_INFO: `/v3/projects/939bf9541f4a4afe86550f749d337680/users/f7ad5ae70939416e8157693e02997a58/roles/3185f450429e4bb3b5f289b615f3269b` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:19.176069 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302c5dfa-3d68-4817-804e-88534dd84571 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:19.193141 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564b3514-85e4-4eca-92f5-b1cdf5d6d6c2 None admin] RBAC: Authorizing `identity:create_grant(project_id=939bf9541f4a4afe86550f749d337680, user_id=f7ad5ae70939416e8157693e02997a58, role_id=3185f450429e4bb3b5f289b615f3269b)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:19.194631 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564b3514-85e4-4eca-92f5-b1cdf5d6d6c2 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:19.208007 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 424/816] 10.222.0.118 () {58 vars in 1444 bytes} [Thu Jul 14 15:24:19 2022] PUT /identity/v3/projects/939bf9541f4a4afe86550f749d337680/users/f7ad5ae70939416e8157693e02997a58/roles/3185f450429e4bb3b5f289b615f3269b => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:24:19.208823 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564b3514-85e4-4eca-92f5-b1cdf5d6d6c2 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:19.280964 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:19.293149 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302c5dfa-3d68-4817-804e-88534dd84571 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:19.334796 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564b3514-85e4-4eca-92f5-b1cdf5d6d6c2 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:19.335267 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa85c816-ee61-4364-b8cc-86e6e8305bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:19.336093 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa85c816-ee61-4364-b8cc-86e6e8305bed None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:19.336371 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa85c816-ee61-4364-b8cc-86e6e8305bed None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:19.336930 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa85c816-ee61-4364-b8cc-86e6e8305bed None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:19.337609 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa85c816-ee61-4364-b8cc-86e6e8305bed None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:19.340169 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa85c816-ee61-4364-b8cc-86e6e8305bed None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:19.356289 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-aa85c816-ee61-4364-b8cc-86e6e8305bed None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 15:24:19.356289 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:19.356289 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 15:24:19.356289 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 15:24:19.356289 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 15:24:19.356289 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 15:24:19.356289 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 15:24:19.356289 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:24:19.356289 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 15:24:19.356289 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:24:19.356289 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 15:24:19.356289 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:24:19.356289 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:19.356289 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:19.356289 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:19.356289 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:19.357258 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:19.357258 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:19.357258 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:19.357258 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:19.357258 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:19.357258 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:19.357258 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:19.357258 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 15:24:19.357258 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 15:24:19.357258 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 15:24:19.357258 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 15:24:19.357258 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:19.357258 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:19.357258 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:19.357258 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:19.357258 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:19.358246 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:19.358246 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:19.358246 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:19.358246 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:19.358246 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:19.358246 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:19.358246 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:19.358246 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:19.358246 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:19.358246 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:19.358246 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:19.358246 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 15:24:19.358246 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:24:19.358246 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 15:24:19.358246 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:24:19.358246 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 393/817] 10.222.0.118 () {56 vars in 1134 bytes} [Thu Jul 14 15:24:19 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:19.359256 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa85c816-ee61-4364-b8cc-86e6e8305bed None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:19.378974 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fc71c9-4eef-4b1b-a84b-a188e53a07c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:19.379780 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc71c9-4eef-4b1b-a84b-a188e53a07c7 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:19.380060 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc71c9-4eef-4b1b-a84b-a188e53a07c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:19.380599 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc71c9-4eef-4b1b-a84b-a188e53a07c7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:19.384991 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:19.388668 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fc71c9-4eef-4b1b-a84b-a188e53a07c7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:19.390210 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fc71c9-4eef-4b1b-a84b-a188e53a07c7 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:19.407312 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-b9fc71c9-4eef-4b1b-a84b-a188e53a07c7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 15:24:19.407312 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:19.407312 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:19.407312 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:19.407312 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:19.407312 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:19.407312 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:19.407312 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:19.407312 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:19.407312 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:19.407312 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:19.407312 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:19.407312 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 15:24:19.407312 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 15:24:19.407312 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 15:24:19.407312 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 15:24:19.408527 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:19.408527 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:19.408527 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 15:24:19.408527 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:24:19.408527 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 15:24:19.408527 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:24:19.408527 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:19.408527 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:19.408527 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:19.408527 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:19.408527 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:19.408527 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:19.408527 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:19.408527 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:19.408527 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:19.408527 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:19.408527 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:19.408527 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:19.409456 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:19.409456 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:19.409456 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 15:24:19.409456 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 15:24:19.409456 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 15:24:19.409456 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 15:24:19.409456 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 15:24:19.409456 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 15:24:19.409456 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 15:24:19.409456 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:24:19.409456 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 425/818] 10.222.0.118 () {56 vars in 1098 bytes} [Thu Jul 14 15:24:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:19.410073 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fc71c9-4eef-4b1b-a84b-a188e53a07c7 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:19.503554 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa85c816-ee61-4364-b8cc-86e6e8305bed None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:19.531595 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fc71c9-4eef-4b1b-a84b-a188e53a07c7 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:19.537741 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5273d6f-3149-42a1-80fb-c3acce7c8d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:19.538575 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5273d6f-3149-42a1-80fb-c3acce7c8d47 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:19.538851 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5273d6f-3149-42a1-80fb-c3acce7c8d47 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:19.539122 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5273d6f-3149-42a1-80fb-c3acce7c8d47 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:19.546162 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5273d6f-3149-42a1-80fb-c3acce7c8d47 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:19.547554 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5273d6f-3149-42a1-80fb-c3acce7c8d47 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:19.550090 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:19.562423 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-f5273d6f-3149-42a1-80fb-c3acce7c8d47 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:24:19.562423 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:19.562423 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:19.562423 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:19.562423 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:19.562423 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:19.562423 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:19.562423 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:19.562423 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:19.562423 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:19.562423 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:19.562423 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:19.562423 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 15:24:19.562423 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 15:24:19.562423 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 15:24:19.563561 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 15:24:19.563561 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:19.563561 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:19.563561 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:19.563561 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:19.563561 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:19.563561 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:19.563561 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:19.563561 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:19.563561 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:19.563561 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:19.563561 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:19.563561 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:19.563561 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:19.563561 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:19.563561 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:19.563561 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:19.565265 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 15:24:19.565265 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 15:24:19.565265 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:24:19.565265 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:24:19.565265 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:24:19.565265 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:24:19.565265 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:24:19.565265 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:24:19.569078 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 394/819] 10.222.0.118 () {56 vars in 1116 bytes} [Thu Jul 14 15:24:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:19.569908 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5273d6f-3149-42a1-80fb-c3acce7c8d47 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:19.575834 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534acfe7-3d2e-40db-9ee7-67b045ef8391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:19.576491 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534acfe7-3d2e-40db-9ee7-67b045ef8391 None admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:19.576766 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534acfe7-3d2e-40db-9ee7-67b045ef8391 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:19.577034 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534acfe7-3d2e-40db-9ee7-67b045ef8391 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:19.577777 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534acfe7-3d2e-40db-9ee7-67b045ef8391 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:19.579167 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534acfe7-3d2e-40db-9ee7-67b045ef8391 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:19.602022 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 426/820] 10.222.0.118 () {60 vars in 1149 bytes} [Thu Jul 14 15:24:19 2022] POST /identity/v3/endpoints => generated 329 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:24:19.603146 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534acfe7-3d2e-40db-9ee7-67b045ef8391 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:19.676112 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:19.702811 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5273d6f-3149-42a1-80fb-c3acce7c8d47 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:19.757015 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af12928a-41da-458f-b570-15ace5bb3fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:19.757822 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af12928a-41da-458f-b570-15ace5bb3fc2 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:19.758178 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af12928a-41da-458f-b570-15ace5bb3fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:19.758528 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af12928a-41da-458f-b570-15ace5bb3fc2 None admin] PATH_INFO: `/v3/services` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:19.759263 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af12928a-41da-458f-b570-15ace5bb3fc2 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:19.759575 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af12928a-41da-458f-b570-15ace5bb3fc2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:19.761126 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af12928a-41da-458f-b570-15ace5bb3fc2 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:19.762298 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534acfe7-3d2e-40db-9ee7-67b045ef8391 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:19.767414 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 395/821] 10.222.0.118 () {56 vars in 1129 bytes} [Thu Jul 14 15:24:19 2022] GET /identity/v3/services?name=block-storage => generated 131 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:19.768397 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af12928a-41da-458f-b570-15ace5bb3fc2 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:19.802424 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abbb308-3560-4c7f-b385-fa27e387c9cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:19.803030 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abbb308-3560-4c7f-b385-fa27e387c9cd None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:19.803297 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abbb308-3560-4c7f-b385-fa27e387c9cd None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:19.803567 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abbb308-3560-4c7f-b385-fa27e387c9cd None admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:19.804410 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abbb308-3560-4c7f-b385-fa27e387c9cd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:19.804714 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abbb308-3560-4c7f-b385-fa27e387c9cd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:19.806439 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abbb308-3560-4c7f-b385-fa27e387c9cd None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:19.824318 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 427/822] 10.222.0.118 () {56 vars in 1138 bytes} [Thu Jul 14 15:24:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:19.825159 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abbb308-3560-4c7f-b385-fa27e387c9cd None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:19.859312 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:19.897823 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af12928a-41da-458f-b570-15ace5bb3fc2 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:19.940465 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee37b6fc-49c8-4f11-a0de-d2bb7edd1e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:19.941249 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee37b6fc-49c8-4f11-a0de-d2bb7edd1e1e None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:19.941599 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee37b6fc-49c8-4f11-a0de-d2bb7edd1e1e None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:19.941981 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee37b6fc-49c8-4f11-a0de-d2bb7edd1e1e None admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:19.942836 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee37b6fc-49c8-4f11-a0de-d2bb7edd1e1e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:19.943215 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee37b6fc-49c8-4f11-a0de-d2bb7edd1e1e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:19.944752 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee37b6fc-49c8-4f11-a0de-d2bb7edd1e1e None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:19.951382 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abbb308-3560-4c7f-b385-fa27e387c9cd None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:19.952315 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:19.964639 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 396/823] 10.222.0.118 () {56 vars in 1153 bytes} [Thu Jul 14 15:24:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:19.965629 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee37b6fc-49c8-4f11-a0de-d2bb7edd1e1e None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:19.999151 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eae29f-9721-46a8-ada1-83f317561f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:19.999908 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eae29f-9721-46a8-ada1-83f317561f3e None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:20.000342 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eae29f-9721-46a8-ada1-83f317561f3e None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:20.000706 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eae29f-9721-46a8-ada1-83f317561f3e None admin] PATH_INFO: `/v3/services` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:20.001527 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eae29f-9721-46a8-ada1-83f317561f3e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:20.001852 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eae29f-9721-46a8-ada1-83f317561f3e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:20.003263 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eae29f-9721-46a8-ada1-83f317561f3e None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:20.009850 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 428/824] 10.222.0.118 () {56 vars in 1129 bytes} [Thu Jul 14 15:24:19 2022] GET /identity/v3/services?type=block-storage => generated 369 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:20.010605 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eae29f-9721-46a8-ada1-83f317561f3e None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:20.075048 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee37b6fc-49c8-4f11-a0de-d2bb7edd1e1e None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:20.099916 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:20.112633 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b50a3da-5e6a-4f85-8bce-a864bdf8c770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:20.112844 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eae29f-9721-46a8-ada1-83f317561f3e None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:20.113286 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b50a3da-5e6a-4f85-8bce-a864bdf8c770 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:20.113565 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b50a3da-5e6a-4f85-8bce-a864bdf8c770 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:20.113925 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b50a3da-5e6a-4f85-8bce-a864bdf8c770 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:20.153656 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74412a4-d4bc-4926-bd58-c5a37e7c6b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:20.154692 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74412a4-d4bc-4926-bd58-c5a37e7c6b7b None admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:20.155035 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74412a4-d4bc-4926-bd58-c5a37e7c6b7b None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:20.155315 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74412a4-d4bc-4926-bd58-c5a37e7c6b7b None admin] PATH_INFO: `/v3/projects/939bf9541f4a4afe86550f749d337680/users/b672a6a601584d2d826147069e90a10f/roles/3b880cef7dcf4baf87b50f8610c0c56e` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:20.157513 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74412a4-d4bc-4926-bd58-c5a37e7c6b7b None admin] RBAC: Authorizing `identity:create_grant(project_id=939bf9541f4a4afe86550f749d337680, user_id=b672a6a601584d2d826147069e90a10f, role_id=3b880cef7dcf4baf87b50f8610c0c56e)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:20.159702 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74412a4-d4bc-4926-bd58-c5a37e7c6b7b None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:20.177213 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 429/825] 10.222.0.118 () {58 vars in 1444 bytes} [Thu Jul 14 15:24:20 2022] PUT /identity/v3/projects/939bf9541f4a4afe86550f749d337680/users/b672a6a601584d2d826147069e90a10f/roles/3b880cef7dcf4baf87b50f8610c0c56e => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:24:20.178149 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74412a4-d4bc-4926-bd58-c5a37e7c6b7b None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:20.198878 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:20.203490 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b50a3da-5e6a-4f85-8bce-a864bdf8c770 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:20.206291 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b50a3da-5e6a-4f85-8bce-a864bdf8c770 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:20.334222 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 397/826] 10.222.0.118 () {58 vars in 1287 bytes} [Thu Jul 14 15:24:19 2022] GET /identity/v3/auth/tokens => generated 1153 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 15:24:20.339759 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b50a3da-5e6a-4f85-8bce-a864bdf8c770 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:20.449436 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74412a4-d4bc-4926-bd58-c5a37e7c6b7b None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:20.460822 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:20.467059 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b50a3da-5e6a-4f85-8bce-a864bdf8c770 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:20.502308 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c98d76-31b0-4346-9eb4-20e311107355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:20.502981 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c98d76-31b0-4346-9eb4-20e311107355 None admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:20.503259 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c98d76-31b0-4346-9eb4-20e311107355 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:20.503551 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c98d76-31b0-4346-9eb4-20e311107355 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:20.504287 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c98d76-31b0-4346-9eb4-20e311107355 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:20.505897 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c98d76-31b0-4346-9eb4-20e311107355 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:20.506984 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec72a612-d3f2-4ef4-bf74-1f14a76347d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:20.508015 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec72a612-d3f2-4ef4-bf74-1f14a76347d4 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:20.508511 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec72a612-d3f2-4ef4-bf74-1f14a76347d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:20.508996 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec72a612-d3f2-4ef4-bf74-1f14a76347d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:20.521899 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec72a612-d3f2-4ef4-bf74-1f14a76347d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:20.523845 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec72a612-d3f2-4ef4-bf74-1f14a76347d4 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:20.528360 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 430/827] 10.222.0.118 () {60 vars in 1149 bytes} [Thu Jul 14 15:24:20 2022] POST /identity/v3/endpoints => generated 348 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:24:20.546993 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-ec72a612-d3f2-4ef4-bf74-1f14a76347d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:20.546993 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:20.546993 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:20.546993 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:20.546993 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:20.546993 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:20.546993 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:20.546993 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:20.546993 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:20.546993 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:20.546993 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:20.546993 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:20.546993 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:24:20.546993 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:24:20.546993 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:24:20.548182 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:24:20.548182 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:20.548182 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:20.548182 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:20.548182 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:20.548182 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:20.548182 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:20.548182 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:20.548182 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:20.548182 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:20.548182 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:20.548182 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:20.548182 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:20.548182 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:20.548182 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:20.548182 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:20.548182 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:20.549392 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:24:20.549392 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:24:20.549392 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:20.549392 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:24:20.551960 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 398/828] 10.222.0.118 () {56 vars in 1113 bytes} [Thu Jul 14 15:24:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:20.558150 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c98d76-31b0-4346-9eb4-20e311107355 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:20.561887 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:20.676427 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c98d76-31b0-4346-9eb4-20e311107355 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:20.716064 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76e7817-6c4f-4b22-83b1-ad96cf9f6b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:20.716736 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76e7817-6c4f-4b22-83b1-ad96cf9f6b88 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:20.717015 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76e7817-6c4f-4b22-83b1-ad96cf9f6b88 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:20.717291 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76e7817-6c4f-4b22-83b1-ad96cf9f6b88 None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:20.718134 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76e7817-6c4f-4b22-83b1-ad96cf9f6b88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:20.718441 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76e7817-6c4f-4b22-83b1-ad96cf9f6b88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:20.719831 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76e7817-6c4f-4b22-83b1-ad96cf9f6b88 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:20.733258 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 431/829] 10.222.0.118 () {56 vars in 1114 bytes} [Thu Jul 14 15:24:20 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:20.739424 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec72a612-d3f2-4ef4-bf74-1f14a76347d4 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:20.842577 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec72a612-d3f2-4ef4-bf74-1f14a76347d4 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:20.877393 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a4fc81-551d-49ab-99fb-249aa7c164c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:20.878217 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a4fc81-551d-49ab-99fb-249aa7c164c7 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:20.878493 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a4fc81-551d-49ab-99fb-249aa7c164c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:20.878758 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a4fc81-551d-49ab-99fb-249aa7c164c7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:20.885891 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a4fc81-551d-49ab-99fb-249aa7c164c7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:20.887360 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a4fc81-551d-49ab-99fb-249aa7c164c7 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:20.901317 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-c9a4fc81-551d-49ab-99fb-249aa7c164c7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:24:20.901317 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:20.901317 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:20.901317 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:20.901317 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:20.901317 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:20.901317 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:20.901317 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:20.901317 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:20.901317 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:20.901317 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:20.901317 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:20.901317 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 15:24:20.901317 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 15:24:20.901317 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 15:24:20.902274 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 15:24:20.902274 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:20.902274 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:20.902274 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:20.902274 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:20.902274 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:20.902274 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:20.902274 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:20.902274 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:20.902274 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:20.902274 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:20.902274 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:20.902274 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:20.902274 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:20.902274 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:20.902274 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:20.902274 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:20.903534 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 15:24:20.903534 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 15:24:20.903534 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:24:20.903534 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:24:20.903534 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:24:20.903534 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:24:20.903534 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:24:20.903534 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:24:20.903534 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 399/830] 10.222.0.118 () {56 vars in 1116 bytes} [Thu Jul 14 15:24:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:20.908611 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76e7817-6c4f-4b22-83b1-ad96cf9f6b88 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:20.969700 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:21.012119 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76e7817-6c4f-4b22-83b1-ad96cf9f6b88 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:21.047031 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c04b5f9-ed43-4470-8f55-45b2e1851308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:21.047696 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c04b5f9-ed43-4470-8f55-45b2e1851308 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:21.047976 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c04b5f9-ed43-4470-8f55-45b2e1851308 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:21.048245 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c04b5f9-ed43-4470-8f55-45b2e1851308 None admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:21.049070 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c04b5f9-ed43-4470-8f55-45b2e1851308 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:21.049378 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c04b5f9-ed43-4470-8f55-45b2e1851308 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:21.052366 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c04b5f9-ed43-4470-8f55-45b2e1851308 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:21.069648 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 432/831] 10.222.0.118 () {56 vars in 1153 bytes} [Thu Jul 14 15:24:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:21.075259 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a4fc81-551d-49ab-99fb-249aa7c164c7 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:21.089136 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:21.181669 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a4fc81-551d-49ab-99fb-249aa7c164c7 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:21.216994 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02678361-8bca-4ea6-a7df-d0efb39e4c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:21.218027 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02678361-8bca-4ea6-a7df-d0efb39e4c17 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:21.218542 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02678361-8bca-4ea6-a7df-d0efb39e4c17 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:21.219016 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02678361-8bca-4ea6-a7df-d0efb39e4c17 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:21.220113 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02678361-8bca-4ea6-a7df-d0efb39e4c17 None admin] RBAC: Adding query filter params (role.id=3b880cef7dcf4baf87b50f8610c0c56e, scope.project.id=939bf9541f4a4afe86550f749d337680, user.id=f0177fc696ea40069902803da09f437c) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:21.220725 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02678361-8bca-4ea6-a7df-d0efb39e4c17 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:21.222390 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02678361-8bca-4ea6-a7df-d0efb39e4c17 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:21.229098 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 400/832] 10.222.0.118 () {56 vars in 1379 bytes} [Thu Jul 14 15:24:21 2022] GET /identity/v3/role_assignments?user.id=f0177fc696ea40069902803da09f437c&scope.project.id=939bf9541f4a4afe86550f749d337680&role.id=3b880cef7dcf4baf87b50f8610c0c56e => generated 610 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:21.352823 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4c3576-fb30-47dc-a5de-43682682da06 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:21.353376 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4c3576-fb30-47dc-a5de-43682682da06 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:21.353376 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4c3576-fb30-47dc-a5de-43682682da06 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:21.355063 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 433/833] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:24:21 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:24:21.360583 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e951a62-55b5-4a38-9062-8917c670c116 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:21.360921 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e951a62-55b5-4a38-9062-8917c670c116 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:21.361167 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e951a62-55b5-4a38-9062-8917c670c116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:21.379426 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-5e951a62-55b5-4a38-9062-8917c670c116 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:21.380962 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-5e951a62-55b5-4a38-9062-8917c670c116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:21.454664 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 401/834] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:24:21 2022] POST /identity/v3/auth/tokens => generated 1153 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:24:21.479006 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4c3576-fb30-47dc-a5de-43682682da06 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:21.587865 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4c3576-fb30-47dc-a5de-43682682da06 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:21.614070 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:21.629943 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d570da11-588d-453d-b238-e73619fdd43c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:21.631024 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d570da11-588d-453d-b238-e73619fdd43c None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:21.631303 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d570da11-588d-453d-b238-e73619fdd43c None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:21.631576 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d570da11-588d-453d-b238-e73619fdd43c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:21.642374 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d570da11-588d-453d-b238-e73619fdd43c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:24:21.650076 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-d570da11-588d-453d-b238-e73619fdd43c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:24:21.650076 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:21.650076 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:21.650076 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:21.650076 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:21.650076 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:21.650076 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:21.650076 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:21.650076 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:21.650076 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:21.650076 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:21.650076 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:21.650076 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:24:21.650076 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:24:21.650076 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:24:21.650076 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:24:21.651013 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:24:21.651013 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:24:21.651013 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:24:21.651013 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:24:21.651013 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:21.651013 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:21.651013 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:21.651013 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:21.651013 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:21.651013 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:21.651013 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:21.651013 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:21.651013 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:21.651013 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:21.651013 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:21.651013 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:21.651829 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:21.651829 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:21.651829 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:21.651829 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:21.651829 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:24:21.651829 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:24:21.651829 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:24:21.651829 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:24:21.651829 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:24:21.651829 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:24:21.651829 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:24:21.651829 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:24:21.651829 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 434/835] 10.222.0.118 () {56 vars in 1107 bytes} [Thu Jul 14 15:24:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:21.659308 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e951a62-55b5-4a38-9062-8917c670c116 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:21.663774 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:21.771355 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e951a62-55b5-4a38-9062-8917c670c116 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:21.806238 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e60c56-c4be-4756-b366-70fac69a1a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:21.806907 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e60c56-c4be-4756-b366-70fac69a1a18 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:21.807183 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e60c56-c4be-4756-b366-70fac69a1a18 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:21.807453 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e60c56-c4be-4756-b366-70fac69a1a18 None admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:21.808202 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e60c56-c4be-4756-b366-70fac69a1a18 None admin] RBAC: Adding query filter params (name=service) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:21.808507 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e60c56-c4be-4756-b366-70fac69a1a18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:21.809873 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e60c56-c4be-4756-b366-70fac69a1a18 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:21.819248 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 402/836] 10.222.0.118 () {56 vars in 1108 bytes} [Thu Jul 14 15:24:21 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:21.824683 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d570da11-588d-453d-b238-e73619fdd43c None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:21.929807 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d570da11-588d-453d-b238-e73619fdd43c None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:21.964729 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a81a26-2ea8-48de-af08-2df382a50999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:21.965876 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a81a26-2ea8-48de-af08-2df382a50999 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:21.966458 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a81a26-2ea8-48de-af08-2df382a50999 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:21.966932 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a81a26-2ea8-48de-af08-2df382a50999 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:21.983178 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a81a26-2ea8-48de-af08-2df382a50999 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:21.984710 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a81a26-2ea8-48de-af08-2df382a50999 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:22.002682 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-b4a81a26-2ea8-48de-af08-2df382a50999 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:22.002682 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:22.002682 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:22.002682 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:22.002682 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:22.002682 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:22.002682 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:22.002682 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:22.002682 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:22.002682 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:22.002682 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:22.002682 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:22.002682 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:24:22.002682 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:24:22.002682 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:24:22.003600 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:24:22.003600 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:22.003600 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:22.003600 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:22.003600 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:22.003600 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:22.003600 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:22.003600 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:22.003600 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:22.003600 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:22.003600 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:22.003600 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:22.003600 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:22.003600 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:22.003600 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:22.003600 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:22.003600 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:22.004472 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:24:22.004472 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:24:22.004472 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:22.004472 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:24:22.004472 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 435/837] 10.222.0.118 () {56 vars in 1113 bytes} [Thu Jul 14 15:24:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:22.011218 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e60c56-c4be-4756-b366-70fac69a1a18 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:22.086415 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:22.116505 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e60c56-c4be-4756-b366-70fac69a1a18 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:22.150671 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9951ab-6360-46b3-85c1-110bf4b435b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:22.151332 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9951ab-6360-46b3-85c1-110bf4b435b2 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:22.151607 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9951ab-6360-46b3-85c1-110bf4b435b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:22.151876 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9951ab-6360-46b3-85c1-110bf4b435b2 None admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:22.152590 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9951ab-6360-46b3-85c1-110bf4b435b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:22.152892 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9951ab-6360-46b3-85c1-110bf4b435b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:22.154447 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9951ab-6360-46b3-85c1-110bf4b435b2 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:22.168081 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 403/838] 10.222.0.118 () {56 vars in 1114 bytes} [Thu Jul 14 15:24:22 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:22.174160 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a81a26-2ea8-48de-af08-2df382a50999 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:22.207542 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:22.289110 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a81a26-2ea8-48de-af08-2df382a50999 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:22.324314 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21a6cc0-1012-4f5e-9c5a-38409907bce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:22.325473 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a6cc0-1012-4f5e-9c5a-38409907bce0 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:22.325954 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a6cc0-1012-4f5e-9c5a-38409907bce0 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:22.326472 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a6cc0-1012-4f5e-9c5a-38409907bce0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:22.335261 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21a6cc0-1012-4f5e-9c5a-38409907bce0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:22.336736 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21a6cc0-1012-4f5e-9c5a-38409907bce0 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:22.352073 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-b21a6cc0-1012-4f5e-9c5a-38409907bce0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 15:24:22.352073 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:22.352073 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:22.352073 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:22.352073 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:22.352073 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:22.352073 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:22.352073 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:22.352073 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:22.352073 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:22.352073 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:22.352073 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:22.352073 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 15:24:22.352073 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 15:24:22.352073 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 15:24:22.352073 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 15:24:22.353469 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:22.353469 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:22.353469 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 15:24:22.353469 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:24:22.353469 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 15:24:22.353469 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:24:22.353469 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:22.353469 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:22.353469 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:22.353469 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:22.353469 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:22.353469 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:22.353469 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:22.353469 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:22.353469 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:22.353469 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:22.353469 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:22.353469 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:22.354448 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:22.354448 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:22.354448 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 15:24:22.354448 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 15:24:22.354448 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 15:24:22.354448 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 15:24:22.354448 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 15:24:22.354448 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 15:24:22.354448 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 15:24:22.354448 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:24:22.354448 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 436/839] 10.222.0.118 () {56 vars in 1122 bytes} [Thu Jul 14 15:24:22 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:22.363085 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9951ab-6360-46b3-85c1-110bf4b435b2 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:22.451878 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040d20a1-ecd9-4e08-a42f-a4600253a895 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:22.452194 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040d20a1-ecd9-4e08-a42f-a4600253a895 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:22.452435 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040d20a1-ecd9-4e08-a42f-a4600253a895 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:22.453940 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 437/840] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:24:22 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:24:22.465743 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9396effb-8cd8-4449-8ee7-b79c3a351ab6 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:22.466063 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9396effb-8cd8-4449-8ee7-b79c3a351ab6 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:22.466331 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9396effb-8cd8-4449-8ee7-b79c3a351ab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:22.476797 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9951ab-6360-46b3-85c1-110bf4b435b2 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:22.487685 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-9396effb-8cd8-4449-8ee7-b79c3a351ab6 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:22.489072 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-9396effb-8cd8-4449-8ee7-b79c3a351ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:22.506542 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:22.516942 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0b9659-81b2-44cf-bb3f-71c0b5ffc1ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:22.518725 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0b9659-81b2-44cf-bb3f-71c0b5ffc1ef None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:22.519160 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0b9659-81b2-44cf-bb3f-71c0b5ffc1ef None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:22.519773 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0b9659-81b2-44cf-bb3f-71c0b5ffc1ef None admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:22.521113 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0b9659-81b2-44cf-bb3f-71c0b5ffc1ef None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:22.521854 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0b9659-81b2-44cf-bb3f-71c0b5ffc1ef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:22.523653 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0b9659-81b2-44cf-bb3f-71c0b5ffc1ef None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:22.545557 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 404/841] 10.222.0.118 () {56 vars in 1154 bytes} [Thu Jul 14 15:24:22 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 386 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:22.551185 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0b9659-81b2-44cf-bb3f-71c0b5ffc1ef None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:22.580624 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 438/842] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:24:22 2022] POST /identity/v3/auth/tokens => generated 1153 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:24:22.606155 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9396effb-8cd8-4449-8ee7-b79c3a351ab6 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:22.632596 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:22.677592 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0b9659-81b2-44cf-bb3f-71c0b5ffc1ef None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:22.714740 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8983641-9ab7-4489-8a09-b23d189c7868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:22.715846 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8983641-9ab7-4489-8a09-b23d189c7868 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:22.715975 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8983641-9ab7-4489-8a09-b23d189c7868 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:22.716337 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8983641-9ab7-4489-8a09-b23d189c7868 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:22.722110 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9396effb-8cd8-4449-8ee7-b79c3a351ab6 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:22.763201 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41ea94f-2cca-4950-8539-bb24ed1a2769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:22.764303 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41ea94f-2cca-4950-8539-bb24ed1a2769 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:22.764769 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41ea94f-2cca-4950-8539-bb24ed1a2769 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:22.765192 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41ea94f-2cca-4950-8539-bb24ed1a2769 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:22.775158 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:22.778255 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41ea94f-2cca-4950-8539-bb24ed1a2769 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:24:22.786043 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-a41ea94f-2cca-4950-8539-bb24ed1a2769 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:24:22.786043 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:22.786043 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:22.786043 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:22.786043 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:22.786043 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:22.786043 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:22.786043 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:22.786043 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:22.786043 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:22.786043 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:22.786043 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:22.786043 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:24:22.786043 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:24:22.786043 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:24:22.786043 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:24:22.786929 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:24:22.786929 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:24:22.786929 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:24:22.786929 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:24:22.786929 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:22.786929 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:22.786929 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:22.786929 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:22.786929 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:22.786929 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:22.786929 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:22.786929 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:22.786929 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:22.786929 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:22.786929 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:22.786929 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:22.787738 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:22.787738 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:22.787738 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:22.787738 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:22.787738 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:24:22.787738 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:24:22.787738 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:24:22.787738 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:24:22.787738 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:24:22.787738 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:24:22.787738 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:24:22.787738 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:24:22.787738 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 439/843] 10.222.0.118 () {56 vars in 1101 bytes} [Thu Jul 14 15:24:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:24:22.788967 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5882e9e3-69d8-42db-bb96-4e86d70edc34 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:22.788967 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5882e9e3-69d8-42db-bb96-4e86d70edc34 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:22.789135 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5882e9e3-69d8-42db-bb96-4e86d70edc34 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:22.790447 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 440/844] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:24:22 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:24:22.795418 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b3b3f-225f-450b-90a7-6ad4c2dbac57 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:22.795705 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b3b3f-225f-450b-90a7-6ad4c2dbac57 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:22.795983 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b3b3f-225f-450b-90a7-6ad4c2dbac57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:22.798836 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8983641-9ab7-4489-8a09-b23d189c7868 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:22.800302 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8983641-9ab7-4489-8a09-b23d189c7868 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:22.812852 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-073b3b3f-225f-450b-90a7-6ad4c2dbac57 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:22.814606 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-073b3b3f-225f-450b-90a7-6ad4c2dbac57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:22.885425 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 441/845] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:24:22 2022] POST /identity/v3/auth/tokens => generated 1153 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 15:24:22.886307 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073b3b3f-225f-450b-90a7-6ad4c2dbac57 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:22.908739 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:22.915395 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 405/846] 10.222.0.118 () {58 vars in 1287 bytes} [Thu Jul 14 15:24:22 2022] GET /identity/v3/auth/tokens => generated 1153 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 14 15:24:22.918844 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8983641-9ab7-4489-8a09-b23d189c7868 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:23.005414 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073b3b3f-225f-450b-90a7-6ad4c2dbac57 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:23.009308 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:23.028142 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8983641-9ab7-4489-8a09-b23d189c7868 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:23.044620 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6af9118-f1ee-4212-bb19-ff1d91de13ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:23.045292 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6af9118-f1ee-4212-bb19-ff1d91de13ea None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:23.045571 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6af9118-f1ee-4212-bb19-ff1d91de13ea None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:23.045848 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6af9118-f1ee-4212-bb19-ff1d91de13ea None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:23.046644 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6af9118-f1ee-4212-bb19-ff1d91de13ea None admin] RBAC: Adding query filter params (name=admin) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:23.047058 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6af9118-f1ee-4212-bb19-ff1d91de13ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:23.048846 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6af9118-f1ee-4212-bb19-ff1d91de13ea None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:23.062806 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 442/847] 10.222.0.118 () {56 vars in 1104 bytes} [Thu Jul 14 15:24:22 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:23.062806 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6af9118-f1ee-4212-bb19-ff1d91de13ea None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:23.067272 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030923e1-3c3d-46e9-a7a2-39f1f5d2e789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:23.068078 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030923e1-3c3d-46e9-a7a2-39f1f5d2e789 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:23.068356 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030923e1-3c3d-46e9-a7a2-39f1f5d2e789 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:23.068626 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030923e1-3c3d-46e9-a7a2-39f1f5d2e789 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:23.069278 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030923e1-3c3d-46e9-a7a2-39f1f5d2e789 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:23.070682 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030923e1-3c3d-46e9-a7a2-39f1f5d2e789 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:23.082777 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-030923e1-3c3d-46e9-a7a2-39f1f5d2e789 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 15:24:23.082777 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:23.082777 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 15:24:23.082777 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 15:24:23.082777 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 15:24:23.082777 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 15:24:23.082777 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 15:24:23.082777 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:24:23.082777 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 15:24:23.082777 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:24:23.082777 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 15:24:23.082777 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:24:23.082777 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:23.082777 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:23.082777 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:23.082777 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:23.082777 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:23.083788 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:23.083788 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:23.083788 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:23.083788 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:23.083788 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:23.083788 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:23.083788 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 15:24:23.083788 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 15:24:23.083788 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 15:24:23.083788 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 15:24:23.083788 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:23.083788 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:23.083788 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:23.083788 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:23.083788 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:23.083788 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:23.084635 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:23.084635 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:23.084635 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:23.084635 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:23.084635 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:23.084635 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:23.084635 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:23.084635 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:23.084635 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:23.084635 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:23.084635 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 15:24:23.084635 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:24:23.084635 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 15:24:23.084635 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:24:23.088796 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 406/848] 10.222.0.118 () {56 vars in 1119 bytes} [Thu Jul 14 15:24:22 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:23.089637 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030923e1-3c3d-46e9-a7a2-39f1f5d2e789 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:23.152921 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:23.181558 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6af9118-f1ee-4212-bb19-ff1d91de13ea None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:23.199268 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030923e1-3c3d-46e9-a7a2-39f1f5d2e789 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:23.216526 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b7a5a5-4e2d-4b5f-bd55-1dfeaa0f678c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:23.217313 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b7a5a5-4e2d-4b5f-bd55-1dfeaa0f678c None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:23.217589 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b7a5a5-4e2d-4b5f-bd55-1dfeaa0f678c None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:23.217859 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b7a5a5-4e2d-4b5f-bd55-1dfeaa0f678c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:23.229285 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b7a5a5-4e2d-4b5f-bd55-1dfeaa0f678c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:23.230748 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b7a5a5-4e2d-4b5f-bd55-1dfeaa0f678c None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:23.234399 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac92214d-1097-4640-94c4-84bd704607fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:23.235194 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac92214d-1097-4640-94c4-84bd704607fc None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:23.235473 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac92214d-1097-4640-94c4-84bd704607fc None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:23.236277 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac92214d-1097-4640-94c4-84bd704607fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:23.248743 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-a2b7a5a5-4e2d-4b5f-bd55-1dfeaa0f678c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:23.248743 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:23.248743 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:23.248743 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:23.248743 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:23.248743 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:23.248743 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:23.248743 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:23.248743 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:23.248743 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:23.248743 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:23.248743 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:23.248743 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:24:23.248743 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:24:23.248743 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:24:23.249715 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:24:23.249715 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:23.249715 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:23.249715 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:23.249715 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:23.249715 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:23.249715 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:23.249715 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:23.249715 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:23.249715 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:23.249715 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:23.249715 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:23.249715 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:23.249715 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:23.249715 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:23.249715 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:23.249715 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:23.256539 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:24:23.256539 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:24:23.256539 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:23.256539 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:24:23.256539 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 443/849] 10.222.0.118 () {56 vars in 1113 bytes} [Thu Jul 14 15:24:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:23.256539 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b7a5a5-4e2d-4b5f-bd55-1dfeaa0f678c None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:23.363549 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac92214d-1097-4640-94c4-84bd704607fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:23.365012 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac92214d-1097-4640-94c4-84bd704607fc None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:23.365206 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b7a5a5-4e2d-4b5f-bd55-1dfeaa0f678c None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:23.373758 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:23.384866 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-ac92214d-1097-4640-94c4-84bd704607fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:23.384866 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:23.384866 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:23.384866 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:23.384866 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:23.384866 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:23.384866 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:23.384866 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:23.384866 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:23.384866 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:23.384866 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:23.384866 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:23.384866 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:24:23.384866 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:24:23.384866 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:24:23.385950 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:24:23.385950 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:23.385950 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:23.385950 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:23.385950 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:23.385950 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:23.385950 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:23.385950 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:23.385950 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:23.385950 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:23.385950 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:23.385950 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:23.385950 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:23.385950 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:23.385950 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:23.385950 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:23.385950 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:23.386867 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:24:23.386867 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:24:23.386867 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:23.386867 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:24:23.389096 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 407/850] 10.222.0.118 () {56 vars in 1113 bytes} [Thu Jul 14 15:24:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:23.389815 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac92214d-1097-4640-94c4-84bd704607fc None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:23.398612 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:23.409465 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfd17db-1d76-430b-8c25-e144d5a20ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:23.410099 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd17db-1d76-430b-8c25-e144d5a20ed2 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:23.410376 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd17db-1d76-430b-8c25-e144d5a20ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:23.410654 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd17db-1d76-430b-8c25-e144d5a20ed2 None admin] PATH_INFO: `/v3/services` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:23.411370 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfd17db-1d76-430b-8c25-e144d5a20ed2 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:23.411677 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfd17db-1d76-430b-8c25-e144d5a20ed2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:23.413046 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfd17db-1d76-430b-8c25-e144d5a20ed2 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:23.421956 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 444/851] 10.222.0.118 () {56 vars in 1119 bytes} [Thu Jul 14 15:24:23 2022] GET /identity/v3/services?name=volumev3 => generated 126 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:23.421956 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfd17db-1d76-430b-8c25-e144d5a20ed2 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:23.497660 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac92214d-1097-4640-94c4-84bd704607fc None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:23.530205 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfd17db-1d76-430b-8c25-e144d5a20ed2 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:23.530512 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0bb893-99ee-434a-b1b4-cc8bef6f105e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:23.531168 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0bb893-99ee-434a-b1b4-cc8bef6f105e None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:23.531443 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0bb893-99ee-434a-b1b4-cc8bef6f105e None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:23.531710 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0bb893-99ee-434a-b1b4-cc8bef6f105e None admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:23.532417 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0bb893-99ee-434a-b1b4-cc8bef6f105e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:23.533269 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0bb893-99ee-434a-b1b4-cc8bef6f105e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:23.534654 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0bb893-99ee-434a-b1b4-cc8bef6f105e None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:23.545514 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 408/852] 10.222.0.118 () {56 vars in 1114 bytes} [Thu Jul 14 15:24:23 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:23.546338 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0bb893-99ee-434a-b1b4-cc8bef6f105e None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:23.575203 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf25d808-73d6-441c-ac52-23f8f5a8f268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:23.575863 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf25d808-73d6-441c-ac52-23f8f5a8f268 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:23.576141 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf25d808-73d6-441c-ac52-23f8f5a8f268 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:23.576422 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf25d808-73d6-441c-ac52-23f8f5a8f268 None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:23.577135 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf25d808-73d6-441c-ac52-23f8f5a8f268 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:23.577439 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf25d808-73d6-441c-ac52-23f8f5a8f268 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:23.578883 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf25d808-73d6-441c-ac52-23f8f5a8f268 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:23.590559 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 445/853] 10.222.0.118 () {56 vars in 1114 bytes} [Thu Jul 14 15:24:23 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:23.591790 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2726b9-89ff-4894-ba63-0ba314ef2bdf None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:23.592070 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2726b9-89ff-4894-ba63-0ba314ef2bdf None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:23.592340 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2726b9-89ff-4894-ba63-0ba314ef2bdf None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:23.593743 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 446/854] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:24:23 2022] GET /identity => generated 271 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:24:23.597814 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2726b9-89ff-4894-ba63-0ba314ef2bdf None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:23.607410 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:23.647865 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:23.653078 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0bb893-99ee-434a-b1b4-cc8bef6f105e None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:23.686994 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f0c124-182a-4161-b230-bdec8ff1da07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:23.687574 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f0c124-182a-4161-b230-bdec8ff1da07 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:23.687846 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f0c124-182a-4161-b230-bdec8ff1da07 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:23.688116 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f0c124-182a-4161-b230-bdec8ff1da07 None admin] PATH_INFO: `/v3/services` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:23.688807 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f0c124-182a-4161-b230-bdec8ff1da07 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:23.689135 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f0c124-182a-4161-b230-bdec8ff1da07 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:23.690531 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f0c124-182a-4161-b230-bdec8ff1da07 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:23.694961 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 409/855] 10.222.0.118 () {56 vars in 1119 bytes} [Thu Jul 14 15:24:23 2022] GET /identity/v3/services?type=volumev3 => generated 126 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:23.695849 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f0c124-182a-4161-b230-bdec8ff1da07 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:23.700595 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2726b9-89ff-4894-ba63-0ba314ef2bdf None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:23.745308 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0f282f-3460-49cb-85bd-864f7d549f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:23.746315 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f282f-3460-49cb-85bd-864f7d549f7c None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:23.746652 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f282f-3460-49cb-85bd-864f7d549f7c None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:23.746988 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f282f-3460-49cb-85bd-864f7d549f7c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:23.755688 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0f282f-3460-49cb-85bd-864f7d549f7c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:23.757263 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0f282f-3460-49cb-85bd-864f7d549f7c None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:23.772746 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-3e0f282f-3460-49cb-85bd-864f7d549f7c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:24:23.772746 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:23.772746 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:23.772746 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:23.772746 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:23.772746 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:23.772746 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:23.772746 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:23.772746 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:23.772746 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:23.772746 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:23.772746 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:23.772746 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 15:24:23.772746 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 15:24:23.772746 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 15:24:23.773863 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 15:24:23.773863 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:23.773863 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:23.773863 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:23.773863 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:23.773863 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:23.773863 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:23.773863 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:23.773863 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:23.773863 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:23.773863 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:23.773863 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:23.773863 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:23.773863 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:23.773863 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:23.773863 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:23.773863 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:23.774999 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 15:24:23.774999 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 15:24:23.774999 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:24:23.774999 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:24:23.774999 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:24:23.774999 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:24:23.774999 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:24:23.774999 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:24:23.775951 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 447/856] 10.222.0.118 () {56 vars in 1116 bytes} [Thu Jul 14 15:24:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:23.782282 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd911ca4-0d16-4f82-9244-102273b2da07 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:23.782565 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd911ca4-0d16-4f82-9244-102273b2da07 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:23.783427 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd911ca4-0d16-4f82-9244-102273b2da07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:23.802030 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-fd911ca4-0d16-4f82-9244-102273b2da07 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:23.803272 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-fd911ca4-0d16-4f82-9244-102273b2da07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:23.818983 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f0c124-182a-4161-b230-bdec8ff1da07 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:23.848260 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:23.863926 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507436cd-9cdf-40ee-b8fd-489a30f9458a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:23.865023 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507436cd-9cdf-40ee-b8fd-489a30f9458a None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:23.865302 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507436cd-9cdf-40ee-b8fd-489a30f9458a None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:23.865578 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507436cd-9cdf-40ee-b8fd-489a30f9458a None admin] PATH_INFO: `/v3/users/swift` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:23.874543 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507436cd-9cdf-40ee-b8fd-489a30f9458a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:23.875986 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507436cd-9cdf-40ee-b8fd-489a30f9458a None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:23.893987 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 448/857] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:24:23 2022] POST /identity/v3/auth/tokens => generated 1153 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:24:23.893987 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd911ca4-0d16-4f82-9244-102273b2da07 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:23.894251 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-507436cd-9cdf-40ee-b8fd-489a30f9458a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 14 15:24:23.894251 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:23.894251 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:23.894251 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:23.894251 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:23.894251 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:23.894251 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:23.894251 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:23.894251 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:23.894251 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:23.894251 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:23.894251 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:23.894251 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 15:24:23.894251 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 15:24:23.894251 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 15:24:23.894251 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 15:24:23.895079 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:23.895079 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:23.895079 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 15:24:23.895079 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:24:23.895079 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 15:24:23.895079 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:24:23.895079 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:23.895079 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:23.895079 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:23.895079 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:23.895079 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:23.895079 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:23.895079 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:23.895079 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:23.895079 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:23.895079 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:23.895079 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:23.895079 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:23.896039 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:23.896039 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:23.896039 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 15:24:23.896039 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 15:24:23.896039 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 15:24:23.896039 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 15:24:23.896039 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 15:24:23.896039 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 15:24:23.896039 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 14 15:24:23.896039 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:24:23.896039 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 410/858] 10.222.0.118 () {56 vars in 1101 bytes} [Thu Jul 14 15:24:23 2022] GET /identity/v3/users/swift => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:23.897988 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507436cd-9cdf-40ee-b8fd-489a30f9458a None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:23.940917 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:24.016841 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd911ca4-0d16-4f82-9244-102273b2da07 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:24.022705 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507436cd-9cdf-40ee-b8fd-489a30f9458a None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:24.053774 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77bc04c-9d6a-4156-a726-5543e0dbbd04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:24.054480 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77bc04c-9d6a-4156-a726-5543e0dbbd04 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:24.054753 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77bc04c-9d6a-4156-a726-5543e0dbbd04 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:24.055015 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77bc04c-9d6a-4156-a726-5543e0dbbd04 None admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:24.055797 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77bc04c-9d6a-4156-a726-5543e0dbbd04 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:24.056101 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77bc04c-9d6a-4156-a726-5543e0dbbd04 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:24.057502 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77bc04c-9d6a-4156-a726-5543e0dbbd04 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:24.060241 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538f9481-a1b9-4c12-ab72-5a09d35541f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:24.060905 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538f9481-a1b9-4c12-ab72-5a09d35541f5 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:24.061182 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538f9481-a1b9-4c12-ab72-5a09d35541f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:24.061450 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538f9481-a1b9-4c12-ab72-5a09d35541f5 None admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:24.062307 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538f9481-a1b9-4c12-ab72-5a09d35541f5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:24.062613 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538f9481-a1b9-4c12-ab72-5a09d35541f5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:24.064710 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538f9481-a1b9-4c12-ab72-5a09d35541f5 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:24.069566 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 449/859] 10.222.0.118 () {56 vars in 1153 bytes} [Thu Jul 14 15:24:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:24.070568 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77bc04c-9d6a-4156-a726-5543e0dbbd04 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:24.088498 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 411/860] 10.222.0.118 () {56 vars in 1140 bytes} [Thu Jul 14 15:24:23 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 372 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:24.088498 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538f9481-a1b9-4c12-ab72-5a09d35541f5 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:24.132711 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:24.179804 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:24.182730 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77bc04c-9d6a-4156-a726-5543e0dbbd04 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:24.199782 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538f9481-a1b9-4c12-ab72-5a09d35541f5 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:24.219101 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f233cf4-282a-4039-8c72-829431400286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:24.220362 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f233cf4-282a-4039-8c72-829431400286 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:24.220818 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f233cf4-282a-4039-8c72-829431400286 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:24.221274 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f233cf4-282a-4039-8c72-829431400286 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:24.222033 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f233cf4-282a-4039-8c72-829431400286 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:24.223619 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f233cf4-282a-4039-8c72-829431400286 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:24.233755 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2c31ab-e52b-41d2-8261-299196a76013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:24.234437 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2c31ab-e52b-41d2-8261-299196a76013 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:24.234711 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2c31ab-e52b-41d2-8261-299196a76013 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:24.234979 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2c31ab-e52b-41d2-8261-299196a76013 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:24.235824 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2c31ab-e52b-41d2-8261-299196a76013 None admin] RBAC: Adding query filter params (role.id=3185f450429e4bb3b5f289b615f3269b, scope.project.id=939bf9541f4a4afe86550f749d337680, user.id=f7ad5ae70939416e8157693e02997a58) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:24.236131 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2c31ab-e52b-41d2-8261-299196a76013 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:24.236917 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-4f233cf4-282a-4039-8c72-829431400286 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 15:24:24.236917 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:24.236917 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 15:24:24.236917 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 15:24:24.236917 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 15:24:24.236917 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 15:24:24.236917 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 15:24:24.236917 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:24:24.236917 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 15:24:24.236917 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:24:24.236917 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 15:24:24.236917 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:24:24.236917 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:24.236917 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:24.236917 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:24.236917 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:24.237851 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:24.237851 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:24.237851 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:24.237851 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:24.237851 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:24.237851 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:24.237851 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:24.237851 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 15:24:24.237851 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 15:24:24.237851 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 15:24:24.237851 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 15:24:24.237851 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:24.237851 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:24.237851 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:24.237851 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:24.237851 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:24.239399 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:24.239399 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:24.239399 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:24.239399 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:24.239399 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:24.239399 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:24.239399 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:24.239399 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:24.239399 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:24.239399 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:24.239399 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:24.239399 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 15:24:24.239399 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:24:24.239399 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 15:24:24.239399 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:24:24.240431 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2c31ab-e52b-41d2-8261-299196a76013 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:24.240504 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 450/861] 10.222.0.118 () {56 vars in 1137 bytes} [Thu Jul 14 15:24:24 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:24.240504 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f233cf4-282a-4039-8c72-829431400286 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:24.258368 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 412/862] 10.222.0.118 () {56 vars in 1379 bytes} [Thu Jul 14 15:24:24 2022] GET /identity/v3/role_assignments?user.id=f7ad5ae70939416e8157693e02997a58&scope.project.id=939bf9541f4a4afe86550f749d337680&role.id=3185f450429e4bb3b5f289b615f3269b => generated 610 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:24.258368 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2c31ab-e52b-41d2-8261-299196a76013 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:24.378872 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f233cf4-282a-4039-8c72-829431400286 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:24.391979 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2c31ab-e52b-41d2-8261-299196a76013 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:24.403223 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:24.424402 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7842593-4fcd-499c-818d-d843be1b15a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:24.425549 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7842593-4fcd-499c-818d-d843be1b15a2 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:24.425936 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7842593-4fcd-499c-818d-d843be1b15a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:24.426340 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7842593-4fcd-499c-818d-d843be1b15a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:24.436960 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e06620a-6f04-4ac2-b69e-b40d01306f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:24.437929 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e06620a-6f04-4ac2-b69e-b40d01306f1d None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:24.438379 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e06620a-6f04-4ac2-b69e-b40d01306f1d None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:24.439502 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e06620a-6f04-4ac2-b69e-b40d01306f1d None admin] PATH_INFO: `/v3/services` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:24.440455 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e06620a-6f04-4ac2-b69e-b40d01306f1d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:24.440974 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e06620a-6f04-4ac2-b69e-b40d01306f1d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:24.442705 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e06620a-6f04-4ac2-b69e-b40d01306f1d None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:24.453087 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 413/863] 10.222.0.118 () {56 vars in 1131 bytes} [Thu Jul 14 15:24:24 2022] GET /identity/v3/services?name=compute_legacy => generated 132 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:24.454482 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e06620a-6f04-4ac2-b69e-b40d01306f1d None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:24.465629 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:24.517280 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7842593-4fcd-499c-818d-d843be1b15a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:24.518805 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7842593-4fcd-499c-818d-d843be1b15a2 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:24.587317 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e06620a-6f04-4ac2-b69e-b40d01306f1d None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:24.624565 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9323ef1-72f4-4b9e-924e-91ae770d7c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:24.625329 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9323ef1-72f4-4b9e-924e-91ae770d7c40 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:24.625608 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9323ef1-72f4-4b9e-924e-91ae770d7c40 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:24.625881 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9323ef1-72f4-4b9e-924e-91ae770d7c40 None admin] PATH_INFO: `/v3/services` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:24.627204 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9323ef1-72f4-4b9e-924e-91ae770d7c40 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:24.627513 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9323ef1-72f4-4b9e-924e-91ae770d7c40 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:24.628908 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9323ef1-72f4-4b9e-924e-91ae770d7c40 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:24.634090 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 414/864] 10.222.0.118 () {56 vars in 1131 bytes} [Thu Jul 14 15:24:24 2022] GET /identity/v3/services?type=compute_legacy => generated 132 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:24.641437 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 451/865] 10.222.0.118 () {58 vars in 1287 bytes} [Thu Jul 14 15:24:24 2022] GET /identity/v3/auth/tokens => generated 1153 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 15:24:24.647052 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9323ef1-72f4-4b9e-924e-91ae770d7c40 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:24.686360 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:24.760848 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9323ef1-72f4-4b9e-924e-91ae770d7c40 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:24.798070 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f539124-e27b-434c-b5bf-4e754c8b6233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:24.799411 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f539124-e27b-434c-b5bf-4e754c8b6233 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:24.799690 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f539124-e27b-434c-b5bf-4e754c8b6233 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:24.799964 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f539124-e27b-434c-b5bf-4e754c8b6233 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:24.811112 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f539124-e27b-434c-b5bf-4e754c8b6233 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:24.812584 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f539124-e27b-434c-b5bf-4e754c8b6233 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:24.832102 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-3f539124-e27b-434c-b5bf-4e754c8b6233 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:24.832102 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:24.832102 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:24.832102 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:24.832102 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:24.832102 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:24.832102 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:24.832102 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:24.832102 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:24.832102 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:24.832102 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:24.832102 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:24.832102 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:24:24.832102 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:24:24.832102 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:24:24.833134 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:24:24.833134 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:24.833134 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:24.833134 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:24.833134 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:24.833134 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:24.833134 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:24.833134 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:24.833134 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:24.833134 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:24.833134 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:24.833134 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:24.833134 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:24.833134 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:24.833134 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:24.833134 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:24.833134 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:24.834039 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:24:24.834039 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:24:24.834039 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:24.834039 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:24:24.834039 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 415/866] 10.222.0.118 () {56 vars in 1113 bytes} [Thu Jul 14 15:24:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:24:24.839472 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7842593-4fcd-499c-818d-d843be1b15a2 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:24.906883 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:24.951986 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7842593-4fcd-499c-818d-d843be1b15a2 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:24.987614 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d05b34-dddd-4625-b2d0-6d307ce18edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:24.988196 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d05b34-dddd-4625-b2d0-6d307ce18edf None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:24.988474 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d05b34-dddd-4625-b2d0-6d307ce18edf None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:24.988744 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d05b34-dddd-4625-b2d0-6d307ce18edf None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:24.989468 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d05b34-dddd-4625-b2d0-6d307ce18edf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:24.989772 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d05b34-dddd-4625-b2d0-6d307ce18edf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:24.991162 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d05b34-dddd-4625-b2d0-6d307ce18edf None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:25.003260 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 452/867] 10.222.0.118 () {56 vars in 1114 bytes} [Thu Jul 14 15:24:24 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:24:25.008652 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f539124-e27b-434c-b5bf-4e754c8b6233 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:25.096049 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:25.112544 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f539124-e27b-434c-b5bf-4e754c8b6233 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:25.147951 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fd25f2-ea4c-426f-a98b-767aa5cb1f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:25.148814 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fd25f2-ea4c-426f-a98b-767aa5cb1f7d None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:25.149093 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fd25f2-ea4c-426f-a98b-767aa5cb1f7d None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:25.149366 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fd25f2-ea4c-426f-a98b-767aa5cb1f7d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:25.156334 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fd25f2-ea4c-426f-a98b-767aa5cb1f7d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:25.158345 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fd25f2-ea4c-426f-a98b-767aa5cb1f7d None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:25.172250 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-b8fd25f2-ea4c-426f-a98b-767aa5cb1f7d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:24:25.172250 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:25.172250 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:25.172250 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:25.172250 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:25.172250 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:25.172250 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:25.172250 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:25.172250 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:25.172250 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:25.172250 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:25.172250 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:25.172250 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 15:24:25.172250 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 15:24:25.172250 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 15:24:25.173832 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 15:24:25.173832 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:25.173832 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:25.173832 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:25.173832 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:25.173832 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:25.173832 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:25.173832 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:25.173832 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:25.173832 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:25.173832 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:25.173832 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:25.173832 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:25.173832 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:25.173832 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:25.173832 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:25.173832 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:25.175202 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 15:24:25.175202 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 15:24:25.175202 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:24:25.175202 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:24:25.175202 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:24:25.175202 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:24:25.175202 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:24:25.175202 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:24:25.175202 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 416/868] 10.222.0.118 () {56 vars in 1116 bytes} [Thu Jul 14 15:24:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:25.180702 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d05b34-dddd-4625-b2d0-6d307ce18edf None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:25.288807 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d05b34-dddd-4625-b2d0-6d307ce18edf None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:25.312675 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:25.325317 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ec9327-c0ed-4420-a72f-8bb9a2cd37c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:25.325990 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec9327-c0ed-4420-a72f-8bb9a2cd37c5 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:25.326280 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec9327-c0ed-4420-a72f-8bb9a2cd37c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:25.326549 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec9327-c0ed-4420-a72f-8bb9a2cd37c5 None admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:25.327337 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ec9327-c0ed-4420-a72f-8bb9a2cd37c5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:25.327650 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ec9327-c0ed-4420-a72f-8bb9a2cd37c5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:25.329089 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ec9327-c0ed-4420-a72f-8bb9a2cd37c5 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:25.342158 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 453/869] 10.222.0.118 () {56 vars in 1153 bytes} [Thu Jul 14 15:24:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:25.351103 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fd25f2-ea4c-426f-a98b-767aa5cb1f7d None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:25.460799 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fd25f2-ea4c-426f-a98b-767aa5cb1f7d None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:25.495933 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df9f882-95d9-4ced-9853-b9c82123965c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:25.497000 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df9f882-95d9-4ced-9853-b9c82123965c None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:25.497482 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df9f882-95d9-4ced-9853-b9c82123965c None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:25.497997 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df9f882-95d9-4ced-9853-b9c82123965c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:25.499051 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df9f882-95d9-4ced-9853-b9c82123965c None admin] RBAC: Adding query filter params (role.id=3b880cef7dcf4baf87b50f8610c0c56e, scope.project.id=939bf9541f4a4afe86550f749d337680, user.id=b672a6a601584d2d826147069e90a10f) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:25.499577 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df9f882-95d9-4ced-9853-b9c82123965c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:25.501246 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df9f882-95d9-4ced-9853-b9c82123965c None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:25.508933 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 417/870] 10.222.0.118 () {56 vars in 1379 bytes} [Thu Jul 14 15:24:25 2022] GET /identity/v3/role_assignments?user.id=b672a6a601584d2d826147069e90a10f&scope.project.id=939bf9541f4a4afe86550f749d337680&role.id=3b880cef7dcf4baf87b50f8610c0c56e => generated 610 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:25.828216 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330baca3-4c96-40e6-9b0c-c683c790f737 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:25.828732 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330baca3-4c96-40e6-9b0c-c683c790f737 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:25.828840 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330baca3-4c96-40e6-9b0c-c683c790f737 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:25.830505 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 454/871] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:24:25 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:24:25.835706 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a692fee-0c8b-4a84-8294-c0158d77ec7e None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:25.835995 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a692fee-0c8b-4a84-8294-c0158d77ec7e None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:25.836270 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a692fee-0c8b-4a84-8294-c0158d77ec7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:25.853602 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-7a692fee-0c8b-4a84-8294-c0158d77ec7e None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:25.854837 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-7a692fee-0c8b-4a84-8294-c0158d77ec7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:25.857684 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:25.926424 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 418/872] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:24:25 2022] POST /identity/v3/auth/tokens => generated 1153 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:24:25.949201 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330baca3-4c96-40e6-9b0c-c683c790f737 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:26.057946 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330baca3-4c96-40e6-9b0c-c683c790f737 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:26.092898 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c38488e-2c41-4613-9aef-e09c0f17854d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:26.093567 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c38488e-2c41-4613-9aef-e09c0f17854d None admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:26.093844 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c38488e-2c41-4613-9aef-e09c0f17854d None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:26.094172 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c38488e-2c41-4613-9aef-e09c0f17854d None admin] PATH_INFO: `/v3/services` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:26.094915 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c38488e-2c41-4613-9aef-e09c0f17854d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:26.096863 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c38488e-2c41-4613-9aef-e09c0f17854d None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:26.111401 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 455/873] 10.222.0.118 () {60 vars in 1146 bytes} [Thu Jul 14 15:24:25 2022] POST /identity/v3/services => generated 252 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:24:26.601892 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68455771-7632-43c1-a02c-eff523eba4e0 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:26.602434 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68455771-7632-43c1-a02c-eff523eba4e0 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:26.602625 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68455771-7632-43c1-a02c-eff523eba4e0 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:26.604184 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 419/874] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:24:26 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:24:26.609460 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9731268d-5936-4211-b67f-fa0fad8ca6ce None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:26.609739 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9731268d-5936-4211-b67f-fa0fad8ca6ce None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:26.610032 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9731268d-5936-4211-b67f-fa0fad8ca6ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:26.627473 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-9731268d-5936-4211-b67f-fa0fad8ca6ce None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:26.628720 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-9731268d-5936-4211-b67f-fa0fad8ca6ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:26.669017 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:26.713813 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 456/875] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:24:26 2022] POST /identity/v3/auth/tokens => generated 1254 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:24:26.738211 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68455771-7632-43c1-a02c-eff523eba4e0 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:26.774802 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f965f2-43d5-4d0a-9b62-c0c73ed5a9e7 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:26.775234 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f965f2-43d5-4d0a-9b62-c0c73ed5a9e7 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:26.775608 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f965f2-43d5-4d0a-9b62-c0c73ed5a9e7 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:26.777352 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 457/876] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:24:26 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 14 15:24:26.782314 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96191ed9-3251-4808-83dd-780debcd37b8 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:26.782664 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96191ed9-3251-4808-83dd-780debcd37b8 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:26.783438 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96191ed9-3251-4808-83dd-780debcd37b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:26.802905 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-96191ed9-3251-4808-83dd-780debcd37b8 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:26.804588 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-96191ed9-3251-4808-83dd-780debcd37b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:26.850074 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68455771-7632-43c1-a02c-eff523eba4e0 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:26.886142 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 458/877] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:24:26 2022] POST /identity/v3/auth/tokens => generated 1254 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 15:24:26.890088 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0ba669-3699-4b92-94b6-c79787c21d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:26.891050 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0ba669-3699-4b92-94b6-c79787c21d39 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:26.891420 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0ba669-3699-4b92-94b6-c79787c21d39 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:26.891795 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0ba669-3699-4b92-94b6-c79787c21d39 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:26.901558 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96191ed9-3251-4808-83dd-780debcd37b8 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:26.902906 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0ba669-3699-4b92-94b6-c79787c21d39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:24:26.910293 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:26.915696 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-cf0ba669-3699-4b92-94b6-c79787c21d39 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 15:24:26.915696 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:26.915696 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:26.915696 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:26.915696 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:26.915696 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:26.915696 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:26.915696 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:26.915696 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:26.915696 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:26.915696 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:26.915696 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:26.915696 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:24:26.915696 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:24:26.915696 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:24:26.915696 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:24:26.916902 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:24:26.916902 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:24:26.916902 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:24:26.916902 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:24:26.916902 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:26.916902 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:26.916902 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:26.916902 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:26.916902 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:26.916902 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:26.916902 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:26.916902 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:26.916902 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:26.916902 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:26.916902 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:26.916902 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:26.917914 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:26.917914 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:26.917914 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:26.917914 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:26.917914 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:24:26.917914 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:24:26.917914 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:24:26.917914 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:24:26.917914 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:24:26.917914 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:24:26.917914 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 15:24:26.917914 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:24:26.922009 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 420/878] 10.222.0.118 () {56 vars in 1125 bytes} [Thu Jul 14 15:24:26 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:26.924604 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0ba669-3699-4b92-94b6-c79787c21d39 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:27.027859 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:27.031477 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96191ed9-3251-4808-83dd-780debcd37b8 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:27.042972 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0ba669-3699-4b92-94b6-c79787c21d39 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:27.082119 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b08c801-1424-4779-87cb-bc87f5ea65a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:27.082366 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418f29fd-ae06-4b1a-8038-32821c7f353a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:27.082836 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418f29fd-ae06-4b1a-8038-32821c7f353a None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:27.083119 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418f29fd-ae06-4b1a-8038-32821c7f353a None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:27.083397 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418f29fd-ae06-4b1a-8038-32821c7f353a None admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:27.083905 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b08c801-1424-4779-87cb-bc87f5ea65a4 None admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:27.084151 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418f29fd-ae06-4b1a-8038-32821c7f353a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:27.084462 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418f29fd-ae06-4b1a-8038-32821c7f353a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:27.084799 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b08c801-1424-4779-87cb-bc87f5ea65a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:27.085259 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b08c801-1424-4779-87cb-bc87f5ea65a4 None admin] PATH_INFO: `/v3/services` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:27.085832 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418f29fd-ae06-4b1a-8038-32821c7f353a None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:27.086416 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b08c801-1424-4779-87cb-bc87f5ea65a4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:27.088852 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b08c801-1424-4779-87cb-bc87f5ea65a4 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:27.096404 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 421/879] 10.222.0.118 () {56 vars in 1120 bytes} [Thu Jul 14 15:24:26 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 340 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:24:27.101992 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418f29fd-ae06-4b1a-8038-32821c7f353a None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:27.107105 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 459/880] 10.222.0.118 () {60 vars in 1146 bytes} [Thu Jul 14 15:24:26 2022] POST /identity/v3/services => generated 270 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:24:27.182846 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:27.228255 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418f29fd-ae06-4b1a-8038-32821c7f353a None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:27.274063 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f8ceed-7912-4315-917a-fddfe0548601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:27.274892 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f8ceed-7912-4315-917a-fddfe0548601 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:27.275171 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f8ceed-7912-4315-917a-fddfe0548601 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:27.275445 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f8ceed-7912-4315-917a-fddfe0548601 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:27.288806 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f8ceed-7912-4315-917a-fddfe0548601 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:27.290307 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f8ceed-7912-4315-917a-fddfe0548601 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:27.309150 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-f5f8ceed-7912-4315-917a-fddfe0548601 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:27.309150 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:27.309150 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:27.309150 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:27.309150 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:27.309150 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:27.309150 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:27.309150 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:27.309150 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:27.309150 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:27.309150 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:27.309150 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:27.309150 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:24:27.309150 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:24:27.309150 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:24:27.310124 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:24:27.310124 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:27.310124 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:27.310124 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:27.310124 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:27.310124 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:27.310124 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:27.310124 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:27.310124 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:27.310124 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:27.310124 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:27.310124 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:27.310124 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:27.310124 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:27.310124 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:27.310124 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:27.310124 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:27.311422 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:24:27.311422 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:24:27.311422 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:27.311422 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:24:27.311422 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 422/881] 10.222.0.118 () {56 vars in 1113 bytes} [Thu Jul 14 15:24:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:27.316922 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b08c801-1424-4779-87cb-bc87f5ea65a4 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:27.429101 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b08c801-1424-4779-87cb-bc87f5ea65a4 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:27.469016 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ce285d-ef56-434a-98f4-d08d8a54a3fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:27.469602 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ce285d-ef56-434a-98f4-d08d8a54a3fe None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:27.469883 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ce285d-ef56-434a-98f4-d08d8a54a3fe None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:27.470216 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ce285d-ef56-434a-98f4-d08d8a54a3fe None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:27.471033 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ce285d-ef56-434a-98f4-d08d8a54a3fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:27.471341 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ce285d-ef56-434a-98f4-d08d8a54a3fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:27.472707 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ce285d-ef56-434a-98f4-d08d8a54a3fe None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:27.486542 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 460/882] 10.222.0.118 () {56 vars in 1114 bytes} [Thu Jul 14 15:24:27 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:27.495316 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f8ceed-7912-4315-917a-fddfe0548601 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:27.615953 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f8ceed-7912-4315-917a-fddfe0548601 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:27.627327 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:27.654471 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6b8ffc-9673-40f7-b363-470157b8e730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:27.655686 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6b8ffc-9673-40f7-b363-470157b8e730 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:27.656172 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6b8ffc-9673-40f7-b363-470157b8e730 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:27.656647 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6b8ffc-9673-40f7-b363-470157b8e730 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:27.665842 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6b8ffc-9673-40f7-b363-470157b8e730 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:27.667600 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6b8ffc-9673-40f7-b363-470157b8e730 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:27.683369 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-fd6b8ffc-9673-40f7-b363-470157b8e730 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 15:24:27.683369 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:27.683369 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:27.683369 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:27.683369 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:27.683369 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:27.683369 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:27.683369 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:27.683369 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:27.683369 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:27.683369 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:27.683369 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:27.683369 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 15:24:27.683369 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 15:24:27.683369 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 15:24:27.683369 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 15:24:27.684356 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:27.684356 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:27.684356 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 15:24:27.684356 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:24:27.684356 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 15:24:27.684356 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:24:27.684356 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:27.684356 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:27.684356 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:27.684356 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:27.684356 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:27.684356 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:27.684356 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:27.684356 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:27.684356 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:27.684356 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:27.684356 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:27.684356 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:27.685303 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:27.685303 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:27.685303 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 15:24:27.685303 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 15:24:27.685303 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 15:24:27.685303 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 15:24:27.685303 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 15:24:27.685303 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 15:24:27.685303 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 15:24:27.685303 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:24:27.688008 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 423/883] 10.222.0.118 () {56 vars in 1122 bytes} [Thu Jul 14 15:24:27 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:27.693352 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b8875a-0306-4f58-aade-e365258e1141 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:27.693635 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b8875a-0306-4f58-aade-e365258e1141 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:27.693907 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b8875a-0306-4f58-aade-e365258e1141 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:27.695484 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6b8ffc-9673-40f7-b363-470157b8e730 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:27.695599 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 461/884] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:24:27 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:24:27.700495 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d01c05-4552-4d01-aa17-dff039d4015f None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:27.700780 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d01c05-4552-4d01-aa17-dff039d4015f None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:27.701054 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d01c05-4552-4d01-aa17-dff039d4015f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:27.729787 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-95d01c05-4552-4d01-aa17-dff039d4015f None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:27.731516 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-95d01c05-4552-4d01-aa17-dff039d4015f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:27.752229 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:27.807302 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6b8ffc-9673-40f7-b363-470157b8e730 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:27.827223 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 462/885] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:24:27 2022] POST /identity/v3/auth/tokens => generated 1364 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 15:24:27.849491 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d01c05-4552-4d01-aa17-dff039d4015f None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:27.851770 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f73f697-bf80-4c47-ad09-292280407fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:27.852644 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f73f697-bf80-4c47-ad09-292280407fb7 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:27.852921 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f73f697-bf80-4c47-ad09-292280407fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:27.853193 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f73f697-bf80-4c47-ad09-292280407fb7 None admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:27.854981 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f73f697-bf80-4c47-ad09-292280407fb7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:27.855295 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f73f697-bf80-4c47-ad09-292280407fb7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:27.856735 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f73f697-bf80-4c47-ad09-292280407fb7 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:27.880346 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 424/886] 10.222.0.118 () {56 vars in 1154 bytes} [Thu Jul 14 15:24:27 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 386 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:24:27.884979 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f73f697-bf80-4c47-ad09-292280407fb7 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:27.921674 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:27.965602 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d01c05-4552-4d01-aa17-dff039d4015f None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:28.003499 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773e7fe3-2433-4028-aef1-c578ef4cc2e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:28.004706 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773e7fe3-2433-4028-aef1-c578ef4cc2e6 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:28.005471 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773e7fe3-2433-4028-aef1-c578ef4cc2e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:28.005935 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773e7fe3-2433-4028-aef1-c578ef4cc2e6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:28.006800 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773e7fe3-2433-4028-aef1-c578ef4cc2e6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:28.008586 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773e7fe3-2433-4028-aef1-c578ef4cc2e6 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:28.010856 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f73f697-bf80-4c47-ad09-292280407fb7 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:28.021495 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-773e7fe3-2433-4028-aef1-c578ef4cc2e6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 15:24:28.021495 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:28.021495 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 15:24:28.021495 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 15:24:28.021495 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 15:24:28.021495 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 15:24:28.021495 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 15:24:28.021495 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:24:28.021495 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 15:24:28.021495 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:24:28.021495 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 15:24:28.021495 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:24:28.021495 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:28.021495 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:28.021495 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:28.021495 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:28.021495 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:28.022504 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:28.022504 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:28.022504 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:28.022504 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:28.022504 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:28.022504 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:28.022504 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 15:24:28.022504 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 15:24:28.022504 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 15:24:28.022504 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 15:24:28.022504 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:28.022504 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:28.022504 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:28.022504 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:28.022504 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:28.022504 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:28.023313 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:28.023313 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:28.023313 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:28.023313 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:28.023313 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:28.023313 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:28.023313 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:28.023313 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:28.023313 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:28.023313 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:28.023313 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 15:24:28.023313 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:24:28.023313 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 15:24:28.023313 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:24:28.031453 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 463/887] 10.222.0.118 () {56 vars in 1131 bytes} [Thu Jul 14 15:24:27 2022] GET /identity/v3/services/object-store => generated 93 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:24:28.033927 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773e7fe3-2433-4028-aef1-c578ef4cc2e6 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:28.048129 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e79d2e-b413-4591-8007-977063d6f766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:28.049321 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e79d2e-b413-4591-8007-977063d6f766 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:28.049602 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e79d2e-b413-4591-8007-977063d6f766 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:28.049879 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e79d2e-b413-4591-8007-977063d6f766 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:28.054674 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:28.136112 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e79d2e-b413-4591-8007-977063d6f766 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:28.137744 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e79d2e-b413-4591-8007-977063d6f766 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:28.154508 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773e7fe3-2433-4028-aef1-c578ef4cc2e6 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:28.173743 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:28.193737 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33b3b43-bcab-408c-9d1e-84c6367cf031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:28.194777 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33b3b43-bcab-408c-9d1e-84c6367cf031 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:28.195315 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33b3b43-bcab-408c-9d1e-84c6367cf031 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:28.195897 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33b3b43-bcab-408c-9d1e-84c6367cf031 None admin] PATH_INFO: `/v3/services` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:28.196835 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33b3b43-bcab-408c-9d1e-84c6367cf031 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:28.197376 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33b3b43-bcab-408c-9d1e-84c6367cf031 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:28.199173 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33b3b43-bcab-408c-9d1e-84c6367cf031 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:28.210945 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 464/888] 10.222.0.118 () {56 vars in 1127 bytes} [Thu Jul 14 15:24:28 2022] GET /identity/v3/services?name=object-store => generated 130 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:24:28.212037 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f29caef-e43b-40c5-b799-798bc1fcc11d None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:28.212597 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f29caef-e43b-40c5-b799-798bc1fcc11d None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:28.212899 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f29caef-e43b-40c5-b799-798bc1fcc11d None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:28.214653 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 465/889] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:24:28 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:24:28.215182 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f29caef-e43b-40c5-b799-798bc1fcc11d None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:28.259375 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 425/890] 10.222.0.118 () {58 vars in 1287 bytes} [Thu Jul 14 15:24:27 2022] GET /identity/v3/auth/tokens => generated 1364 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 15:24:28.261464 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf1af52-b551-4dab-be89-d2e35b3f5ca7 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:28.262316 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf1af52-b551-4dab-be89-d2e35b3f5ca7 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:28.262795 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf1af52-b551-4dab-be89-d2e35b3f5ca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:28.280220 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-0bf1af52-b551-4dab-be89-d2e35b3f5ca7 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:28.281448 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-0bf1af52-b551-4dab-be89-d2e35b3f5ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:28.303143 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:28.325600 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f29caef-e43b-40c5-b799-798bc1fcc11d None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:28.360329 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97bad15-68ff-4d0b-8221-d4f401e13cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:28.360594 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97bad15-68ff-4d0b-8221-d4f401e13cec None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:28.360833 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97bad15-68ff-4d0b-8221-d4f401e13cec None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:28.361021 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97bad15-68ff-4d0b-8221-d4f401e13cec None admin] PATH_INFO: `/v3/services` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:28.361736 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97bad15-68ff-4d0b-8221-d4f401e13cec None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:28.362072 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97bad15-68ff-4d0b-8221-d4f401e13cec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:28.362554 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 426/891] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:24:28 2022] POST /identity/v3/auth/tokens => generated 1364 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:24:28.363453 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97bad15-68ff-4d0b-8221-d4f401e13cec None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:28.363926 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf1af52-b551-4dab-be89-d2e35b3f5ca7 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:28.374016 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 466/892] 10.222.0.118 () {56 vars in 1127 bytes} [Thu Jul 14 15:24:28 2022] GET /identity/v3/services?type=object-store => generated 130 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:28.382118 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97bad15-68ff-4d0b-8221-d4f401e13cec None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:28.454849 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:28.511355 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf1af52-b551-4dab-be89-d2e35b3f5ca7 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:28.513753 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97bad15-68ff-4d0b-8221-d4f401e13cec None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:28.555854 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2451f7b-8165-4c9c-acef-3cb2eb0bdcb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:28.556062 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f068d857-409b-4f55-bb71-9e004374d2ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:28.556178 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2451f7b-8165-4c9c-acef-3cb2eb0bdcb5 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:28.556415 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2451f7b-8165-4c9c-acef-3cb2eb0bdcb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:28.556598 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2451f7b-8165-4c9c-acef-3cb2eb0bdcb5 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:28.556688 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f068d857-409b-4f55-bb71-9e004374d2ff None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:28.556951 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f068d857-409b-4f55-bb71-9e004374d2ff None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:28.557221 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f068d857-409b-4f55-bb71-9e004374d2ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:28.557322 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2451f7b-8165-4c9c-acef-3cb2eb0bdcb5 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:28.558641 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2451f7b-8165-4c9c-acef-3cb2eb0bdcb5 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:28.572291 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-d2451f7b-8165-4c9c-acef-3cb2eb0bdcb5 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 15:24:28.572291 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:28.572291 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 15:24:28.572291 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 15:24:28.572291 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 15:24:28.572291 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 15:24:28.572291 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 15:24:28.572291 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:24:28.572291 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 15:24:28.572291 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:24:28.572291 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 15:24:28.572291 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:24:28.572291 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:28.572291 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:28.572291 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:28.572291 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:28.572291 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:28.573296 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:28.573296 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:28.573296 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:28.573296 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:28.573296 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:28.573296 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:28.573296 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 15:24:28.573296 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 15:24:28.573296 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 15:24:28.573296 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 15:24:28.573296 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:28.573296 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:28.573296 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:28.573296 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:28.573296 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:28.573296 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:28.582447 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:28.582447 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:28.582447 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:28.582447 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:28.582447 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:28.582447 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:28.582447 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:28.582447 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:28.582447 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:28.582447 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:28.582447 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 15:24:28.582447 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:24:28.582447 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 15:24:28.582447 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:24:28.582447 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 467/893] 10.222.0.118 () {56 vars in 1119 bytes} [Thu Jul 14 15:24:28 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:24:28.583303 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f068d857-409b-4f55-bb71-9e004374d2ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:28.583303 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f068d857-409b-4f55-bb71-9e004374d2ff None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:28.583429 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2451f7b-8165-4c9c-acef-3cb2eb0bdcb5 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:28.595175 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-f068d857-409b-4f55-bb71-9e004374d2ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:28.595175 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:28.595175 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:28.595175 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:28.595175 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:28.595175 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:28.595175 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:28.595175 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:28.595175 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:28.595175 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:28.595175 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:28.595175 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:28.595175 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:24:28.595175 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:24:28.595175 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:24:28.596080 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:24:28.596080 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:28.596080 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:28.596080 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:28.596080 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:28.596080 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:28.596080 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:28.596080 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:28.596080 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:28.596080 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:28.596080 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:28.596080 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:28.596080 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:28.596080 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:28.596080 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:28.596080 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:28.596080 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:28.596952 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:24:28.596952 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:24:28.596952 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:28.596952 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:24:28.596952 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 427/894] 10.222.0.118 () {56 vars in 1113 bytes} [Thu Jul 14 15:24:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:28.597903 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:28.602902 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f068d857-409b-4f55-bb71-9e004374d2ff None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:28.706676 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2451f7b-8165-4c9c-acef-3cb2eb0bdcb5 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:28.726494 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f068d857-409b-4f55-bb71-9e004374d2ff None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:28.740668 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:28.767685 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406d47e2-f654-4825-b27a-6bfd170938a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:28.768308 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406d47e2-f654-4825-b27a-6bfd170938a5 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:28.768580 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406d47e2-f654-4825-b27a-6bfd170938a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:28.768847 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406d47e2-f654-4825-b27a-6bfd170938a5 None admin] PATH_INFO: `/v3/services` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:28.769558 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406d47e2-f654-4825-b27a-6bfd170938a5 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:28.769856 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406d47e2-f654-4825-b27a-6bfd170938a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:28.771260 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406d47e2-f654-4825-b27a-6bfd170938a5 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:28.776650 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 468/895] 10.222.0.118 () {56 vars in 1119 bytes} [Thu Jul 14 15:24:28 2022] GET /identity/v3/services?name=volumev3 => generated 126 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:28.778686 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49f0674-dcc3-499a-aaa6-c9a8658de9f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:28.779579 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49f0674-dcc3-499a-aaa6-c9a8658de9f2 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:28.780051 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49f0674-dcc3-499a-aaa6-c9a8658de9f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:28.780534 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49f0674-dcc3-499a-aaa6-c9a8658de9f2 None admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:28.781450 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49f0674-dcc3-499a-aaa6-c9a8658de9f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:28.781948 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49f0674-dcc3-499a-aaa6-c9a8658de9f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:28.783591 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49f0674-dcc3-499a-aaa6-c9a8658de9f2 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:28.786269 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406d47e2-f654-4825-b27a-6bfd170938a5 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:28.800972 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 428/896] 10.222.0.118 () {56 vars in 1114 bytes} [Thu Jul 14 15:24:28 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:28.807085 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49f0674-dcc3-499a-aaa6-c9a8658de9f2 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:28.862275 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:28.898454 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406d47e2-f654-4825-b27a-6bfd170938a5 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:28.933126 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49f0674-dcc3-499a-aaa6-c9a8658de9f2 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:28.936704 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46d8bc4-c455-4417-bfaa-a1b7007b1cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:28.937530 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46d8bc4-c455-4417-bfaa-a1b7007b1cdd None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:28.937872 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46d8bc4-c455-4417-bfaa-a1b7007b1cdd None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:28.938179 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46d8bc4-c455-4417-bfaa-a1b7007b1cdd None admin] PATH_INFO: `/v3/services` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:28.939096 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46d8bc4-c455-4417-bfaa-a1b7007b1cdd None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:28.939405 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46d8bc4-c455-4417-bfaa-a1b7007b1cdd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:28.940910 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46d8bc4-c455-4417-bfaa-a1b7007b1cdd None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:28.946852 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 469/897] 10.222.0.118 () {56 vars in 1119 bytes} [Thu Jul 14 15:24:28 2022] GET /identity/v3/services?type=volumev3 => generated 364 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:24:28.954798 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46d8bc4-c455-4417-bfaa-a1b7007b1cdd None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:28.976039 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61babc2-5cbc-41f8-93af-50e35ac5c4c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:28.977054 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61babc2-5cbc-41f8-93af-50e35ac5c4c9 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:28.977503 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61babc2-5cbc-41f8-93af-50e35ac5c4c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:28.977916 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61babc2-5cbc-41f8-93af-50e35ac5c4c9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:28.987006 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61babc2-5cbc-41f8-93af-50e35ac5c4c9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:28.988858 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61babc2-5cbc-41f8-93af-50e35ac5c4c9 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:29.007631 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-b61babc2-5cbc-41f8-93af-50e35ac5c4c9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:24:29.007631 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:29.007631 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:29.007631 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:29.007631 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:29.007631 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:29.007631 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:29.007631 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:29.007631 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:29.007631 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:29.007631 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:29.007631 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:29.007631 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 15:24:29.007631 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 15:24:29.007631 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 15:24:29.008640 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 15:24:29.008640 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:29.008640 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:29.008640 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:29.008640 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:29.008640 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:29.008640 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:29.008640 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:29.008640 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:29.008640 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:29.008640 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:29.008640 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:29.008640 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:29.008640 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:29.008640 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:29.008640 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:29.008640 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:29.009548 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 15:24:29.009548 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 15:24:29.009548 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:24:29.009548 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:24:29.009548 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:24:29.009548 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:24:29.009548 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:24:29.009548 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:24:29.011660 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 429/898] 10.222.0.118 () {56 vars in 1116 bytes} [Thu Jul 14 15:24:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:29.022084 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61babc2-5cbc-41f8-93af-50e35ac5c4c9 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:29.055851 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:29.066494 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46d8bc4-c455-4417-bfaa-a1b7007b1cdd None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:29.104215 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264b2441-f4a6-46ba-a2f2-5d2d5d2b4b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:29.104442 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264b2441-f4a6-46ba-a2f2-5d2d5d2b4b0c None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:29.104698 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264b2441-f4a6-46ba-a2f2-5d2d5d2b4b0c None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:29.104965 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264b2441-f4a6-46ba-a2f2-5d2d5d2b4b0c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:29.105781 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264b2441-f4a6-46ba-a2f2-5d2d5d2b4b0c None admin] RBAC: Adding query filter params (interface=public, service_id=d3dd86423fb5480a940753b6998a817c, region_id=RegionOne) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:29.106115 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264b2441-f4a6-46ba-a2f2-5d2d5d2b4b0c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:29.107482 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264b2441-f4a6-46ba-a2f2-5d2d5d2b4b0c None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:29.108993 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:29.118031 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 470/899] 10.222.0.118 () {56 vars in 1256 bytes} [Thu Jul 14 15:24:28 2022] GET /identity/v3/endpoints?service_id=d3dd86423fb5480a940753b6998a817c&interface=public®ion_id=RegionOne => generated 195 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:29.119472 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264b2441-f4a6-46ba-a2f2-5d2d5d2b4b0c None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:29.140833 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61babc2-5cbc-41f8-93af-50e35ac5c4c9 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:29.181052 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb87341-ebc2-478c-a58d-ab837deba293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:29.182164 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb87341-ebc2-478c-a58d-ab837deba293 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:29.182698 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb87341-ebc2-478c-a58d-ab837deba293 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:29.183120 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb87341-ebc2-478c-a58d-ab837deba293 None admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:29.184058 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb87341-ebc2-478c-a58d-ab837deba293 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:29.184517 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb87341-ebc2-478c-a58d-ab837deba293 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:29.186288 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb87341-ebc2-478c-a58d-ab837deba293 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:29.205256 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 430/900] 10.222.0.118 () {56 vars in 1153 bytes} [Thu Jul 14 15:24:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:29.206427 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb87341-ebc2-478c-a58d-ab837deba293 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:29.226599 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264b2441-f4a6-46ba-a2f2-5d2d5d2b4b0c None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:29.262684 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51639a53-2cae-409f-98fa-6c6063aae295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:29.263342 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51639a53-2cae-409f-98fa-6c6063aae295 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:29.263615 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51639a53-2cae-409f-98fa-6c6063aae295 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:29.263882 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51639a53-2cae-409f-98fa-6c6063aae295 None admin] PATH_INFO: `/v3/services` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:29.264562 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51639a53-2cae-409f-98fa-6c6063aae295 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:29.266572 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51639a53-2cae-409f-98fa-6c6063aae295 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:29.272259 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 471/901] 10.222.0.118 () {56 vars in 1092 bytes} [Thu Jul 14 15:24:29 2022] GET /identity/v3/services => generated 1274 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:24:29.284244 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f49814-ae79-4adf-a53a-e113c9215fdb None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:29.284573 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f49814-ae79-4adf-a53a-e113c9215fdb None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:29.284792 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f49814-ae79-4adf-a53a-e113c9215fdb None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:29.290005 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 472/902] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:24:29 2022] GET /identity => generated 271 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:24:29.296153 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e473011d-72c9-4ec7-82e7-ad4345fe902b None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:29.296703 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e473011d-72c9-4ec7-82e7-ad4345fe902b None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:29.297124 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e473011d-72c9-4ec7-82e7-ad4345fe902b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:29.314461 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:29.317507 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-e473011d-72c9-4ec7-82e7-ad4345fe902b None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:29.319357 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-e473011d-72c9-4ec7-82e7-ad4345fe902b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:29.326544 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb87341-ebc2-478c-a58d-ab837deba293 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:29.370592 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2eaa9e-0a04-4906-9228-004ba8a1cf89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:29.371904 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2eaa9e-0a04-4906-9228-004ba8a1cf89 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:29.372333 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2eaa9e-0a04-4906-9228-004ba8a1cf89 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:29.372749 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2eaa9e-0a04-4906-9228-004ba8a1cf89 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:29.374392 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2eaa9e-0a04-4906-9228-004ba8a1cf89 None admin] RBAC: Adding query filter params (role.id=395d04a64fa447d88861d9397f70322e, scope.project.id=939bf9541f4a4afe86550f749d337680, user.id=f7ad5ae70939416e8157693e02997a58) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:29.374904 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2eaa9e-0a04-4906-9228-004ba8a1cf89 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:29.377471 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2eaa9e-0a04-4906-9228-004ba8a1cf89 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:29.386134 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 431/903] 10.222.0.118 () {56 vars in 1379 bytes} [Thu Jul 14 15:24:29 2022] GET /identity/v3/role_assignments?user.id=f7ad5ae70939416e8157693e02997a58&scope.project.id=939bf9541f4a4afe86550f749d337680&role.id=395d04a64fa447d88861d9397f70322e => generated 260 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:29.390487 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:29.410151 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 473/904] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:24:29 2022] POST /identity/v3/auth/tokens => generated 1364 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 15:24:29.429265 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2eaa9e-0a04-4906-9228-004ba8a1cf89 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:29.547419 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2eaa9e-0a04-4906-9228-004ba8a1cf89 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:29.586788 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c598d06-c34c-4843-9ed8-a7c4acfda3c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:29.587609 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c598d06-c34c-4843-9ed8-a7c4acfda3c9 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:29.587888 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c598d06-c34c-4843-9ed8-a7c4acfda3c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:29.588161 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c598d06-c34c-4843-9ed8-a7c4acfda3c9 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:29.588819 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c598d06-c34c-4843-9ed8-a7c4acfda3c9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:29.590272 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c598d06-c34c-4843-9ed8-a7c4acfda3c9 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:29.603687 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-9c598d06-c34c-4843-9ed8-a7c4acfda3c9 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 15:24:29.603687 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:29.603687 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 15:24:29.603687 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 15:24:29.603687 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 15:24:29.603687 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 15:24:29.603687 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 15:24:29.603687 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:24:29.603687 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 15:24:29.603687 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:24:29.603687 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 15:24:29.603687 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:24:29.603687 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:29.603687 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:29.603687 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:29.603687 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:29.604636 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:29.604636 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:29.604636 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:29.604636 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:29.604636 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:29.604636 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:29.604636 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:29.604636 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 15:24:29.604636 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 15:24:29.604636 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 15:24:29.604636 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 15:24:29.604636 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:29.604636 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:29.604636 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:29.604636 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:29.604636 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:29.605602 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:29.605602 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:29.605602 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:29.605602 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:29.605602 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:29.605602 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:29.605602 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:29.605602 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:29.605602 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:29.605602 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:29.605602 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:29.605602 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 15:24:29.605602 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:24:29.605602 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 15:24:29.605602 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:24:29.605602 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 432/905] 10.222.0.118 () {56 vars in 1137 bytes} [Thu Jul 14 15:24:29 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:29.613097 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e473011d-72c9-4ec7-82e7-ad4345fe902b None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:29.717786 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e473011d-72c9-4ec7-82e7-ad4345fe902b None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:29.754055 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea203e4-4cd6-4846-8993-33e43d7fc221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:29.755225 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea203e4-4cd6-4846-8993-33e43d7fc221 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:29.755509 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea203e4-4cd6-4846-8993-33e43d7fc221 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:29.755778 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea203e4-4cd6-4846-8993-33e43d7fc221 None admin] PATH_INFO: `/v3/services` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:29.756479 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea203e4-4cd6-4846-8993-33e43d7fc221 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:29.756790 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea203e4-4cd6-4846-8993-33e43d7fc221 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:29.758167 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea203e4-4cd6-4846-8993-33e43d7fc221 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:29.767751 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 474/906] 10.222.0.118 () {56 vars in 1131 bytes} [Thu Jul 14 15:24:29 2022] GET /identity/v3/services?name=compute_legacy => generated 132 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:29.771048 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c598d06-c34c-4843-9ed8-a7c4acfda3c9 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:29.791623 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:29.877344 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c598d06-c34c-4843-9ed8-a7c4acfda3c9 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:29.912570 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcadea2d-8753-4b82-be5f-e12297ea7451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:29.913241 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcadea2d-8753-4b82-be5f-e12297ea7451 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:29.913520 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcadea2d-8753-4b82-be5f-e12297ea7451 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:29.913790 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcadea2d-8753-4b82-be5f-e12297ea7451 None admin] PATH_INFO: `/v3/services` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:29.914530 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcadea2d-8753-4b82-be5f-e12297ea7451 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:29.914835 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcadea2d-8753-4b82-be5f-e12297ea7451 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:29.916208 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcadea2d-8753-4b82-be5f-e12297ea7451 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:29.921640 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 433/907] 10.222.0.118 () {56 vars in 1131 bytes} [Thu Jul 14 15:24:29 2022] GET /identity/v3/services?type=compute_legacy => generated 388 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:29.927770 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea203e4-4cd6-4846-8993-33e43d7fc221 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:29.991529 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:30.036243 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea203e4-4cd6-4846-8993-33e43d7fc221 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:30.074226 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef5f1ec-5201-4574-a1a0-76c7d87e0470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:30.074859 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef5f1ec-5201-4574-a1a0-76c7d87e0470 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:30.075141 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef5f1ec-5201-4574-a1a0-76c7d87e0470 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:30.075408 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef5f1ec-5201-4574-a1a0-76c7d87e0470 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:30.076192 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef5f1ec-5201-4574-a1a0-76c7d87e0470 None admin] RBAC: Adding query filter params (interface=public, service_id=c6c327b2909c4a5d9e7f33106738daa7, region_id=RegionOne) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:30.076499 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef5f1ec-5201-4574-a1a0-76c7d87e0470 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:30.077862 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef5f1ec-5201-4574-a1a0-76c7d87e0470 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:30.087623 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 475/908] 10.222.0.118 () {56 vars in 1256 bytes} [Thu Jul 14 15:24:29 2022] GET /identity/v3/endpoints?service_id=c6c327b2909c4a5d9e7f33106738daa7&interface=public®ion_id=RegionOne => generated 195 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:30.088994 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcadea2d-8753-4b82-be5f-e12297ea7451 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:30.179526 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:30.198882 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcadea2d-8753-4b82-be5f-e12297ea7451 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:30.234106 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12066704-22c5-4ec8-bc37-d30e18496d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:30.234782 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12066704-22c5-4ec8-bc37-d30e18496d9e None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:30.235062 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12066704-22c5-4ec8-bc37-d30e18496d9e None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:30.235338 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12066704-22c5-4ec8-bc37-d30e18496d9e None admin] PATH_INFO: `/v3/services` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:30.236626 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12066704-22c5-4ec8-bc37-d30e18496d9e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:30.238008 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12066704-22c5-4ec8-bc37-d30e18496d9e None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:30.248852 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 434/909] 10.222.0.118 () {56 vars in 1092 bytes} [Thu Jul 14 15:24:30 2022] GET /identity/v3/services => generated 1274 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:24:30.519640 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efd8d79-2a86-42e2-9518-52485ca68793 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:30.519980 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efd8d79-2a86-42e2-9518-52485ca68793 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:30.520153 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efd8d79-2a86-42e2-9518-52485ca68793 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:30.521753 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 476/910] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:24:30 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:24:30.527090 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa53f8-63d9-4a2d-b6e0-0ddfea6998a2 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:30.527375 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa53f8-63d9-4a2d-b6e0-0ddfea6998a2 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:30.527656 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa53f8-63d9-4a2d-b6e0-0ddfea6998a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:30.544997 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-a7aa53f8-63d9-4a2d-b6e0-0ddfea6998a2 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:30.546241 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-a7aa53f8-63d9-4a2d-b6e0-0ddfea6998a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:30.617536 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 435/911] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:24:30 2022] POST /identity/v3/auth/tokens => generated 1364 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:24:30.640545 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efd8d79-2a86-42e2-9518-52485ca68793 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:30.750713 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efd8d79-2a86-42e2-9518-52485ca68793 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:30.773894 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:30.789659 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92810a21-b017-4cb5-811a-84f8db26a7b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:30.790355 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92810a21-b017-4cb5-811a-84f8db26a7b4 None admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:30.790638 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92810a21-b017-4cb5-811a-84f8db26a7b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:30.790916 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92810a21-b017-4cb5-811a-84f8db26a7b4 None admin] PATH_INFO: `/v3/services` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:30.791691 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92810a21-b017-4cb5-811a-84f8db26a7b4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:30.793143 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92810a21-b017-4cb5-811a-84f8db26a7b4 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:30.809019 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 477/912] 10.222.0.118 () {60 vars in 1146 bytes} [Thu Jul 14 15:24:30 2022] POST /identity/v3/services => generated 242 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:24:31.405774 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80787332-834a-4cc7-b3b6-8426cedc106d None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:31.406319 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80787332-834a-4cc7-b3b6-8426cedc106d None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:31.406319 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80787332-834a-4cc7-b3b6-8426cedc106d None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:31.408486 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 436/913] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:24:31 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:24:31.413982 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df443234-2464-4f09-aa90-f3920caaf34b None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:31.414444 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df443234-2464-4f09-aa90-f3920caaf34b None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:31.414625 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df443234-2464-4f09-aa90-f3920caaf34b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:31.433265 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-df443234-2464-4f09-aa90-f3920caaf34b None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:31.434516 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-df443234-2464-4f09-aa90-f3920caaf34b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:31.510432 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 478/914] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:24:31 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:24:31.521090 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c390ec6a-0c5b-415a-9bd8-1bc647e7e3fa None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:31.521646 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c390ec6a-0c5b-415a-9bd8-1bc647e7e3fa None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:31.522161 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c390ec6a-0c5b-415a-9bd8-1bc647e7e3fa None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:31.524024 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 437/915] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:24:31 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:24:31.529302 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ace6ad-cc8e-43ac-81fb-c66c016ae835 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:31.529818 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ace6ad-cc8e-43ac-81fb-c66c016ae835 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:31.530343 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ace6ad-cc8e-43ac-81fb-c66c016ae835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:31.534357 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c390ec6a-0c5b-415a-9bd8-1bc647e7e3fa None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:31.548094 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-83ace6ad-cc8e-43ac-81fb-c66c016ae835 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:31.549840 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-83ace6ad-cc8e-43ac-81fb-c66c016ae835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:31.620540 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:31.623404 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 479/916] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:24:31 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:24:31.647042 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ace6ad-cc8e-43ac-81fb-c66c016ae835 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:31.664640 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c390ec6a-0c5b-415a-9bd8-1bc647e7e3fa None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:31.683164 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:31.708992 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76787e28-764b-441a-b675-db54ff0519bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:31.710345 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76787e28-764b-441a-b675-db54ff0519bb None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:31.710856 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76787e28-764b-441a-b675-db54ff0519bb None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:31.711347 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76787e28-764b-441a-b675-db54ff0519bb None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:31.712636 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76787e28-764b-441a-b675-db54ff0519bb None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:31.714790 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76787e28-764b-441a-b675-db54ff0519bb None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:31.729319 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-76787e28-764b-441a-b675-db54ff0519bb None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 15:24:31.729319 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:31.729319 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 15:24:31.729319 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 15:24:31.729319 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 15:24:31.729319 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 15:24:31.729319 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 15:24:31.729319 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:24:31.729319 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 15:24:31.729319 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:24:31.729319 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 15:24:31.729319 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:24:31.729319 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:31.729319 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:31.729319 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:31.729319 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:31.729319 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:31.730297 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:31.730297 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:31.730297 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:31.730297 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:31.730297 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:31.730297 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:31.730297 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 15:24:31.730297 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 15:24:31.730297 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 15:24:31.730297 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 15:24:31.730297 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:31.730297 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:31.730297 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:31.730297 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:31.730297 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:31.730297 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:31.731129 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:31.731129 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:31.731129 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:31.731129 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:31.731129 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:31.731129 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:31.731129 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:31.731129 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:31.731129 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:31.731129 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:31.731129 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 15:24:31.731129 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:24:31.731129 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 15:24:31.731129 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:24:31.731847 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 438/917] 10.222.0.118 () {56 vars in 1119 bytes} [Thu Jul 14 15:24:31 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:31.738279 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76787e28-764b-441a-b675-db54ff0519bb None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:31.773226 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ace6ad-cc8e-43ac-81fb-c66c016ae835 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:31.809199 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8daf53-b501-4460-aa27-d3b210be6d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:31.810077 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8daf53-b501-4460-aa27-d3b210be6d12 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:31.810443 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8daf53-b501-4460-aa27-d3b210be6d12 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:31.810638 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8daf53-b501-4460-aa27-d3b210be6d12 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:31.822921 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8daf53-b501-4460-aa27-d3b210be6d12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:24:31.831183 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-6f8daf53-b501-4460-aa27-d3b210be6d12 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 15:24:31.831183 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:31.831183 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:31.831183 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:31.831183 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:31.831183 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:31.831183 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:31.831183 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:31.831183 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:31.831183 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:31.831183 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:31.831183 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:31.831183 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:24:31.831183 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:24:31.831183 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:24:31.831183 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:24:31.832134 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:24:31.832134 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:24:31.832134 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:24:31.832134 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:24:31.832134 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:31.832134 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:31.832134 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:31.832134 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:31.832134 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:31.832134 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:31.832134 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:31.832134 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:31.832134 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:31.832134 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:31.832134 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:31.832134 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:31.832949 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:31.832949 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:31.832949 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:31.832949 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:31.832949 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:24:31.832949 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:24:31.832949 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:24:31.832949 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:24:31.832949 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:24:31.832949 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:24:31.832949 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 15:24:31.832949 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:24:31.837445 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 480/918] 10.222.0.118 () {56 vars in 1125 bytes} [Thu Jul 14 15:24:31 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:24:31.838462 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8daf53-b501-4460-aa27-d3b210be6d12 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:31.868659 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76787e28-764b-441a-b675-db54ff0519bb None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:31.904632 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfb6c4e-0c79-4e26-a151-39ca8298e7e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:31.905664 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfb6c4e-0c79-4e26-a151-39ca8298e7e3 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:31.906307 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfb6c4e-0c79-4e26-a151-39ca8298e7e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:31.906809 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfb6c4e-0c79-4e26-a151-39ca8298e7e3 None admin] PATH_INFO: `/v3/services` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:31.907838 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfb6c4e-0c79-4e26-a151-39ca8298e7e3 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:31.908365 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfb6c4e-0c79-4e26-a151-39ca8298e7e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:31.910081 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfb6c4e-0c79-4e26-a151-39ca8298e7e3 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:31.920254 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 439/919] 10.222.0.118 () {56 vars in 1119 bytes} [Thu Jul 14 15:24:31 2022] GET /identity/v3/services?name=volumev3 => generated 126 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:24:31.921401 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfb6c4e-0c79-4e26-a151-39ca8298e7e3 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:31.925855 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:31.941151 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:31.951805 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8daf53-b501-4460-aa27-d3b210be6d12 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:31.995908 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99307980-5a76-4f54-8ccd-8d9ae32d11ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:31.996583 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99307980-5a76-4f54-8ccd-8d9ae32d11ef None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:31.996861 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99307980-5a76-4f54-8ccd-8d9ae32d11ef None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:31.997132 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99307980-5a76-4f54-8ccd-8d9ae32d11ef None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:31.997894 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99307980-5a76-4f54-8ccd-8d9ae32d11ef None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:31.998233 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99307980-5a76-4f54-8ccd-8d9ae32d11ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:31.999610 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99307980-5a76-4f54-8ccd-8d9ae32d11ef None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:32.014253 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 481/920] 10.222.0.118 () {56 vars in 1120 bytes} [Thu Jul 14 15:24:31 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 340 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:24:32.015922 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99307980-5a76-4f54-8ccd-8d9ae32d11ef None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:32.046016 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfb6c4e-0c79-4e26-a151-39ca8298e7e3 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:32.091509 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b09153-8d6c-4b02-953c-982d2f00fbb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:32.092558 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b09153-8d6c-4b02-953c-982d2f00fbb7 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:32.093096 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b09153-8d6c-4b02-953c-982d2f00fbb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:32.093572 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b09153-8d6c-4b02-953c-982d2f00fbb7 None admin] PATH_INFO: `/v3/services` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:32.094511 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b09153-8d6c-4b02-953c-982d2f00fbb7 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:32.095979 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b09153-8d6c-4b02-953c-982d2f00fbb7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:32.097576 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b09153-8d6c-4b02-953c-982d2f00fbb7 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:32.109214 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 440/921] 10.222.0.118 () {56 vars in 1119 bytes} [Thu Jul 14 15:24:31 2022] GET /identity/v3/services?type=volumev3 => generated 364 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:32.112253 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b09153-8d6c-4b02-953c-982d2f00fbb7 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:32.133288 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99307980-5a76-4f54-8ccd-8d9ae32d11ef None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:32.170082 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0084c4-5fad-46e5-8a88-92d7bece4725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:32.171044 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0084c4-5fad-46e5-8a88-92d7bece4725 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:32.171265 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0084c4-5fad-46e5-8a88-92d7bece4725 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:32.171536 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0084c4-5fad-46e5-8a88-92d7bece4725 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:32.183473 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0084c4-5fad-46e5-8a88-92d7bece4725 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:32.184907 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0084c4-5fad-46e5-8a88-92d7bece4725 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:32.201391 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:32.203363 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-fc0084c4-5fad-46e5-8a88-92d7bece4725 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:32.203363 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:32.203363 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:32.203363 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:32.203363 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:32.203363 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:32.203363 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:32.203363 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:32.203363 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:32.203363 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:32.203363 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:32.203363 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:32.203363 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:24:32.203363 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:24:32.203363 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:24:32.204397 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:24:32.204397 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:32.204397 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:32.204397 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:32.204397 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:32.204397 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:32.204397 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:32.204397 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:32.204397 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:32.204397 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:32.204397 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:32.204397 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:32.204397 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:32.204397 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:32.204397 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:32.204397 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:32.204397 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:32.205456 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:24:32.205456 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:24:32.205456 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:32.205456 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:24:32.210072 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 482/922] 10.222.0.118 () {56 vars in 1113 bytes} [Thu Jul 14 15:24:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:24:32.211527 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0084c4-5fad-46e5-8a88-92d7bece4725 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:32.227149 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:32.247563 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b09153-8d6c-4b02-953c-982d2f00fbb7 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:32.284445 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd5892b-92d6-436c-a5cd-5f1758e7fe16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:32.285100 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd5892b-92d6-436c-a5cd-5f1758e7fe16 None admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:32.285376 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd5892b-92d6-436c-a5cd-5f1758e7fe16 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:32.285644 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd5892b-92d6-436c-a5cd-5f1758e7fe16 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:32.286407 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd5892b-92d6-436c-a5cd-5f1758e7fe16 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:32.288064 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd5892b-92d6-436c-a5cd-5f1758e7fe16 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:32.314014 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 441/923] 10.222.0.118 () {60 vars in 1149 bytes} [Thu Jul 14 15:24:32 2022] POST /identity/v3/endpoints => generated 348 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:24:32.352368 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0084c4-5fad-46e5-8a88-92d7bece4725 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:32.397073 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5923eb-e9c4-41fb-827d-bf49f36df59e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:32.397756 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5923eb-e9c4-41fb-827d-bf49f36df59e None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:32.398054 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5923eb-e9c4-41fb-827d-bf49f36df59e None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:32.398326 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5923eb-e9c4-41fb-827d-bf49f36df59e None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:32.399064 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5923eb-e9c4-41fb-827d-bf49f36df59e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:32.399370 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5923eb-e9c4-41fb-827d-bf49f36df59e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:32.400763 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5923eb-e9c4-41fb-827d-bf49f36df59e None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:32.412127 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e2c255-4644-45bf-b404-db481f1466b2 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:32.412660 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e2c255-4644-45bf-b404-db481f1466b2 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:32.412660 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e2c255-4644-45bf-b404-db481f1466b2 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:32.415880 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 483/925] 10.222.0.118 () {56 vars in 1114 bytes} [Thu Jul 14 15:24:32 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:32.416320 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 442/925] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:24:32 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 14 15:24:32.420153 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebafd950-41bf-478b-976c-bbc17536c8d0 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:32.420441 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebafd950-41bf-478b-976c-bbc17536c8d0 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:32.420733 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebafd950-41bf-478b-976c-bbc17536c8d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:32.424188 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e2c255-4644-45bf-b404-db481f1466b2 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:32.444573 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-ebafd950-41bf-478b-976c-bbc17536c8d0 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:32.445844 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-ebafd950-41bf-478b-976c-bbc17536c8d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:32.532994 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:32.546058 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 484/926] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:24:32 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:24:32.566867 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e2c255-4644-45bf-b404-db481f1466b2 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:32.567353 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebafd950-41bf-478b-976c-bbc17536c8d0 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:32.599267 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:32.605373 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b587e26-bd8d-40aa-ab4f-b1daab319fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:32.606241 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b587e26-bd8d-40aa-ab4f-b1daab319fdf None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:32.606696 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b587e26-bd8d-40aa-ab4f-b1daab319fdf None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:32.607239 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b587e26-bd8d-40aa-ab4f-b1daab319fdf None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:32.616598 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b587e26-bd8d-40aa-ab4f-b1daab319fdf None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:32.618273 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b587e26-bd8d-40aa-ab4f-b1daab319fdf None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:32.634716 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-7b587e26-bd8d-40aa-ab4f-b1daab319fdf None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 15:24:32.634716 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:32.634716 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:32.634716 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:32.634716 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:32.634716 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:32.634716 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:32.634716 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:32.634716 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:32.634716 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:32.634716 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:32.634716 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:32.634716 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 15:24:32.634716 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 15:24:32.634716 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 15:24:32.634716 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 15:24:32.635697 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:32.635697 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:32.635697 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 15:24:32.635697 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:24:32.635697 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 15:24:32.635697 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:24:32.635697 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:32.635697 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:32.635697 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:32.635697 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:32.635697 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:32.635697 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:32.635697 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:32.635697 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:32.635697 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:32.635697 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:32.635697 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:32.635697 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:32.636782 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:32.636782 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:32.636782 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 15:24:32.636782 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 15:24:32.636782 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 15:24:32.636782 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 15:24:32.636782 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 15:24:32.636782 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 15:24:32.636782 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 15:24:32.636782 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:24:32.636782 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 443/927] 10.222.0.118 () {56 vars in 1122 bytes} [Thu Jul 14 15:24:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:32.642660 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b587e26-bd8d-40aa-ab4f-b1daab319fdf None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:32.694947 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebafd950-41bf-478b-976c-bbc17536c8d0 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:32.735310 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dea8bff-dc65-49cd-9273-fa4f46730e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:32.736487 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dea8bff-dc65-49cd-9273-fa4f46730e54 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:32.736987 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dea8bff-dc65-49cd-9273-fa4f46730e54 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:32.737568 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dea8bff-dc65-49cd-9273-fa4f46730e54 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:32.738593 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dea8bff-dc65-49cd-9273-fa4f46730e54 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:32.740194 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dea8bff-dc65-49cd-9273-fa4f46730e54 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:32.754558 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-1dea8bff-dc65-49cd-9273-fa4f46730e54 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 15:24:32.754558 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:32.754558 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 15:24:32.754558 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 15:24:32.754558 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 15:24:32.754558 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 15:24:32.754558 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 15:24:32.754558 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:24:32.754558 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 15:24:32.754558 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:24:32.754558 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 15:24:32.754558 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:24:32.754558 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:32.754558 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:32.754558 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:32.754558 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:32.755912 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:32.755912 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:32.755912 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:32.755912 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:32.755912 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:32.755912 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:32.755912 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:32.755912 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 15:24:32.755912 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 15:24:32.755912 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 15:24:32.755912 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 15:24:32.755912 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:32.755912 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:32.755912 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:32.755912 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:32.755912 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:32.756837 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:32.756837 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:32.756837 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:32.756837 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:32.756837 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:32.756837 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:32.756837 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:32.756837 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:32.756837 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:32.756837 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:32.756837 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:32.756837 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 15:24:32.756837 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:24:32.756837 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 15:24:32.756837 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:24:32.757631 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b587e26-bd8d-40aa-ab4f-b1daab319fdf None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:32.760140 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 485/928] 10.222.0.118 () {56 vars in 1137 bytes} [Thu Jul 14 15:24:32 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:24:32.769814 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dea8bff-dc65-49cd-9273-fa4f46730e54 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:32.795986 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef37fcb0-4237-4664-a04e-a39813332f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:32.796695 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef37fcb0-4237-4664-a04e-a39813332f29 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:32.796967 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef37fcb0-4237-4664-a04e-a39813332f29 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:32.797212 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef37fcb0-4237-4664-a04e-a39813332f29 None admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:32.798123 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef37fcb0-4237-4664-a04e-a39813332f29 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:32.798433 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef37fcb0-4237-4664-a04e-a39813332f29 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:32.799878 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef37fcb0-4237-4664-a04e-a39813332f29 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:32.825181 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 444/929] 10.222.0.118 () {56 vars in 1154 bytes} [Thu Jul 14 15:24:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 386 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:24:32.826534 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef37fcb0-4237-4664-a04e-a39813332f29 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:32.846602 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:32.876611 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:32.889017 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dea8bff-dc65-49cd-9273-fa4f46730e54 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:32.925255 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704fb6cf-81ff-4d2b-b4f8-a5a62f148c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:32.925922 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704fb6cf-81ff-4d2b-b4f8-a5a62f148c46 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:32.926449 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704fb6cf-81ff-4d2b-b4f8-a5a62f148c46 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:32.926584 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704fb6cf-81ff-4d2b-b4f8-a5a62f148c46 None admin] PATH_INFO: `/v3/services` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:32.927198 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704fb6cf-81ff-4d2b-b4f8-a5a62f148c46 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:32.927507 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704fb6cf-81ff-4d2b-b4f8-a5a62f148c46 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:32.928876 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704fb6cf-81ff-4d2b-b4f8-a5a62f148c46 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:32.933825 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 486/930] 10.222.0.118 () {56 vars in 1131 bytes} [Thu Jul 14 15:24:32 2022] GET /identity/v3/services?name=compute_legacy => generated 132 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:32.935131 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e96cf06-746f-43ab-b1fc-9291c6b1c3ea None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:32.935467 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e96cf06-746f-43ab-b1fc-9291c6b1c3ea None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:32.935745 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e96cf06-746f-43ab-b1fc-9291c6b1c3ea None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:32.937094 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 487/931] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:24:32 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:24:32.939814 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e96cf06-746f-43ab-b1fc-9291c6b1c3ea None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:32.944880 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef37fcb0-4237-4664-a04e-a39813332f29 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:32.983226 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc7079a-7cd7-40c4-bbc3-126b2deb835e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:32.984293 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc7079a-7cd7-40c4-bbc3-126b2deb835e None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:32.984728 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc7079a-7cd7-40c4-bbc3-126b2deb835e None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:32.985141 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc7079a-7cd7-40c4-bbc3-126b2deb835e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:32.995919 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc7079a-7cd7-40c4-bbc3-126b2deb835e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:32.997540 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc7079a-7cd7-40c4-bbc3-126b2deb835e None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:33.016063 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-abc7079a-7cd7-40c4-bbc3-126b2deb835e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:33.016063 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:33.016063 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:33.016063 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:33.016063 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:33.016063 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:33.016063 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:33.016063 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:33.016063 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:33.016063 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:33.016063 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:33.016063 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:33.016063 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:24:33.016063 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:24:33.016063 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:24:33.018028 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:24:33.018028 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:33.018028 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:33.018028 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:33.018028 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:33.018028 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:33.018028 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:33.018028 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:33.018028 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:33.018028 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:33.018028 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:33.018028 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:33.018028 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:33.018028 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:33.018028 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:33.018028 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:33.018028 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:33.019105 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:24:33.019105 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:24:33.019105 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:33.019105 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:24:33.025101 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 445/932] 10.222.0.118 () {56 vars in 1113 bytes} [Thu Jul 14 15:24:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:24:33.026600 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224c499e-1172-40ee-bb6e-6abebb6e6291 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:33.026883 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224c499e-1172-40ee-bb6e-6abebb6e6291 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:33.027157 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224c499e-1172-40ee-bb6e-6abebb6e6291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:33.045349 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e96cf06-746f-43ab-b1fc-9291c6b1c3ea None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:33.045614 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-224c499e-1172-40ee-bb6e-6abebb6e6291 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:33.046770 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-224c499e-1172-40ee-bb6e-6abebb6e6291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:33.069551 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:33.080952 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d92c67-1479-4b9d-96e2-321c52f32aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:33.081619 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d92c67-1479-4b9d-96e2-321c52f32aba None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:33.081902 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d92c67-1479-4b9d-96e2-321c52f32aba None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:33.082208 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d92c67-1479-4b9d-96e2-321c52f32aba None admin] PATH_INFO: `/v3/services` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:33.083442 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d92c67-1479-4b9d-96e2-321c52f32aba None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:33.083756 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d92c67-1479-4b9d-96e2-321c52f32aba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:33.085122 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d92c67-1479-4b9d-96e2-321c52f32aba None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:33.090179 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 488/933] 10.222.0.118 () {56 vars in 1131 bytes} [Thu Jul 14 15:24:32 2022] GET /identity/v3/services?type=compute_legacy => generated 388 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:24:33.090964 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d92c67-1479-4b9d-96e2-321c52f32aba None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:33.120157 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 446/934] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:24:33 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:24:33.121202 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224c499e-1172-40ee-bb6e-6abebb6e6291 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:33.147193 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:33.228088 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d92c67-1479-4b9d-96e2-321c52f32aba None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:33.231649 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224c499e-1172-40ee-bb6e-6abebb6e6291 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:33.263727 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e392e6f8-03d8-463e-ba6b-537213d03d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:33.264314 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e392e6f8-03d8-463e-ba6b-537213d03d68 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:33.264596 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e392e6f8-03d8-463e-ba6b-537213d03d68 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:33.264875 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e392e6f8-03d8-463e-ba6b-537213d03d68 None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:33.265720 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e392e6f8-03d8-463e-ba6b-537213d03d68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:33.266058 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e392e6f8-03d8-463e-ba6b-537213d03d68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:33.267463 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e392e6f8-03d8-463e-ba6b-537213d03d68 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:33.270256 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a82123-bb69-444e-a19e-f03a69bac246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:33.270915 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a82123-bb69-444e-a19e-f03a69bac246 None admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:33.271195 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a82123-bb69-444e-a19e-f03a69bac246 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:33.271468 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a82123-bb69-444e-a19e-f03a69bac246 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:33.272207 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a82123-bb69-444e-a19e-f03a69bac246 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:33.273558 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a82123-bb69-444e-a19e-f03a69bac246 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:33.284977 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 489/935] 10.222.0.118 () {56 vars in 1114 bytes} [Thu Jul 14 15:24:33 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:33.286150 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e392e6f8-03d8-463e-ba6b-537213d03d68 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:33.300983 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 447/936] 10.222.0.118 () {60 vars in 1149 bytes} [Thu Jul 14 15:24:33 2022] POST /identity/v3/endpoints => generated 349 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:24:33.302278 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a82123-bb69-444e-a19e-f03a69bac246 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:33.343502 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:33.414129 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e392e6f8-03d8-463e-ba6b-537213d03d68 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:33.421423 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:33.460641 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a82123-bb69-444e-a19e-f03a69bac246 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:33.467212 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea30403a-aa59-4ba0-b9c0-ed3cf342ea42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:33.467695 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea30403a-aa59-4ba0-b9c0-ed3cf342ea42 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:33.467939 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea30403a-aa59-4ba0-b9c0-ed3cf342ea42 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:33.468209 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea30403a-aa59-4ba0-b9c0-ed3cf342ea42 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:33.468907 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea30403a-aa59-4ba0-b9c0-ed3cf342ea42 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:33.470756 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea30403a-aa59-4ba0-b9c0-ed3cf342ea42 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:33.483379 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-ea30403a-aa59-4ba0-b9c0-ed3cf342ea42 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 15:24:33.483379 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:33.483379 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 15:24:33.483379 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 15:24:33.483379 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 15:24:33.483379 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 15:24:33.483379 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 15:24:33.483379 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:24:33.483379 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 15:24:33.483379 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:24:33.483379 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 15:24:33.483379 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:24:33.483379 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:33.483379 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:33.483379 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:33.483379 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:33.483379 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:33.484451 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:33.484451 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:33.484451 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:33.484451 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:33.484451 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:33.484451 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:33.484451 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 15:24:33.484451 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 15:24:33.484451 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 15:24:33.484451 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 15:24:33.484451 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:33.484451 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:33.484451 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:33.484451 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:33.484451 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:33.484451 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:33.485836 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:33.485836 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:33.485836 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:33.485836 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:33.485836 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:33.485836 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:33.485836 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:33.485836 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:33.485836 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:33.485836 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:33.485836 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 15:24:33.485836 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:24:33.485836 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 15:24:33.485836 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:24:33.485836 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 490/937] 10.222.0.118 () {56 vars in 1131 bytes} [Thu Jul 14 15:24:33 2022] GET /identity/v3/services/object-store => generated 93 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:33.491645 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea30403a-aa59-4ba0-b9c0-ed3cf342ea42 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:33.513283 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6641c4e-44d7-4925-9ab3-32bed8dba048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:33.514243 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6641c4e-44d7-4925-9ab3-32bed8dba048 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:33.514468 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6641c4e-44d7-4925-9ab3-32bed8dba048 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:33.514760 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6641c4e-44d7-4925-9ab3-32bed8dba048 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:33.524336 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6641c4e-44d7-4925-9ab3-32bed8dba048 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:33.525836 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6641c4e-44d7-4925-9ab3-32bed8dba048 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:33.542248 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-e6641c4e-44d7-4925-9ab3-32bed8dba048 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:24:33.542248 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:33.542248 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:33.542248 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:33.542248 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:33.542248 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:33.542248 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:33.542248 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:33.542248 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:33.542248 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:33.542248 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:33.542248 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:33.542248 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 15:24:33.542248 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 15:24:33.542248 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 15:24:33.543203 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 15:24:33.543203 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:33.543203 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:33.543203 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:33.543203 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:33.543203 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:33.543203 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:33.543203 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:33.543203 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:33.543203 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:33.543203 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:33.543203 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:33.543203 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:33.543203 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:33.543203 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:33.543203 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:33.543203 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:33.544239 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 15:24:33.544239 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 15:24:33.544239 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:24:33.544239 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:24:33.544239 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:24:33.544239 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:24:33.544239 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:24:33.544239 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:24:33.544239 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 448/938] 10.222.0.118 () {56 vars in 1116 bytes} [Thu Jul 14 15:24:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:33.550926 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6641c4e-44d7-4925-9ab3-32bed8dba048 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:33.620627 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea30403a-aa59-4ba0-b9c0-ed3cf342ea42 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:33.631914 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:33.660456 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3272995-1747-4913-97bc-f1f7378ff2e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:33.661169 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3272995-1747-4913-97bc-f1f7378ff2e3 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:33.661458 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3272995-1747-4913-97bc-f1f7378ff2e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:33.661726 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3272995-1747-4913-97bc-f1f7378ff2e3 None admin] PATH_INFO: `/v3/services` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:33.662476 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3272995-1747-4913-97bc-f1f7378ff2e3 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:33.662782 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3272995-1747-4913-97bc-f1f7378ff2e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:33.664148 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3272995-1747-4913-97bc-f1f7378ff2e3 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:33.674985 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 491/939] 10.222.0.118 () {56 vars in 1127 bytes} [Thu Jul 14 15:24:33 2022] GET /identity/v3/services?name=object-store => generated 130 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:24:33.680367 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3272995-1747-4913-97bc-f1f7378ff2e3 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:33.723763 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6641c4e-44d7-4925-9ab3-32bed8dba048 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:33.768895 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd0e3c1-34bc-481a-a425-07968bec4b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:33.769478 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd0e3c1-34bc-481a-a425-07968bec4b79 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:33.770564 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd0e3c1-34bc-481a-a425-07968bec4b79 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:33.770853 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd0e3c1-34bc-481a-a425-07968bec4b79 None admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:33.771917 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd0e3c1-34bc-481a-a425-07968bec4b79 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:33.772241 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd0e3c1-34bc-481a-a425-07968bec4b79 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:33.774813 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd0e3c1-34bc-481a-a425-07968bec4b79 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:33.777499 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:33.798824 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 449/940] 10.222.0.118 () {56 vars in 1153 bytes} [Thu Jul 14 15:24:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:33.799316 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd0e3c1-34bc-481a-a425-07968bec4b79 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:33.812576 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3272995-1747-4913-97bc-f1f7378ff2e3 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:33.850126 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e975394-fffa-4e45-b41b-3258a7532ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:33.850798 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e975394-fffa-4e45-b41b-3258a7532ef5 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:33.851074 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e975394-fffa-4e45-b41b-3258a7532ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:33.851367 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e975394-fffa-4e45-b41b-3258a7532ef5 None admin] PATH_INFO: `/v3/services` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:33.852100 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e975394-fffa-4e45-b41b-3258a7532ef5 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:33.852407 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e975394-fffa-4e45-b41b-3258a7532ef5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:33.853871 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e975394-fffa-4e45-b41b-3258a7532ef5 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:33.864933 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 492/941] 10.222.0.118 () {56 vars in 1127 bytes} [Thu Jul 14 15:24:33 2022] GET /identity/v3/services?type=object-store => generated 358 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:33.866288 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e975394-fffa-4e45-b41b-3258a7532ef5 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:33.903426 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:33.953988 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd0e3c1-34bc-481a-a425-07968bec4b79 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:33.980326 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e975394-fffa-4e45-b41b-3258a7532ef5 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:33.985572 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622703f4-c935-46ff-a13f-27d07180b4ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:33.986500 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622703f4-c935-46ff-a13f-27d07180b4ca None admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:33.986781 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622703f4-c935-46ff-a13f-27d07180b4ca None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:33.987055 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622703f4-c935-46ff-a13f-27d07180b4ca None admin] PATH_INFO: `/v3/projects/939bf9541f4a4afe86550f749d337680/users/f7ad5ae70939416e8157693e02997a58/roles/395d04a64fa447d88861d9397f70322e` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:33.989529 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622703f4-c935-46ff-a13f-27d07180b4ca None admin] RBAC: Authorizing `identity:create_grant(project_id=939bf9541f4a4afe86550f749d337680, user_id=f7ad5ae70939416e8157693e02997a58, role_id=395d04a64fa447d88861d9397f70322e)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:33.991056 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622703f4-c935-46ff-a13f-27d07180b4ca None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:34.009532 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 450/942] 10.222.0.118 () {58 vars in 1444 bytes} [Thu Jul 14 15:24:33 2022] PUT /identity/v3/projects/939bf9541f4a4afe86550f749d337680/users/f7ad5ae70939416e8157693e02997a58/roles/395d04a64fa447d88861d9397f70322e => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:24:34.021275 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bd9a67-3041-47f7-88c8-9bc42aff9114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:34.021921 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd9a67-3041-47f7-88c8-9bc42aff9114 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:34.022241 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd9a67-3041-47f7-88c8-9bc42aff9114 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:34.022516 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd9a67-3041-47f7-88c8-9bc42aff9114 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:34.023403 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bd9a67-3041-47f7-88c8-9bc42aff9114 None admin] RBAC: Adding query filter params (interface=public, service_id=936a33ad93eb4639b0c43024928fa139, region_id=RegionOne) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:34.023724 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bd9a67-3041-47f7-88c8-9bc42aff9114 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:34.025314 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bd9a67-3041-47f7-88c8-9bc42aff9114 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:34.037677 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 493/943] 10.222.0.118 () {56 vars in 1256 bytes} [Thu Jul 14 15:24:33 2022] GET /identity/v3/endpoints?service_id=936a33ad93eb4639b0c43024928fa139&interface=public®ion_id=RegionOne => generated 195 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:34.039644 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622703f4-c935-46ff-a13f-27d07180b4ca None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:34.106097 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:34.165900 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622703f4-c935-46ff-a13f-27d07180b4ca None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:34.207035 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f538fbe0-074b-4341-b316-9ce661abaef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:34.207716 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f538fbe0-074b-4341-b316-9ce661abaef0 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:34.207997 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f538fbe0-074b-4341-b316-9ce661abaef0 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:34.208270 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f538fbe0-074b-4341-b316-9ce661abaef0 None admin] PATH_INFO: `/v3/services` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:34.208957 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f538fbe0-074b-4341-b316-9ce661abaef0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:34.210380 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f538fbe0-074b-4341-b316-9ce661abaef0 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:34.218103 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 451/944] 10.222.0.118 () {56 vars in 1092 bytes} [Thu Jul 14 15:24:34 2022] GET /identity/v3/services => generated 1504 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:24:34.568817 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7b7de8-28bc-49f8-b721-2095b4d851f9 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:34.569343 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7b7de8-28bc-49f8-b721-2095b4d851f9 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:34.569343 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7b7de8-28bc-49f8-b721-2095b4d851f9 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:34.571043 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 494/945] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:24:34 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:24:34.576179 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdab3d43-0875-4f41-ae65-af5fe2783170 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:34.576584 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdab3d43-0875-4f41-ae65-af5fe2783170 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:34.576766 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdab3d43-0875-4f41-ae65-af5fe2783170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:34.594562 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-cdab3d43-0875-4f41-ae65-af5fe2783170 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:34.595811 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-cdab3d43-0875-4f41-ae65-af5fe2783170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:34.665299 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 452/946] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:24:34 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:24:34.689351 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7b7de8-28bc-49f8-b721-2095b4d851f9 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:34.794544 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:34.800004 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7b7de8-28bc-49f8-b721-2095b4d851f9 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:34.837653 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf21308-785e-432d-93f3-c0bb4726feeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:34.838322 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf21308-785e-432d-93f3-c0bb4726feeb None admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:34.838602 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf21308-785e-432d-93f3-c0bb4726feeb None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:34.838918 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf21308-785e-432d-93f3-c0bb4726feeb None admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:34.839643 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf21308-785e-432d-93f3-c0bb4726feeb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:34.841077 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf21308-785e-432d-93f3-c0bb4726feeb None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:34.842531 dv-cinder-826510-8-smb devstack@keystone.service[80344]: WARNING keystone.server.flask.common [None req-9cf21308-785e-432d-93f3-c0bb4726feeb None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 14 15:24:34.864218 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.sql.core [None req-9cf21308-785e-432d-93f3-c0bb4726feeb None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 14 15:24:34.864218 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 14 15:24:34.864218 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [parameters: {'id': '2b49e42a4f4a415fb6517f05092be2d2', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 14 15:24:34.864218 dv-cinder-826510-8-smb devstack@keystone.service[80344]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80344) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 14 15:24:34.872192 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-9cf21308-785e-432d-93f3-c0bb4726feeb None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 2b49e42a4f4a415fb6517f05092be2d2.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 2b49e42a4f4a415fb6517f05092be2d2. Jul 14 15:24:34.872192 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:34.872192 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 14 15:24:34.872192 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 14 15:24:34.872192 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 14 15:24:34.872192 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 14 15:24:34.872192 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 14 15:24:34.872192 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application result = self._query(query) Jul 14 15:24:34.872192 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 14 15:24:34.872192 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application conn.query(q) Jul 14 15:24:34.872192 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 14 15:24:34.872192 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 14 15:24:34.872192 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 14 15:24:34.872982 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application result.read() Jul 14 15:24:34.872982 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 14 15:24:34.872982 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 14 15:24:34.872982 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 14 15:24:34.872982 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 14 15:24:34.872982 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 14 15:24:34.872982 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 14 15:24:34.872982 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 14 15:24:34.872982 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 14 15:24:34.872982 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 14 15:24:34.872982 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:24:34.872982 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 14 15:24:34.872982 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:24:34.872982 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:34.872982 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 14 15:24:34.872982 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 14 15:24:34.872982 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 14 15:24:34.872982 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 14 15:24:34.873977 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 14 15:24:34.873977 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application next(self.gen) Jul 14 15:24:34.873977 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 14 15:24:34.873977 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application yield resource Jul 14 15:24:34.873977 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 14 15:24:34.873977 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application next(self.gen) Jul 14 15:24:34.873977 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 14 15:24:34.873977 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application self.session.rollback() Jul 14 15:24:34.873977 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 15:24:34.873977 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application self.force_reraise() Jul 14 15:24:34.873977 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 15:24:34.873977 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise self.value Jul 14 15:24:34.873977 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 14 15:24:34.873977 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 14 15:24:34.873977 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 14 15:24:34.873977 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application session.commit() Jul 14 15:24:34.873977 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 14 15:24:34.874964 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 14 15:24:34.874964 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 14 15:24:34.874964 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application self._prepare_impl() Jul 14 15:24:34.874964 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 14 15:24:34.874964 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application self.session.flush() Jul 14 15:24:34.874964 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 14 15:24:34.874964 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application self._flush(objects) Jul 14 15:24:34.874964 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 14 15:24:34.874964 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 14 15:24:34.874964 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 14 15:24:34.874964 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application compat.raise_( Jul 14 15:24:34.874964 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 14 15:24:34.874964 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception Jul 14 15:24:34.874964 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 14 15:24:34.874964 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application flush_context.execute() Jul 14 15:24:34.874964 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 14 15:24:34.874964 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rec.execute(self) Jul 14 15:24:34.875842 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 14 15:24:34.875842 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 14 15:24:34.875842 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 14 15:24:34.875842 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 14 15:24:34.875842 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 14 15:24:34.875842 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 14 15:24:34.875842 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 14 15:24:34.875842 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 14 15:24:34.875842 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 14 15:24:34.875842 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 14 15:24:34.875842 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 14 15:24:34.875842 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 14 15:24:34.875842 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 14 15:24:34.875842 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 14 15:24:34.875842 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 14 15:24:34.877264 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 14 15:24:34.877264 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 14 15:24:34.877264 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception Jul 14 15:24:34.877264 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 14 15:24:34.877264 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 14 15:24:34.877264 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 14 15:24:34.877264 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 14 15:24:34.877264 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 14 15:24:34.877264 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application result = self._query(query) Jul 14 15:24:34.877264 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 14 15:24:34.877264 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application conn.query(q) Jul 14 15:24:34.877264 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 14 15:24:34.877264 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 14 15:24:34.877264 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 14 15:24:34.877264 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application result.read() Jul 14 15:24:34.877264 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 14 15:24:34.877264 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 14 15:24:34.883690 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 14 15:24:34.883690 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 14 15:24:34.883690 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 14 15:24:34.883690 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 14 15:24:34.883690 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 14 15:24:34.883690 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 14 15:24:34.883690 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 14 15:24:34.883690 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 14 15:24:34.883690 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [parameters: {'id': '2b49e42a4f4a415fb6517f05092be2d2', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 14 15:24:34.883690 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 14 15:24:34.883690 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:24:34.883690 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 15:24:34.883690 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:24:34.883690 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:34.883690 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 14 15:24:34.886679 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 14 15:24:34.886679 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 14 15:24:34.886679 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 14 15:24:34.886679 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 14 15:24:34.886679 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:24:34.886679 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 15:24:34.886679 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:24:34.886679 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:34.886679 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:34.886679 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:34.886679 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:34.886679 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:34.886679 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:34.886679 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:34.886679 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:34.886679 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:34.886679 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:34.888842 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:34.888842 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 14 15:24:34.888842 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 14 15:24:34.888842 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:34.888842 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:34.888842 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 14 15:24:34.888842 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 14 15:24:34.888842 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 2b49e42a4f4a415fb6517f05092be2d2. Jul 14 15:24:34.888842 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:24:34.888842 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 495/947] 10.222.0.118 () {60 vars in 1145 bytes} [Thu Jul 14 15:24:34 2022] POST /identity/v3/projects => generated 262 bytes in 185 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:34.894431 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdab3d43-0875-4f41-ae65-af5fe2783170 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:34.938199 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:34.991938 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdab3d43-0875-4f41-ae65-af5fe2783170 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:35.028263 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557930fe-608d-47d1-923b-bc1581ce1199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:35.029360 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557930fe-608d-47d1-923b-bc1581ce1199 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:35.029790 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557930fe-608d-47d1-923b-bc1581ce1199 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:35.030242 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557930fe-608d-47d1-923b-bc1581ce1199 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:35.038252 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557930fe-608d-47d1-923b-bc1581ce1199 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:35.039984 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557930fe-608d-47d1-923b-bc1581ce1199 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:35.054179 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-557930fe-608d-47d1-923b-bc1581ce1199 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:24:35.054179 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:35.054179 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:35.054179 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:35.054179 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:35.054179 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:35.054179 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:35.054179 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:35.054179 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:35.054179 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:35.054179 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:35.054179 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:35.054179 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 15:24:35.054179 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 15:24:35.054179 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 15:24:35.055276 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 15:24:35.055276 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:35.055276 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:35.055276 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:35.055276 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:35.055276 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:35.055276 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:35.055276 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:35.055276 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:35.055276 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:35.055276 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:35.055276 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:35.055276 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:35.055276 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:35.055276 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:35.055276 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:35.055276 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:35.056419 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 15:24:35.056419 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 15:24:35.056419 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:24:35.056419 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:24:35.056419 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:24:35.056419 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:24:35.056419 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:24:35.056419 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:24:35.058538 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 453/948] 10.222.0.118 () {56 vars in 1116 bytes} [Thu Jul 14 15:24:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:35.065101 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf21308-785e-432d-93f3-c0bb4726feeb None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:35.175264 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf21308-785e-432d-93f3-c0bb4726feeb None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:35.212969 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613182dc-ca28-4ec2-98e7-b4cc3e6ce6f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:35.213646 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613182dc-ca28-4ec2-98e7-b4cc3e6ce6f4 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:35.213927 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613182dc-ca28-4ec2-98e7-b4cc3e6ce6f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:35.214255 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613182dc-ca28-4ec2-98e7-b4cc3e6ce6f4 None admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:35.215061 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613182dc-ca28-4ec2-98e7-b4cc3e6ce6f4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:35.215366 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613182dc-ca28-4ec2-98e7-b4cc3e6ce6f4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:35.217015 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613182dc-ca28-4ec2-98e7-b4cc3e6ce6f4 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:35.238546 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 496/949] 10.222.0.118 () {56 vars in 1117 bytes} [Thu Jul 14 15:24:35 2022] GET /identity/v3/projects?name=service => generated 413 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:35.536029 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b7ec8d-e3ee-430f-8544-e9b62d0de66e None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:35.536231 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b7ec8d-e3ee-430f-8544-e9b62d0de66e None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:35.536478 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b7ec8d-e3ee-430f-8544-e9b62d0de66e None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:35.538127 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 454/950] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:24:35 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:24:35.543485 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dc78be-13bf-4af9-832f-a59c7dce3621 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:35.543782 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dc78be-13bf-4af9-832f-a59c7dce3621 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:35.544056 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dc78be-13bf-4af9-832f-a59c7dce3621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:35.568602 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-52dc78be-13bf-4af9-832f-a59c7dce3621 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:35.570146 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-52dc78be-13bf-4af9-832f-a59c7dce3621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:35.582420 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:35.642803 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 497/951] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:24:35 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:24:35.669842 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b7ec8d-e3ee-430f-8544-e9b62d0de66e None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:35.795348 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b7ec8d-e3ee-430f-8544-e9b62d0de66e None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:35.807102 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:35.835622 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2fbc4d-00e3-4c38-8b29-0e307a5c1a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:35.836416 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2fbc4d-00e3-4c38-8b29-0e307a5c1a4b None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:35.836690 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2fbc4d-00e3-4c38-8b29-0e307a5c1a4b None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:35.836956 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2fbc4d-00e3-4c38-8b29-0e307a5c1a4b None admin] PATH_INFO: `/v3/services/compute` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:35.837609 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2fbc4d-00e3-4c38-8b29-0e307a5c1a4b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:35.839004 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2fbc4d-00e3-4c38-8b29-0e307a5c1a4b None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:35.851588 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-0b2fbc4d-00e3-4c38-8b29-0e307a5c1a4b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 15:24:35.851588 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:35.851588 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 15:24:35.851588 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 15:24:35.851588 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 15:24:35.851588 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 15:24:35.851588 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 15:24:35.851588 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:24:35.851588 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 15:24:35.851588 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:24:35.851588 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 15:24:35.851588 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:24:35.851588 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:35.851588 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:35.851588 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:35.851588 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:35.851588 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:35.852628 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:35.852628 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:35.852628 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:35.852628 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:35.852628 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:35.852628 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:35.852628 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 15:24:35.852628 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 15:24:35.852628 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 15:24:35.852628 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 15:24:35.852628 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:35.852628 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:35.852628 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:35.852628 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:35.852628 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:35.852628 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:35.853476 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:35.853476 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:35.853476 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:35.853476 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:35.853476 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:35.853476 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:35.853476 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:35.853476 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:35.853476 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:35.853476 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:35.853476 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 15:24:35.853476 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:24:35.853476 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 15:24:35.853476 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:24:35.853476 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 455/952] 10.222.0.118 () {56 vars in 1116 bytes} [Thu Jul 14 15:24:35 2022] GET /identity/v3/services/compute => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:35.860883 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dc78be-13bf-4af9-832f-a59c7dce3621 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:35.965407 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dc78be-13bf-4af9-832f-a59c7dce3621 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:36.002713 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cd3ecb-93e9-4f95-aedd-e6c9fb37b1ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:36.003443 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cd3ecb-93e9-4f95-aedd-e6c9fb37b1ce None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:36.003726 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cd3ecb-93e9-4f95-aedd-e6c9fb37b1ce None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:36.004002 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cd3ecb-93e9-4f95-aedd-e6c9fb37b1ce None admin] PATH_INFO: `/v3/services` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:36.004766 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cd3ecb-93e9-4f95-aedd-e6c9fb37b1ce None admin] RBAC: Adding query filter params (name=compute) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:36.005343 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cd3ecb-93e9-4f95-aedd-e6c9fb37b1ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:36.006757 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cd3ecb-93e9-4f95-aedd-e6c9fb37b1ce None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:36.012305 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 498/953] 10.222.0.118 () {56 vars in 1117 bytes} [Thu Jul 14 15:24:35 2022] GET /identity/v3/services?name=compute => generated 125 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:36.018679 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2fbc4d-00e3-4c38-8b29-0e307a5c1a4b None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:36.125495 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2fbc4d-00e3-4c38-8b29-0e307a5c1a4b None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:36.148341 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c1dc76-8b2b-4792-8cfb-e9bbf05aa4f6 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:36.148684 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c1dc76-8b2b-4792-8cfb-e9bbf05aa4f6 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:36.148903 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c1dc76-8b2b-4792-8cfb-e9bbf05aa4f6 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:36.150734 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 499/954] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:24:36 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:24:36.155576 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e2111c-57c5-467d-a154-1e0805a81ed5 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:36.155863 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e2111c-57c5-467d-a154-1e0805a81ed5 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:36.156130 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e2111c-57c5-467d-a154-1e0805a81ed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:36.165134 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec02d7db-7932-49ca-baa8-61df07888ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:36.165796 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec02d7db-7932-49ca-baa8-61df07888ca1 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:36.166099 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec02d7db-7932-49ca-baa8-61df07888ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:36.166370 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec02d7db-7932-49ca-baa8-61df07888ca1 None admin] PATH_INFO: `/v3/services` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:36.167072 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec02d7db-7932-49ca-baa8-61df07888ca1 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:36.167373 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec02d7db-7932-49ca-baa8-61df07888ca1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:36.168731 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec02d7db-7932-49ca-baa8-61df07888ca1 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:36.173929 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-d0e2111c-57c5-467d-a154-1e0805a81ed5 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:36.174229 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 456/955] 10.222.0.118 () {56 vars in 1117 bytes} [Thu Jul 14 15:24:36 2022] GET /identity/v3/services?type=compute => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:36.175175 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-d0e2111c-57c5-467d-a154-1e0805a81ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:36.178540 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:36.261350 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 500/956] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:24:36 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 15:24:36.285251 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec02d7db-7932-49ca-baa8-61df07888ca1 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:36.330593 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:36.394379 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec02d7db-7932-49ca-baa8-61df07888ca1 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:36.430905 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9555616b-05df-4989-838d-dc1c1ff02b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:36.431714 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9555616b-05df-4989-838d-dc1c1ff02b6d None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:36.431987 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9555616b-05df-4989-838d-dc1c1ff02b6d None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:36.432253 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9555616b-05df-4989-838d-dc1c1ff02b6d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:36.443469 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9555616b-05df-4989-838d-dc1c1ff02b6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:24:36.444944 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4417ca26-6b18-4279-ba68-c803945cb148 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:36.445236 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4417ca26-6b18-4279-ba68-c803945cb148 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:36.445514 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4417ca26-6b18-4279-ba68-c803945cb148 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:36.448161 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 501/957] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:24:36 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 14 15:24:36.451708 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-9555616b-05df-4989-838d-dc1c1ff02b6d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 15:24:36.451708 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:36.451708 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:36.451708 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:36.451708 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:36.451708 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:36.451708 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:36.451708 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:36.451708 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:36.451708 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:36.451708 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:36.451708 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:36.451708 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:24:36.451708 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:24:36.451708 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:24:36.451708 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:24:36.452626 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:24:36.452626 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:24:36.452626 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:24:36.452626 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:24:36.452626 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:36.452626 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:36.452626 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:36.452626 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:36.452626 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:36.452626 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:36.452626 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:36.452626 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:36.452626 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:36.452626 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:36.452626 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:36.452626 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:36.453730 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:36.453730 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:36.453730 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:36.453730 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:36.453730 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:24:36.453730 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:24:36.453730 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:24:36.453730 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:24:36.453730 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:24:36.453730 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:24:36.453730 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 15:24:36.453730 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:24:36.454470 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aea22b-b9c7-4cc6-92b6-a6a200fe3aaa None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:36.454470 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aea22b-b9c7-4cc6-92b6-a6a200fe3aaa None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:36.454470 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aea22b-b9c7-4cc6-92b6-a6a200fe3aaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:36.454646 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 457/958] 10.222.0.118 () {56 vars in 1125 bytes} [Thu Jul 14 15:24:36 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:36.459713 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9555616b-05df-4989-838d-dc1c1ff02b6d None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:36.473827 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-52aea22b-b9c7-4cc6-92b6-a6a200fe3aaa None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:36.475419 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-52aea22b-b9c7-4cc6-92b6-a6a200fe3aaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:36.550948 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 502/959] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:24:36 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 15:24:36.567026 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:36.571245 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9555616b-05df-4989-838d-dc1c1ff02b6d None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:36.574989 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aea22b-b9c7-4cc6-92b6-a6a200fe3aaa None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:36.608202 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b4831f-6582-42cd-82a2-f5112b2b30ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:36.608967 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b4831f-6582-42cd-82a2-f5112b2b30ce None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:36.609317 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b4831f-6582-42cd-82a2-f5112b2b30ce None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:36.609659 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b4831f-6582-42cd-82a2-f5112b2b30ce None admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:36.611148 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b4831f-6582-42cd-82a2-f5112b2b30ce None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:36.611585 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b4831f-6582-42cd-82a2-f5112b2b30ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:36.613133 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b4831f-6582-42cd-82a2-f5112b2b30ce None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:36.622019 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 458/960] 10.222.0.118 () {56 vars in 1120 bytes} [Thu Jul 14 15:24:36 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 340 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:36.627655 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b4831f-6582-42cd-82a2-f5112b2b30ce None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:36.653868 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:36.689208 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aea22b-b9c7-4cc6-92b6-a6a200fe3aaa None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:36.724834 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310bcffa-d3e7-4cfb-aeca-a4499877d428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:36.725887 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310bcffa-d3e7-4cfb-aeca-a4499877d428 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:36.726448 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310bcffa-d3e7-4cfb-aeca-a4499877d428 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:36.726955 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310bcffa-d3e7-4cfb-aeca-a4499877d428 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:36.727945 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310bcffa-d3e7-4cfb-aeca-a4499877d428 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:36.729529 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310bcffa-d3e7-4cfb-aeca-a4499877d428 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:36.742648 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-310bcffa-d3e7-4cfb-aeca-a4499877d428 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 15:24:36.742648 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:36.742648 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 15:24:36.742648 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 15:24:36.742648 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 15:24:36.742648 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 15:24:36.742648 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 15:24:36.742648 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:24:36.742648 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 15:24:36.742648 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:24:36.742648 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 15:24:36.742648 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:24:36.742648 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:36.742648 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:36.742648 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:36.742648 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:36.742648 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:36.743679 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:36.743679 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:36.743679 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:36.743679 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:36.743679 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:36.743679 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:36.743679 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 15:24:36.743679 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 15:24:36.743679 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 15:24:36.743679 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 15:24:36.743679 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:36.743679 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:36.743679 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:36.743679 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:36.743679 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:36.743679 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:36.744515 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:36.744515 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:36.744515 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:36.744515 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:36.744515 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:36.744515 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:36.744515 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:36.744515 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:36.744515 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:36.744515 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:36.744515 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 15:24:36.744515 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:24:36.744515 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 15:24:36.744515 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:24:36.747336 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 503/961] 10.222.0.118 () {56 vars in 1131 bytes} [Thu Jul 14 15:24:36 2022] GET /identity/v3/services/object-store => generated 93 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:24:36.754053 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310bcffa-d3e7-4cfb-aeca-a4499877d428 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:36.763783 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b4831f-6582-42cd-82a2-f5112b2b30ce None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:36.801644 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccd6c7c-9af8-438b-96a5-35c152a74767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:36.802556 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccd6c7c-9af8-438b-96a5-35c152a74767 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:36.802836 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccd6c7c-9af8-438b-96a5-35c152a74767 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:36.803104 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccd6c7c-9af8-438b-96a5-35c152a74767 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:36.814966 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccd6c7c-9af8-438b-96a5-35c152a74767 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:36.816417 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccd6c7c-9af8-438b-96a5-35c152a74767 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:36.835113 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-eccd6c7c-9af8-438b-96a5-35c152a74767 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:36.835113 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:36.835113 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:36.835113 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:36.835113 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:36.835113 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:36.835113 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:36.835113 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:36.835113 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:36.835113 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:36.835113 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:36.835113 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:36.835113 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:24:36.835113 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:24:36.835113 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:24:36.836037 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:24:36.836037 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:36.836037 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:36.836037 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:36.836037 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:36.836037 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:36.836037 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:36.836037 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:36.836037 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:36.836037 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:36.836037 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:36.836037 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:36.836037 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:36.836037 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:36.836037 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:36.836037 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:36.836037 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:36.837111 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:24:36.837111 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:24:36.837111 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:36.837111 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:24:36.837111 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 459/962] 10.222.0.118 () {56 vars in 1113 bytes} [Thu Jul 14 15:24:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:24:36.841878 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccd6c7c-9af8-438b-96a5-35c152a74767 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:36.859354 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:36.881038 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310bcffa-d3e7-4cfb-aeca-a4499877d428 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:36.918741 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e480547-1115-4449-9ef8-bff75825fd45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:36.919758 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e480547-1115-4449-9ef8-bff75825fd45 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:36.920263 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e480547-1115-4449-9ef8-bff75825fd45 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:36.920744 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e480547-1115-4449-9ef8-bff75825fd45 None admin] PATH_INFO: `/v3/services` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:36.921814 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e480547-1115-4449-9ef8-bff75825fd45 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:36.922541 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e480547-1115-4449-9ef8-bff75825fd45 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:36.924891 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e480547-1115-4449-9ef8-bff75825fd45 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:36.932310 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:36.935587 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 504/963] 10.222.0.118 () {56 vars in 1127 bytes} [Thu Jul 14 15:24:36 2022] GET /identity/v3/services?name=object-store => generated 130 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:36.937064 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e480547-1115-4449-9ef8-bff75825fd45 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:36.952435 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccd6c7c-9af8-438b-96a5-35c152a74767 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:36.988365 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c470367-0cbf-4f22-833a-7c025270e6b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:36.989045 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c470367-0cbf-4f22-833a-7c025270e6b0 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:36.989326 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c470367-0cbf-4f22-833a-7c025270e6b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:36.989601 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c470367-0cbf-4f22-833a-7c025270e6b0 None admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:36.990364 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c470367-0cbf-4f22-833a-7c025270e6b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:36.990674 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c470367-0cbf-4f22-833a-7c025270e6b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:36.992061 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c470367-0cbf-4f22-833a-7c025270e6b0 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:37.009688 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 460/964] 10.222.0.118 () {56 vars in 1114 bytes} [Thu Jul 14 15:24:36 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:37.010642 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c470367-0cbf-4f22-833a-7c025270e6b0 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:37.048643 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e480547-1115-4449-9ef8-bff75825fd45 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:37.083885 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:37.087653 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b83845-8bd7-462d-ad46-dab241d8a6ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:37.088681 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b83845-8bd7-462d-ad46-dab241d8a6ef None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:37.089181 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b83845-8bd7-462d-ad46-dab241d8a6ef None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:37.089662 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b83845-8bd7-462d-ad46-dab241d8a6ef None admin] PATH_INFO: `/v3/services` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:37.090615 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b83845-8bd7-462d-ad46-dab241d8a6ef None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:37.091140 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b83845-8bd7-462d-ad46-dab241d8a6ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:37.092735 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b83845-8bd7-462d-ad46-dab241d8a6ef None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:37.103557 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 505/965] 10.222.0.118 () {56 vars in 1127 bytes} [Thu Jul 14 15:24:36 2022] GET /identity/v3/services?type=object-store => generated 358 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:24:37.105030 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b83845-8bd7-462d-ad46-dab241d8a6ef None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:37.117414 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c470367-0cbf-4f22-833a-7c025270e6b0 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:37.154154 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14878d7-9d16-4401-b7a3-d3dde4ae557f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:37.154973 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14878d7-9d16-4401-b7a3-d3dde4ae557f None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:37.155256 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14878d7-9d16-4401-b7a3-d3dde4ae557f None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:37.155537 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14878d7-9d16-4401-b7a3-d3dde4ae557f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:37.163819 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14878d7-9d16-4401-b7a3-d3dde4ae557f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:37.165283 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14878d7-9d16-4401-b7a3-d3dde4ae557f None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:37.176204 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:37.181510 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-c14878d7-9d16-4401-b7a3-d3dde4ae557f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 15:24:37.181510 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:37.181510 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:37.181510 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:37.181510 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:37.181510 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:37.181510 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:37.181510 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:37.181510 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:37.181510 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:37.181510 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:37.181510 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:37.181510 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 15:24:37.181510 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 15:24:37.181510 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 15:24:37.181510 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 15:24:37.182460 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:37.182460 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:37.182460 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 15:24:37.182460 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:24:37.182460 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 15:24:37.182460 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:24:37.182460 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:37.182460 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:37.182460 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:37.182460 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:37.182460 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:37.182460 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:37.182460 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:37.182460 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:37.182460 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:37.182460 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:37.182460 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:37.182460 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:37.183396 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:37.183396 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:37.183396 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 15:24:37.183396 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 15:24:37.183396 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 15:24:37.183396 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 15:24:37.183396 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 15:24:37.183396 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 15:24:37.183396 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 15:24:37.183396 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:24:37.187860 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 461/966] 10.222.0.118 () {56 vars in 1122 bytes} [Thu Jul 14 15:24:37 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:24:37.188832 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14878d7-9d16-4401-b7a3-d3dde4ae557f None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:37.215311 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b83845-8bd7-462d-ad46-dab241d8a6ef None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:37.251048 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8ea613-49d4-4f45-be7e-b22bb64e4221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:37.252063 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ea613-49d4-4f45-be7e-b22bb64e4221 None admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:37.252568 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ea613-49d4-4f45-be7e-b22bb64e4221 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:37.253065 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ea613-49d4-4f45-be7e-b22bb64e4221 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:37.254083 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8ea613-49d4-4f45-be7e-b22bb64e4221 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:37.255945 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8ea613-49d4-4f45-be7e-b22bb64e4221 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:37.282184 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 506/967] 10.222.0.118 () {60 vars in 1149 bytes} [Thu Jul 14 15:24:37 2022] POST /identity/v3/endpoints => generated 351 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:24:37.299076 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14878d7-9d16-4401-b7a3-d3dde4ae557f None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:37.334729 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:37.349191 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70e26cc-7c5e-4e66-b5c6-1c4319ebf5a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:37.349896 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70e26cc-7c5e-4e66-b5c6-1c4319ebf5a1 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:37.350218 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70e26cc-7c5e-4e66-b5c6-1c4319ebf5a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:37.350496 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70e26cc-7c5e-4e66-b5c6-1c4319ebf5a1 None admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:37.351380 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70e26cc-7c5e-4e66-b5c6-1c4319ebf5a1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:37.351699 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70e26cc-7c5e-4e66-b5c6-1c4319ebf5a1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:37.353335 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70e26cc-7c5e-4e66-b5c6-1c4319ebf5a1 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:37.375493 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 462/968] 10.222.0.118 () {56 vars in 1154 bytes} [Thu Jul 14 15:24:37 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 386 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:24:37.382167 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8ea613-49d4-4f45-be7e-b22bb64e4221 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:37.499236 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8ea613-49d4-4f45-be7e-b22bb64e4221 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:37.519064 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:37.524137 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf14d41-a230-458a-bafd-93a3494ce338 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:37.524488 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf14d41-a230-458a-bafd-93a3494ce338 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:37.524926 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf14d41-a230-458a-bafd-93a3494ce338 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:37.526512 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 463/969] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:24:37 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 14 15:24:37.531683 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d36ef-0d23-46ee-8722-71186e91b64f None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:37.531964 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d36ef-0d23-46ee-8722-71186e91b64f None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:37.532760 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d36ef-0d23-46ee-8722-71186e91b64f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:37.539992 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f36489d-43ca-47a2-b76b-c821d1e04c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:37.540836 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f36489d-43ca-47a2-b76b-c821d1e04c7b None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:37.541267 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f36489d-43ca-47a2-b76b-c821d1e04c7b None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:37.541712 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f36489d-43ca-47a2-b76b-c821d1e04c7b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:37.554574 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-8d1d36ef-0d23-46ee-8722-71186e91b64f None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:37.556084 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-8d1d36ef-0d23-46ee-8722-71186e91b64f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:37.616083 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f36489d-43ca-47a2-b76b-c821d1e04c7b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:37.618214 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f36489d-43ca-47a2-b76b-c821d1e04c7b None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:37.650001 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 464/970] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:24:37 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 15:24:37.670953 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1d36ef-0d23-46ee-8722-71186e91b64f None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:37.744023 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 507/971] 10.222.0.118 () {58 vars in 1287 bytes} [Thu Jul 14 15:24:37 2022] GET /identity/v3/auth/tokens => generated 1466 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 15:24:37.749441 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f36489d-43ca-47a2-b76b-c821d1e04c7b None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:37.772912 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:37.797014 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1d36ef-0d23-46ee-8722-71186e91b64f None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:37.814383 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:37.834153 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972a5a73-8e04-4be7-ba4c-817396443203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:37.834991 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a5a73-8e04-4be7-ba4c-817396443203 None admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:37.835398 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a5a73-8e04-4be7-ba4c-817396443203 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:37.835788 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a5a73-8e04-4be7-ba4c-817396443203 None admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:37.836589 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972a5a73-8e04-4be7-ba4c-817396443203 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:37.838251 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972a5a73-8e04-4be7-ba4c-817396443203 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:37.839673 dv-cinder-826510-8-smb devstack@keystone.service[80345]: WARNING keystone.server.flask.common [None req-972a5a73-8e04-4be7-ba4c-817396443203 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 14 15:24:37.855275 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.sql.core [None req-972a5a73-8e04-4be7-ba4c-817396443203 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 14 15:24:37.855275 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 14 15:24:37.855275 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [parameters: {'user_id': '701070933d19411e83faf228e9aa7a1c', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 14 15:24:37.855275 dv-cinder-826510-8-smb devstack@keystone.service[80345]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80345) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 14 15:24:37.873435 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f36489d-43ca-47a2-b76b-c821d1e04c7b None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:37.878337 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-972a5a73-8e04-4be7-ba4c-817396443203 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 14 15:24:37.878337 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:37.878337 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 14 15:24:37.878337 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 14 15:24:37.878337 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 14 15:24:37.878337 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 14 15:24:37.878337 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 14 15:24:37.878337 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application result = self._query(query) Jul 14 15:24:37.878337 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 14 15:24:37.878337 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application conn.query(q) Jul 14 15:24:37.878337 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 14 15:24:37.878337 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 14 15:24:37.878337 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 14 15:24:37.878337 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application result.read() Jul 14 15:24:37.878337 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 14 15:24:37.879463 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 14 15:24:37.879463 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 14 15:24:37.879463 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 14 15:24:37.879463 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 14 15:24:37.879463 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 14 15:24:37.879463 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 14 15:24:37.879463 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 14 15:24:37.879463 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 14 15:24:37.879463 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:24:37.879463 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 14 15:24:37.879463 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:24:37.879463 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:37.879463 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 14 15:24:37.879463 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 14 15:24:37.879463 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 14 15:24:37.879463 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 14 15:24:37.879463 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 14 15:24:37.879463 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application next(self.gen) Jul 14 15:24:37.880899 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 14 15:24:37.880899 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application yield resource Jul 14 15:24:37.880899 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 14 15:24:37.880899 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application next(self.gen) Jul 14 15:24:37.880899 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 14 15:24:37.880899 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application self.session.rollback() Jul 14 15:24:37.880899 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 15:24:37.880899 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application self.force_reraise() Jul 14 15:24:37.880899 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 15:24:37.880899 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise self.value Jul 14 15:24:37.880899 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 14 15:24:37.880899 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 14 15:24:37.880899 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 14 15:24:37.880899 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application session.commit() Jul 14 15:24:37.880899 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 14 15:24:37.880899 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 14 15:24:37.880899 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 14 15:24:37.882324 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application self._prepare_impl() Jul 14 15:24:37.882324 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 14 15:24:37.882324 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application self.session.flush() Jul 14 15:24:37.882324 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 14 15:24:37.882324 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application self._flush(objects) Jul 14 15:24:37.882324 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 14 15:24:37.882324 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 14 15:24:37.882324 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 14 15:24:37.882324 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application compat.raise_( Jul 14 15:24:37.882324 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 14 15:24:37.882324 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception Jul 14 15:24:37.882324 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 14 15:24:37.882324 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application flush_context.execute() Jul 14 15:24:37.882324 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 14 15:24:37.882324 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rec.execute(self) Jul 14 15:24:37.882324 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 14 15:24:37.882324 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 14 15:24:37.889127 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 14 15:24:37.889127 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 14 15:24:37.889127 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 14 15:24:37.889127 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 14 15:24:37.889127 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 14 15:24:37.889127 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 14 15:24:37.889127 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 14 15:24:37.889127 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 14 15:24:37.889127 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 14 15:24:37.889127 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 14 15:24:37.889127 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 14 15:24:37.889127 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 14 15:24:37.889127 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 14 15:24:37.889127 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 14 15:24:37.889127 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 14 15:24:37.889127 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception Jul 14 15:24:37.892443 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 14 15:24:37.892443 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 14 15:24:37.892443 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 14 15:24:37.892443 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 14 15:24:37.892443 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 14 15:24:37.892443 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application result = self._query(query) Jul 14 15:24:37.892443 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 14 15:24:37.892443 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application conn.query(q) Jul 14 15:24:37.892443 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 14 15:24:37.892443 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 14 15:24:37.892443 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 14 15:24:37.892443 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application result.read() Jul 14 15:24:37.892443 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 14 15:24:37.892443 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 14 15:24:37.892443 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 14 15:24:37.892443 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 14 15:24:37.894624 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 14 15:24:37.894624 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 14 15:24:37.894624 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 14 15:24:37.894624 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 14 15:24:37.894624 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 14 15:24:37.894624 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 14 15:24:37.894624 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [parameters: {'user_id': '701070933d19411e83faf228e9aa7a1c', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 14 15:24:37.894624 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 14 15:24:37.894624 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:24:37.894624 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 15:24:37.894624 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:24:37.894624 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:37.894624 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:37.894624 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:37.894624 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:37.896662 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:37.896662 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:37.896662 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:37.896662 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:37.896662 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:37.896662 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:37.896662 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:37.896662 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 14 15:24:37.896662 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 14 15:24:37.896662 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:37.896662 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:37.896662 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 15:24:37.896662 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:24:37.896662 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 15:24:37.896662 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:24:37.896662 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 14 15:24:37.896662 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 14 15:24:37.899025 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 14 15:24:37.899025 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 14 15:24:37.899025 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 14 15:24:37.899025 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 14 15:24:37.899025 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 14 15:24:37.899025 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:24:37.899025 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 465/972] 10.222.0.118 () {60 vars in 1136 bytes} [Thu Jul 14 15:24:37 2022] POST /identity/v3/users => generated 160 bytes in 213 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:37.899025 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972a5a73-8e04-4be7-ba4c-817396443203 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:37.928612 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144252ec-5948-40ed-884d-ef6dea9cd1bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:37.929923 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144252ec-5948-40ed-884d-ef6dea9cd1bf None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:37.930451 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144252ec-5948-40ed-884d-ef6dea9cd1bf None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:37.930974 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144252ec-5948-40ed-884d-ef6dea9cd1bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:37.945654 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144252ec-5948-40ed-884d-ef6dea9cd1bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:37.947654 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144252ec-5948-40ed-884d-ef6dea9cd1bf None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:37.974043 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-144252ec-5948-40ed-884d-ef6dea9cd1bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:37.974043 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:37.974043 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:37.974043 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:37.974043 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:37.974043 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:37.974043 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:37.974043 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:37.974043 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:37.974043 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:37.974043 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:37.974043 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:37.974043 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:24:37.974043 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:24:37.974043 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:24:37.975000 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:24:37.975000 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:37.975000 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:37.975000 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:37.975000 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:37.975000 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:37.975000 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:37.975000 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:37.975000 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:37.975000 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:37.975000 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:37.975000 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:37.975000 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:37.975000 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:37.975000 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:37.975000 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:37.975000 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:37.975883 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:24:37.975883 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:24:37.975883 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:37.975883 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:24:37.978575 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 508/973] 10.222.0.118 () {56 vars in 1113 bytes} [Thu Jul 14 15:24:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:24:37.985774 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144252ec-5948-40ed-884d-ef6dea9cd1bf None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:38.023970 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972a5a73-8e04-4be7-ba4c-817396443203 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:38.060567 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45c028b-d188-491a-8199-8b28f3e06928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:38.061412 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45c028b-d188-491a-8199-8b28f3e06928 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:38.061748 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45c028b-d188-491a-8199-8b28f3e06928 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:38.062136 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45c028b-d188-491a-8199-8b28f3e06928 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:38.067433 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:38.072235 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45c028b-d188-491a-8199-8b28f3e06928 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:38.073937 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45c028b-d188-491a-8199-8b28f3e06928 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:38.089658 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-a45c028b-d188-491a-8199-8b28f3e06928 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 15:24:38.089658 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:38.089658 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:38.089658 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:38.089658 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:38.089658 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:38.089658 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:38.089658 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:38.089658 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:38.089658 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:38.089658 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:38.089658 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:38.089658 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 15:24:38.089658 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 15:24:38.089658 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 15:24:38.089658 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 15:24:38.090696 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:38.090696 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:38.090696 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 15:24:38.090696 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:24:38.090696 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 15:24:38.090696 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:24:38.090696 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:38.090696 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:38.090696 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:38.090696 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:38.090696 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:38.090696 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:38.090696 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:38.090696 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:38.090696 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:38.090696 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:38.090696 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:38.090696 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:38.091644 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:38.091644 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:38.091644 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 15:24:38.091644 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 15:24:38.091644 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 15:24:38.091644 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 15:24:38.091644 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 15:24:38.091644 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 15:24:38.091644 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 15:24:38.091644 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:24:38.095779 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 466/974] 10.222.0.118 () {56 vars in 1104 bytes} [Thu Jul 14 15:24:37 2022] GET /identity/v3/users/cinder => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:24:38.097143 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45c028b-d188-491a-8199-8b28f3e06928 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:38.106951 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144252ec-5948-40ed-884d-ef6dea9cd1bf None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:38.142349 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:38.147576 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e838803-db9a-401b-83bd-d0ea47a77e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:38.148634 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e838803-db9a-401b-83bd-d0ea47a77e08 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:38.149873 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e838803-db9a-401b-83bd-d0ea47a77e08 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:38.150390 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e838803-db9a-401b-83bd-d0ea47a77e08 None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:38.151341 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e838803-db9a-401b-83bd-d0ea47a77e08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:38.151864 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e838803-db9a-401b-83bd-d0ea47a77e08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:38.153620 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e838803-db9a-401b-83bd-d0ea47a77e08 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:38.172440 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 509/975] 10.222.0.118 () {56 vars in 1114 bytes} [Thu Jul 14 15:24:37 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:38.173774 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e838803-db9a-401b-83bd-d0ea47a77e08 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:38.210333 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45c028b-d188-491a-8199-8b28f3e06928 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:38.248601 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97744546-6287-4027-9105-5500033a1c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:38.249318 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97744546-6287-4027-9105-5500033a1c79 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:38.249608 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97744546-6287-4027-9105-5500033a1c79 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:38.249856 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97744546-6287-4027-9105-5500033a1c79 None admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:38.250697 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97744546-6287-4027-9105-5500033a1c79 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:38.251049 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97744546-6287-4027-9105-5500033a1c79 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:38.253501 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97744546-6287-4027-9105-5500033a1c79 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:38.285737 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e838803-db9a-401b-83bd-d0ea47a77e08 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:38.293494 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 467/976] 10.222.0.118 () {56 vars in 1106 bytes} [Thu Jul 14 15:24:38 2022] GET /identity/v3/users?name=cinder => generated 356 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:38.294996 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c7d470-e176-4858-b2f7-a894906fb1d8 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:38.295289 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c7d470-e176-4858-b2f7-a894906fb1d8 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:38.295570 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c7d470-e176-4858-b2f7-a894906fb1d8 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:38.297154 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 468/977] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:24:38 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:24:38.302909 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61104e2-d1cc-4f16-a7c8-4a621bf1d2e1 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:38.303333 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61104e2-d1cc-4f16-a7c8-4a621bf1d2e1 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:38.303736 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61104e2-d1cc-4f16-a7c8-4a621bf1d2e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:38.319700 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:38.326979 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91c35a8-8618-435e-8d98-3a9c634aae6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:38.328115 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c35a8-8618-435e-8d98-3a9c634aae6d None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:38.328552 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c35a8-8618-435e-8d98-3a9c634aae6d None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:38.329042 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c35a8-8618-435e-8d98-3a9c634aae6d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:38.330846 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-f61104e2-d1cc-4f16-a7c8-4a621bf1d2e1 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:38.333596 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-f61104e2-d1cc-4f16-a7c8-4a621bf1d2e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:38.338199 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91c35a8-8618-435e-8d98-3a9c634aae6d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:38.340020 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91c35a8-8618-435e-8d98-3a9c634aae6d None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:38.357950 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-d91c35a8-8618-435e-8d98-3a9c634aae6d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:24:38.357950 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:38.357950 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:38.357950 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:38.357950 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:38.357950 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:38.357950 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:38.357950 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:38.357950 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:38.357950 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:38.357950 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:38.357950 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:38.357950 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 15:24:38.357950 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 15:24:38.357950 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 15:24:38.358965 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 15:24:38.358965 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:38.358965 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:38.358965 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:38.358965 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:38.358965 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:38.358965 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:38.358965 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:38.358965 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:38.358965 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:38.358965 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:38.358965 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:38.358965 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:38.358965 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:38.358965 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:38.358965 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:38.358965 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:38.359840 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 15:24:38.359840 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 15:24:38.359840 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:24:38.359840 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:24:38.359840 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:24:38.359840 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:24:38.359840 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:24:38.359840 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:24:38.367594 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 510/978] 10.222.0.118 () {56 vars in 1116 bytes} [Thu Jul 14 15:24:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:38.368967 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91c35a8-8618-435e-8d98-3a9c634aae6d None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:38.429419 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 469/979] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:24:38 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:24:38.451679 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61104e2-d1cc-4f16-a7c8-4a621bf1d2e1 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:38.483578 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:38.493992 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91c35a8-8618-435e-8d98-3a9c634aae6d None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:38.541839 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d457ce-c7a2-49e5-b626-09f3391e39e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:38.542509 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d457ce-c7a2-49e5-b626-09f3391e39e4 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:38.542790 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d457ce-c7a2-49e5-b626-09f3391e39e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:38.543064 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d457ce-c7a2-49e5-b626-09f3391e39e4 None admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:38.543896 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d457ce-c7a2-49e5-b626-09f3391e39e4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:38.544206 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d457ce-c7a2-49e5-b626-09f3391e39e4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:38.545643 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d457ce-c7a2-49e5-b626-09f3391e39e4 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:38.567546 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 511/980] 10.222.0.118 () {56 vars in 1153 bytes} [Thu Jul 14 15:24:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:38.574920 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d457ce-c7a2-49e5-b626-09f3391e39e4 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:38.576805 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61104e2-d1cc-4f16-a7c8-4a621bf1d2e1 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:38.613913 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16ab582-10e9-4a2a-9dff-13dfae42ad39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:38.614769 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ab582-10e9-4a2a-9dff-13dfae42ad39 None admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:38.615053 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ab582-10e9-4a2a-9dff-13dfae42ad39 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:38.615323 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ab582-10e9-4a2a-9dff-13dfae42ad39 None admin] PATH_INFO: `/v3/services` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:38.616046 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16ab582-10e9-4a2a-9dff-13dfae42ad39 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:38.617418 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16ab582-10e9-4a2a-9dff-13dfae42ad39 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:38.630976 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:38.635993 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 470/981] 10.222.0.118 () {60 vars in 1146 bytes} [Thu Jul 14 15:24:38 2022] POST /identity/v3/services => generated 243 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:24:38.687801 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d457ce-c7a2-49e5-b626-09f3391e39e4 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:38.742051 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f32b7a9-5beb-4968-b676-564c65cc2906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:38.742715 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f32b7a9-5beb-4968-b676-564c65cc2906 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:38.742992 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f32b7a9-5beb-4968-b676-564c65cc2906 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:38.743257 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f32b7a9-5beb-4968-b676-564c65cc2906 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:38.744095 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f32b7a9-5beb-4968-b676-564c65cc2906 None admin] RBAC: Adding query filter params (role.id=395d04a64fa447d88861d9397f70322e, scope.project.id=939bf9541f4a4afe86550f749d337680, user.id=f7ad5ae70939416e8157693e02997a58) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:38.744460 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f32b7a9-5beb-4968-b676-564c65cc2906 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:38.745945 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f32b7a9-5beb-4968-b676-564c65cc2906 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:38.760804 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 512/982] 10.222.0.118 () {56 vars in 1379 bytes} [Thu Jul 14 15:24:38 2022] GET /identity/v3/role_assignments?user.id=f7ad5ae70939416e8157693e02997a58&scope.project.id=939bf9541f4a4afe86550f749d337680&role.id=395d04a64fa447d88861d9397f70322e => generated 610 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:39.427058 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee213b1a-9ea0-4fd3-a58a-afc5975c30fd None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:39.427647 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee213b1a-9ea0-4fd3-a58a-afc5975c30fd None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:39.427647 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee213b1a-9ea0-4fd3-a58a-afc5975c30fd None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:39.429040 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 471/983] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:24:39 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:24:39.434151 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd97cf1-d5f8-43b8-89cb-f8ef88ac7133 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:39.434442 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd97cf1-d5f8-43b8-89cb-f8ef88ac7133 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:39.434714 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd97cf1-d5f8-43b8-89cb-f8ef88ac7133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:39.451686 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-ccd97cf1-d5f8-43b8-89cb-f8ef88ac7133 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:39.452890 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-ccd97cf1-d5f8-43b8-89cb-f8ef88ac7133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:39.521391 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 513/984] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:24:39 2022] POST /identity/v3/auth/tokens => generated 1562 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:24:39.544375 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee213b1a-9ea0-4fd3-a58a-afc5975c30fd None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:39.631607 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:39.650222 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee213b1a-9ea0-4fd3-a58a-afc5975c30fd None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:39.684107 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c0224d-5a7c-4ca4-aa1e-e4d010d7569b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:39.684834 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c0224d-5a7c-4ca4-aa1e-e4d010d7569b None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:39.685117 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c0224d-5a7c-4ca4-aa1e-e4d010d7569b None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:39.685390 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c0224d-5a7c-4ca4-aa1e-e4d010d7569b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:39.686071 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c0224d-5a7c-4ca4-aa1e-e4d010d7569b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:39.687446 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c0224d-5a7c-4ca4-aa1e-e4d010d7569b None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:39.700283 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-a9c0224d-5a7c-4ca4-aa1e-e4d010d7569b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 15:24:39.700283 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:39.700283 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 15:24:39.700283 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 15:24:39.700283 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 15:24:39.700283 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 15:24:39.700283 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 15:24:39.700283 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:24:39.700283 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 15:24:39.700283 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:24:39.700283 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 15:24:39.700283 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:24:39.700283 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:39.700283 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:39.700283 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:39.700283 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:39.700283 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:39.701229 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:39.701229 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:39.701229 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:39.701229 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:39.701229 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:39.701229 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:39.701229 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 15:24:39.701229 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 15:24:39.701229 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 15:24:39.701229 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 15:24:39.701229 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:39.701229 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:39.701229 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:39.701229 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:39.701229 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:39.701229 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:39.702096 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:39.702096 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:39.702096 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:39.702096 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:39.702096 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:39.702096 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:39.702096 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:39.702096 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:39.702096 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:39.702096 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:39.702096 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 15:24:39.702096 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:24:39.702096 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 15:24:39.702096 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:24:39.709868 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 472/985] 10.222.0.118 () {56 vars in 1131 bytes} [Thu Jul 14 15:24:39 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:39.710048 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd97cf1-d5f8-43b8-89cb-f8ef88ac7133 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:39.758022 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:39.828682 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd97cf1-d5f8-43b8-89cb-f8ef88ac7133 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:39.863542 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938302c7-42f3-4638-899b-931c543fd215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:39.864343 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938302c7-42f3-4638-899b-931c543fd215 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:39.864467 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938302c7-42f3-4638-899b-931c543fd215 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:39.864739 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938302c7-42f3-4638-899b-931c543fd215 None admin] PATH_INFO: `/v3/services` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:39.865447 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938302c7-42f3-4638-899b-931c543fd215 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:39.865750 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938302c7-42f3-4638-899b-931c543fd215 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:39.867144 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938302c7-42f3-4638-899b-931c543fd215 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:39.877379 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 514/986] 10.222.0.118 () {56 vars in 1127 bytes} [Thu Jul 14 15:24:39 2022] GET /identity/v3/services?name=object-store => generated 130 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:39.878899 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c0224d-5a7c-4ca4-aa1e-e4d010d7569b None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:39.981729 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c0224d-5a7c-4ca4-aa1e-e4d010d7569b None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:40.015598 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54edc016-6606-4788-b633-095faa75acfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:40.016256 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54edc016-6606-4788-b633-095faa75acfd None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:40.017139 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54edc016-6606-4788-b633-095faa75acfd None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:40.017538 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54edc016-6606-4788-b633-095faa75acfd None admin] PATH_INFO: `/v3/services` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:40.018558 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54edc016-6606-4788-b633-095faa75acfd None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:40.018968 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54edc016-6606-4788-b633-095faa75acfd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:40.020336 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54edc016-6606-4788-b633-095faa75acfd None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:40.025855 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 473/987] 10.222.0.118 () {56 vars in 1127 bytes} [Thu Jul 14 15:24:39 2022] GET /identity/v3/services?type=object-store => generated 358 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:40.031420 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938302c7-42f3-4638-899b-931c543fd215 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:40.136547 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938302c7-42f3-4638-899b-931c543fd215 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:40.138892 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:40.173017 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3a0d6b-ca19-4244-8fa8-65dfc74178f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:40.173669 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a0d6b-ca19-4244-8fa8-65dfc74178f9 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:40.173950 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a0d6b-ca19-4244-8fa8-65dfc74178f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:40.174250 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a0d6b-ca19-4244-8fa8-65dfc74178f9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:40.175050 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3a0d6b-ca19-4244-8fa8-65dfc74178f9 None admin] RBAC: Adding query filter params (interface=admin, service_id=936a33ad93eb4639b0c43024928fa139, region_id=RegionOne) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:40.175362 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3a0d6b-ca19-4244-8fa8-65dfc74178f9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:40.176720 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3a0d6b-ca19-4244-8fa8-65dfc74178f9 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:40.182049 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 515/988] 10.222.0.118 () {56 vars in 1254 bytes} [Thu Jul 14 15:24:40 2022] GET /identity/v3/endpoints?service_id=936a33ad93eb4639b0c43024928fa139&interface=admin®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:40.187434 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54edc016-6606-4788-b633-095faa75acfd None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:40.205292 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:40.294904 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54edc016-6606-4788-b633-095faa75acfd None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:40.328458 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91208c6-d947-49c7-910d-661a7c6c56a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:40.329688 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91208c6-d947-49c7-910d-661a7c6c56a8 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:40.329980 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91208c6-d947-49c7-910d-661a7c6c56a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:40.330263 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91208c6-d947-49c7-910d-661a7c6c56a8 None admin] PATH_INFO: `/v3/services` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:40.330935 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91208c6-d947-49c7-910d-661a7c6c56a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:40.332307 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91208c6-d947-49c7-910d-661a7c6c56a8 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:40.345417 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 474/989] 10.222.0.118 () {56 vars in 1092 bytes} [Thu Jul 14 15:24:40 2022] GET /identity/v3/services => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:24:40.711370 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215e97ac-28a5-459d-82d5-eb388a5d292d None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:40.711904 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215e97ac-28a5-459d-82d5-eb388a5d292d None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:40.711904 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215e97ac-28a5-459d-82d5-eb388a5d292d None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:40.714006 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 516/990] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:24:40 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:24:40.721520 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6add6394-e0f1-4d35-a45f-6ed8b7a6a637 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:40.722445 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6add6394-e0f1-4d35-a45f-6ed8b7a6a637 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:40.723030 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6add6394-e0f1-4d35-a45f-6ed8b7a6a637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:40.740216 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-6add6394-e0f1-4d35-a45f-6ed8b7a6a637 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:40.741421 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-6add6394-e0f1-4d35-a45f-6ed8b7a6a637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:40.811025 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 475/991] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:24:40 2022] POST /identity/v3/auth/tokens => generated 1562 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:24:40.834420 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215e97ac-28a5-459d-82d5-eb388a5d292d None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:40.844772 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da5f18e-d5ce-4db4-aa97-bcc6c50dcdc8 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:40.845059 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da5f18e-d5ce-4db4-aa97-bcc6c50dcdc8 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:40.845326 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da5f18e-d5ce-4db4-aa97-bcc6c50dcdc8 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:40.846742 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 476/992] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:24:40 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 14 15:24:40.851412 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9078b5d0-92c2-4982-8df1-7325acca7fcf None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:40.851693 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9078b5d0-92c2-4982-8df1-7325acca7fcf None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:40.851969 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9078b5d0-92c2-4982-8df1-7325acca7fcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:40.870208 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-9078b5d0-92c2-4982-8df1-7325acca7fcf None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:40.871408 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-9078b5d0-92c2-4982-8df1-7325acca7fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:40.873421 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:40.945853 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 477/993] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:24:40 2022] POST /identity/v3/auth/tokens => generated 1562 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 15:24:40.946120 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215e97ac-28a5-459d-82d5-eb388a5d292d None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:40.968052 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9078b5d0-92c2-4982-8df1-7325acca7fcf None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:40.987022 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8500bbee-7377-46d3-83fc-f22c8e90db76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:40.988163 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8500bbee-7377-46d3-83fc-f22c8e90db76 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:40.988693 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8500bbee-7377-46d3-83fc-f22c8e90db76 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:40.989599 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8500bbee-7377-46d3-83fc-f22c8e90db76 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:40.990833 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8500bbee-7377-46d3-83fc-f22c8e90db76 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:40.992896 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8500bbee-7377-46d3-83fc-f22c8e90db76 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:41.006304 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-8500bbee-7377-46d3-83fc-f22c8e90db76 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 15:24:41.006304 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:41.006304 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 15:24:41.006304 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 15:24:41.006304 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 15:24:41.006304 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 15:24:41.006304 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 15:24:41.006304 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:24:41.006304 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 15:24:41.006304 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:24:41.006304 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 15:24:41.006304 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:24:41.006304 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:41.006304 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:41.006304 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:41.006304 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:41.006304 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:41.007330 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:41.007330 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:41.007330 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:41.007330 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:41.007330 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:41.007330 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:41.007330 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 15:24:41.007330 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 15:24:41.007330 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 15:24:41.007330 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 15:24:41.007330 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:41.007330 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:41.007330 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:41.007330 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:41.007330 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:41.007330 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:41.008159 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:41.008159 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:41.008159 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:41.008159 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:41.008159 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:41.008159 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:41.008159 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:41.008159 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:41.008159 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:41.008159 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:41.008159 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 15:24:41.008159 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:24:41.008159 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 15:24:41.008159 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:24:41.012465 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 517/994] 10.222.0.118 () {56 vars in 1116 bytes} [Thu Jul 14 15:24:40 2022] GET /identity/v3/services/compute => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:41.013303 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8500bbee-7377-46d3-83fc-f22c8e90db76 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:41.044711 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:41.077977 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9078b5d0-92c2-4982-8df1-7325acca7fcf None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:41.114471 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df30862e-fffc-476c-be7b-de21be73e6c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:41.115264 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df30862e-fffc-476c-be7b-de21be73e6c0 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:41.115536 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df30862e-fffc-476c-be7b-de21be73e6c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:41.115810 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df30862e-fffc-476c-be7b-de21be73e6c0 None admin] PATH_INFO: `/v3/services/image` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:41.116506 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df30862e-fffc-476c-be7b-de21be73e6c0 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:41.117923 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df30862e-fffc-476c-be7b-de21be73e6c0 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:41.122096 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8500bbee-7377-46d3-83fc-f22c8e90db76 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:41.129601 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-df30862e-fffc-476c-be7b-de21be73e6c0 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 15:24:41.129601 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:41.129601 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 15:24:41.129601 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 15:24:41.129601 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 15:24:41.129601 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 15:24:41.129601 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 15:24:41.129601 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:24:41.129601 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 15:24:41.129601 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:24:41.129601 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 15:24:41.129601 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:24:41.129601 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:41.129601 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:41.129601 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:41.129601 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:41.129601 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:41.130947 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:41.130947 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:41.130947 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:41.130947 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:41.130947 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:41.130947 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:41.130947 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 15:24:41.130947 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 15:24:41.130947 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 15:24:41.130947 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 15:24:41.130947 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:41.130947 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:41.130947 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:41.130947 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:41.130947 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:41.130947 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:41.131949 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:41.131949 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:41.131949 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:41.131949 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:41.131949 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:41.131949 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:41.131949 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:41.131949 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:41.131949 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:41.131949 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:41.131949 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 15:24:41.131949 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:24:41.131949 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 15:24:41.131949 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:24:41.131949 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 478/995] 10.222.0.118 () {56 vars in 1110 bytes} [Thu Jul 14 15:24:40 2022] GET /identity/v3/services/image => generated 86 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:24:41.137118 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df30862e-fffc-476c-be7b-de21be73e6c0 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:41.140830 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:41.161920 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7a3385-6137-4d21-95b1-ad38b5455a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:41.162685 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7a3385-6137-4d21-95b1-ad38b5455a9b None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:41.162965 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7a3385-6137-4d21-95b1-ad38b5455a9b None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:41.163239 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7a3385-6137-4d21-95b1-ad38b5455a9b None admin] PATH_INFO: `/v3/services` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:41.163945 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7a3385-6137-4d21-95b1-ad38b5455a9b None admin] RBAC: Adding query filter params (name=compute) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:41.164253 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7a3385-6137-4d21-95b1-ad38b5455a9b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:41.165628 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7a3385-6137-4d21-95b1-ad38b5455a9b None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:41.170654 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 518/996] 10.222.0.118 () {56 vars in 1117 bytes} [Thu Jul 14 15:24:41 2022] GET /identity/v3/services?name=compute => generated 125 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:41.176018 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7a3385-6137-4d21-95b1-ad38b5455a9b None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:41.257644 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df30862e-fffc-476c-be7b-de21be73e6c0 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:41.276850 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:41.287001 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7a3385-6137-4d21-95b1-ad38b5455a9b None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:41.296697 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce4c71a-4ff6-4e6c-b1e3-752441f5e28f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:41.296987 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce4c71a-4ff6-4e6c-b1e3-752441f5e28f None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:41.297274 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce4c71a-4ff6-4e6c-b1e3-752441f5e28f None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:41.297609 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce4c71a-4ff6-4e6c-b1e3-752441f5e28f None admin] PATH_INFO: `/v3/services` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:41.298860 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce4c71a-4ff6-4e6c-b1e3-752441f5e28f None admin] RBAC: Adding query filter params (name=image) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:41.299173 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce4c71a-4ff6-4e6c-b1e3-752441f5e28f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:41.300558 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce4c71a-4ff6-4e6c-b1e3-752441f5e28f None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:41.305540 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 479/997] 10.222.0.118 () {56 vars in 1113 bytes} [Thu Jul 14 15:24:41 2022] GET /identity/v3/services?name=image => generated 123 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:24:41.310995 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce4c71a-4ff6-4e6c-b1e3-752441f5e28f None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:41.330795 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd40c7f-4bd4-46fb-95a6-a7da35508e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:41.331459 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd40c7f-4bd4-46fb-95a6-a7da35508e06 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:41.331742 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd40c7f-4bd4-46fb-95a6-a7da35508e06 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:41.332017 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd40c7f-4bd4-46fb-95a6-a7da35508e06 None admin] PATH_INFO: `/v3/services` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:41.332721 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd40c7f-4bd4-46fb-95a6-a7da35508e06 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:41.333027 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd40c7f-4bd4-46fb-95a6-a7da35508e06 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:41.334468 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd40c7f-4bd4-46fb-95a6-a7da35508e06 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:41.339935 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 519/998] 10.222.0.118 () {56 vars in 1117 bytes} [Thu Jul 14 15:24:41 2022] GET /identity/v3/services?type=compute => generated 354 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:24:41.345896 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd40c7f-4bd4-46fb-95a6-a7da35508e06 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:41.380506 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:41.417359 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce4c71a-4ff6-4e6c-b1e3-752441f5e28f None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:41.451112 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c60ff4a-bba6-4eb9-a6dc-59a9e677075f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:41.451794 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c60ff4a-bba6-4eb9-a6dc-59a9e677075f None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:41.452070 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c60ff4a-bba6-4eb9-a6dc-59a9e677075f None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:41.452349 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c60ff4a-bba6-4eb9-a6dc-59a9e677075f None admin] PATH_INFO: `/v3/services` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:41.453065 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c60ff4a-bba6-4eb9-a6dc-59a9e677075f None admin] RBAC: Adding query filter params (type=image) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:41.453375 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c60ff4a-bba6-4eb9-a6dc-59a9e677075f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:41.455381 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c60ff4a-bba6-4eb9-a6dc-59a9e677075f None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:41.457213 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd40c7f-4bd4-46fb-95a6-a7da35508e06 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:41.460565 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 480/999] 10.222.0.118 () {56 vars in 1113 bytes} [Thu Jul 14 15:24:41 2022] GET /identity/v3/services?type=image => generated 123 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:24:41.495288 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f1b439-6367-413b-b239-970a6d892664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:41.496052 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f1b439-6367-413b-b239-970a6d892664 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:41.496393 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f1b439-6367-413b-b239-970a6d892664 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:41.496727 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f1b439-6367-413b-b239-970a6d892664 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:41.497599 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f1b439-6367-413b-b239-970a6d892664 None admin] RBAC: Adding query filter params (interface=public, service_id=22f55fba3d204877aaf21e48ab85e8d4, region_id=RegionOne) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:41.497992 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f1b439-6367-413b-b239-970a6d892664 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:41.499471 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f1b439-6367-413b-b239-970a6d892664 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:41.510267 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 520/1000] 10.222.0.118 () {56 vars in 1256 bytes} [Thu Jul 14 15:24:41 2022] GET /identity/v3/endpoints?service_id=22f55fba3d204877aaf21e48ab85e8d4&interface=public®ion_id=RegionOne => generated 195 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:24:41.511503 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c60ff4a-bba6-4eb9-a6dc-59a9e677075f None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:41.621278 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c60ff4a-bba6-4eb9-a6dc-59a9e677075f None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:41.650852 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:41.658733 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adb4749-6cdc-4588-9339-eda28dc84a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:41.659511 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adb4749-6cdc-4588-9339-eda28dc84a07 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:41.659883 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adb4749-6cdc-4588-9339-eda28dc84a07 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:41.660249 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adb4749-6cdc-4588-9339-eda28dc84a07 None admin] PATH_INFO: `/v3/services` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:41.661021 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adb4749-6cdc-4588-9339-eda28dc84a07 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:41.662536 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adb4749-6cdc-4588-9339-eda28dc84a07 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:41.673991 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 481/1001] 10.222.0.118 () {56 vars in 1092 bytes} [Thu Jul 14 15:24:41 2022] GET /identity/v3/services => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:24:42.418190 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79718359-787b-4d10-915d-96f231d24761 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:42.418767 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79718359-787b-4d10-915d-96f231d24761 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:42.418767 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79718359-787b-4d10-915d-96f231d24761 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:42.420260 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 521/1002] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:24:42 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:24:42.425821 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d3fef1-a700-40de-90e7-e558f91e481c None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:42.426302 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d3fef1-a700-40de-90e7-e558f91e481c None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:42.426477 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d3fef1-a700-40de-90e7-e558f91e481c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:42.443340 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-71d3fef1-a700-40de-90e7-e558f91e481c None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:42.444515 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-71d3fef1-a700-40de-90e7-e558f91e481c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:42.512093 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 482/1003] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:24:42 2022] POST /identity/v3/auth/tokens => generated 1562 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 15:24:42.534491 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79718359-787b-4d10-915d-96f231d24761 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:42.561778 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:42.644858 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79718359-787b-4d10-915d-96f231d24761 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:42.679416 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568a2a38-da47-4e7f-9928-e05fe675d5c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:42.680192 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568a2a38-da47-4e7f-9928-e05fe675d5c0 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:42.680501 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568a2a38-da47-4e7f-9928-e05fe675d5c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:42.680798 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568a2a38-da47-4e7f-9928-e05fe675d5c0 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:42.681469 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568a2a38-da47-4e7f-9928-e05fe675d5c0 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:42.682907 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568a2a38-da47-4e7f-9928-e05fe675d5c0 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:42.695728 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-568a2a38-da47-4e7f-9928-e05fe675d5c0 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 15:24:42.695728 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:42.695728 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 15:24:42.695728 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 15:24:42.695728 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 15:24:42.695728 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 15:24:42.695728 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 15:24:42.695728 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:24:42.695728 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 15:24:42.695728 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:24:42.695728 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 15:24:42.695728 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:24:42.695728 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:42.695728 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:42.695728 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:42.695728 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:42.695728 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:42.696692 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:42.696692 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:42.696692 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:42.696692 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:42.696692 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:42.696692 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:42.696692 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 15:24:42.696692 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 15:24:42.696692 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 15:24:42.696692 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 15:24:42.696692 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:42.696692 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:42.696692 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:42.696692 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:42.696692 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:42.696692 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:42.697685 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:42.697685 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:42.697685 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:42.697685 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:42.697685 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:42.697685 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:42.697685 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:42.697685 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:42.697685 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:42.697685 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:42.697685 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 15:24:42.697685 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:24:42.697685 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 15:24:42.697685 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:24:42.697685 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 522/1004] 10.222.0.118 () {56 vars in 1131 bytes} [Thu Jul 14 15:24:42 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:42.703257 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d3fef1-a700-40de-90e7-e558f91e481c None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:42.812783 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d3fef1-a700-40de-90e7-e558f91e481c None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:42.836594 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:42.848955 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcf050d-8d3e-4145-bd7b-bf0aa74a0bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:42.849614 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcf050d-8d3e-4145-bd7b-bf0aa74a0bcb None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:42.849891 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcf050d-8d3e-4145-bd7b-bf0aa74a0bcb None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:42.850188 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcf050d-8d3e-4145-bd7b-bf0aa74a0bcb None admin] PATH_INFO: `/v3/services` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:42.850887 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcf050d-8d3e-4145-bd7b-bf0aa74a0bcb None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:42.851187 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcf050d-8d3e-4145-bd7b-bf0aa74a0bcb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:42.852548 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcf050d-8d3e-4145-bd7b-bf0aa74a0bcb None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:42.857480 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 483/1005] 10.222.0.118 () {56 vars in 1127 bytes} [Thu Jul 14 15:24:42 2022] GET /identity/v3/services?name=object-store => generated 130 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:24:42.863089 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568a2a38-da47-4e7f-9928-e05fe675d5c0 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:42.951480 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:42.964631 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568a2a38-da47-4e7f-9928-e05fe675d5c0 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:42.997979 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ebcfba-e45a-43c2-a9e0-23d05fdcf1ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:42.998645 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ebcfba-e45a-43c2-a9e0-23d05fdcf1ef None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:42.998921 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ebcfba-e45a-43c2-a9e0-23d05fdcf1ef None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:42.999194 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ebcfba-e45a-43c2-a9e0-23d05fdcf1ef None admin] PATH_INFO: `/v3/services` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:42.999884 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ebcfba-e45a-43c2-a9e0-23d05fdcf1ef None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:43.000194 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ebcfba-e45a-43c2-a9e0-23d05fdcf1ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:43.002161 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ebcfba-e45a-43c2-a9e0-23d05fdcf1ef None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:43.007375 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 523/1006] 10.222.0.118 () {56 vars in 1127 bytes} [Thu Jul 14 15:24:42 2022] GET /identity/v3/services?type=object-store => generated 358 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:43.012873 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcf050d-8d3e-4145-bd7b-bf0aa74a0bcb None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:43.116235 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcf050d-8d3e-4145-bd7b-bf0aa74a0bcb None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:43.168009 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03abb253-20bd-4dd5-b24f-ec3516e93e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:43.168668 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03abb253-20bd-4dd5-b24f-ec3516e93e9a None admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:43.168941 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03abb253-20bd-4dd5-b24f-ec3516e93e9a None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:43.169210 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03abb253-20bd-4dd5-b24f-ec3516e93e9a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:43.170005 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03abb253-20bd-4dd5-b24f-ec3516e93e9a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:43.171429 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03abb253-20bd-4dd5-b24f-ec3516e93e9a None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:43.187465 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 484/1007] 10.222.0.118 () {60 vars in 1149 bytes} [Thu Jul 14 15:24:43 2022] POST /identity/v3/endpoints => generated 327 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:24:43.522770 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5aeca1-7ef7-4b76-87ea-54d059c5424d None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:43.523293 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5aeca1-7ef7-4b76-87ea-54d059c5424d None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:43.523293 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5aeca1-7ef7-4b76-87ea-54d059c5424d None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:43.524885 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 524/1008] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:24:43 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:24:43.529899 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c17521-8c95-4047-a30a-0c4c1225115a None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:43.530406 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c17521-8c95-4047-a30a-0c4c1225115a None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:43.530480 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c17521-8c95-4047-a30a-0c4c1225115a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:43.548185 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-02c17521-8c95-4047-a30a-0c4c1225115a None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:43.549374 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-02c17521-8c95-4047-a30a-0c4c1225115a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:43.593515 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:43.625378 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 485/1009] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:24:43 2022] POST /identity/v3/auth/tokens => generated 1710 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:24:43.648354 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5aeca1-7ef7-4b76-87ea-54d059c5424d None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:43.725269 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1bfdf9-09b3-49a4-b2b9-4efda737d691 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:43.725518 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1bfdf9-09b3-49a4-b2b9-4efda737d691 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:43.725797 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1bfdf9-09b3-49a4-b2b9-4efda737d691 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:43.730014 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 486/1010] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:24:43 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:24:43.732657 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0deeed9-c47f-46fa-984e-2d39994c68fd None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:43.732947 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0deeed9-c47f-46fa-984e-2d39994c68fd None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:43.733226 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0deeed9-c47f-46fa-984e-2d39994c68fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:43.751531 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-d0deeed9-c47f-46fa-984e-2d39994c68fd None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:43.752752 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-d0deeed9-c47f-46fa-984e-2d39994c68fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:43.762290 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5aeca1-7ef7-4b76-87ea-54d059c5424d None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:43.796569 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7b8240-1933-4d90-838c-f3f7e9b5509d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:43.797098 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7b8240-1933-4d90-838c-f3f7e9b5509d None admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:43.797472 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7b8240-1933-4d90-838c-f3f7e9b5509d None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:43.797730 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7b8240-1933-4d90-838c-f3f7e9b5509d None admin] PATH_INFO: `/v3/services` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:43.798457 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7b8240-1933-4d90-838c-f3f7e9b5509d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:43.799810 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7b8240-1933-4d90-838c-f3f7e9b5509d None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:43.816567 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 525/1011] 10.222.0.118 () {60 vars in 1146 bytes} [Thu Jul 14 15:24:43 2022] POST /identity/v3/services => generated 243 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:24:43.844379 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 487/1012] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:24:43 2022] POST /identity/v3/auth/tokens => generated 1806 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 15:24:43.862195 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7b8240-1933-4d90-838c-f3f7e9b5509d None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:43.879538 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:43.984346 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7b8240-1933-4d90-838c-f3f7e9b5509d None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:44.020962 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318c2209-2025-49f8-a14f-d710d2e7c4d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:44.021764 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318c2209-2025-49f8-a14f-d710d2e7c4d2 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:44.022131 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318c2209-2025-49f8-a14f-d710d2e7c4d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:44.022400 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318c2209-2025-49f8-a14f-d710d2e7c4d2 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:44.023058 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318c2209-2025-49f8-a14f-d710d2e7c4d2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:44.024431 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318c2209-2025-49f8-a14f-d710d2e7c4d2 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:44.036509 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-318c2209-2025-49f8-a14f-d710d2e7c4d2 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 15:24:44.036509 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:44.036509 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 15:24:44.036509 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 15:24:44.036509 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 15:24:44.036509 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 15:24:44.036509 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 15:24:44.036509 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:24:44.036509 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 15:24:44.036509 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:24:44.036509 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 15:24:44.036509 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:24:44.036509 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:44.036509 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:44.036509 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:44.036509 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:44.036509 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:44.037534 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:44.037534 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:44.037534 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:44.037534 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:44.037534 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:44.037534 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:44.037534 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 15:24:44.037534 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 15:24:44.037534 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 15:24:44.037534 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 15:24:44.037534 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:44.037534 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:44.037534 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:44.037534 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:44.037534 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:44.037534 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:44.038401 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:44.038401 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:44.038401 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:44.038401 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:44.038401 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:44.038401 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:44.038401 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:44.038401 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:44.038401 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:44.038401 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:44.038401 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 15:24:44.038401 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:24:44.038401 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 15:24:44.038401 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:24:44.038401 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 526/1013] 10.222.0.118 () {56 vars in 1116 bytes} [Thu Jul 14 15:24:43 2022] GET /identity/v3/services/compute => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:44.045468 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0deeed9-c47f-46fa-984e-2d39994c68fd None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:44.150565 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:44.155649 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0deeed9-c47f-46fa-984e-2d39994c68fd None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:44.191708 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfb0a1f-5cdc-461e-9d77-3d1ceaf0ae46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:44.192375 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfb0a1f-5cdc-461e-9d77-3d1ceaf0ae46 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:44.192657 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfb0a1f-5cdc-461e-9d77-3d1ceaf0ae46 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:44.192931 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfb0a1f-5cdc-461e-9d77-3d1ceaf0ae46 None admin] PATH_INFO: `/v3/services` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:44.193639 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfb0a1f-5cdc-461e-9d77-3d1ceaf0ae46 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:44.193948 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfb0a1f-5cdc-461e-9d77-3d1ceaf0ae46 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:44.195860 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfb0a1f-5cdc-461e-9d77-3d1ceaf0ae46 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:44.206135 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 488/1014] 10.222.0.118 () {56 vars in 1117 bytes} [Thu Jul 14 15:24:44 2022] GET /identity/v3/services?name=compute => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:24:44.207121 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318c2209-2025-49f8-a14f-d710d2e7c4d2 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:44.290562 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:44.317578 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318c2209-2025-49f8-a14f-d710d2e7c4d2 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:44.352340 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54551c5-3d66-454a-8da8-40cd0660c5c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:44.352923 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54551c5-3d66-454a-8da8-40cd0660c5c3 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:44.353202 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54551c5-3d66-454a-8da8-40cd0660c5c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:44.353479 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54551c5-3d66-454a-8da8-40cd0660c5c3 None admin] PATH_INFO: `/v3/services` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:44.354214 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54551c5-3d66-454a-8da8-40cd0660c5c3 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:44.354524 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54551c5-3d66-454a-8da8-40cd0660c5c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:44.355923 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54551c5-3d66-454a-8da8-40cd0660c5c3 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:44.366160 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 527/1015] 10.222.0.118 () {56 vars in 1117 bytes} [Thu Jul 14 15:24:44 2022] GET /identity/v3/services?type=compute => generated 354 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:24:44.367361 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfb0a1f-5cdc-461e-9d77-3d1ceaf0ae46 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:44.470668 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfb0a1f-5cdc-461e-9d77-3d1ceaf0ae46 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:44.505043 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f95f275-c1b1-4646-bab8-651f101c0116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:44.505773 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f95f275-c1b1-4646-bab8-651f101c0116 None admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:44.506087 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f95f275-c1b1-4646-bab8-651f101c0116 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:44.506367 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f95f275-c1b1-4646-bab8-651f101c0116 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:44.507172 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f95f275-c1b1-4646-bab8-651f101c0116 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:44.508550 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f95f275-c1b1-4646-bab8-651f101c0116 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:44.534002 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 489/1016] 10.222.0.118 () {60 vars in 1149 bytes} [Thu Jul 14 15:24:44 2022] POST /identity/v3/endpoints => generated 336 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:24:45.233710 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fddfbae-2b74-46f1-a137-8ebade4c2036 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:45.234271 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fddfbae-2b74-46f1-a137-8ebade4c2036 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:45.234271 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fddfbae-2b74-46f1-a137-8ebade4c2036 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:45.235688 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 528/1017] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:24:45 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:24:45.241019 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea150c-ab05-46f1-8978-b994e8d7c8ca None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:45.241308 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea150c-ab05-46f1-8978-b994e8d7c8ca None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:45.241582 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea150c-ab05-46f1-8978-b994e8d7c8ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:45.259704 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-08ea150c-ab05-46f1-8978-b994e8d7c8ca None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:45.260882 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-08ea150c-ab05-46f1-8978-b994e8d7c8ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:45.275741 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:45.336400 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 490/1018] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:24:45 2022] POST /identity/v3/auth/tokens => generated 1963 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:24:45.359601 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fddfbae-2b74-46f1-a137-8ebade4c2036 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:45.462085 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fddfbae-2b74-46f1-a137-8ebade4c2036 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:45.496123 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1550ae4-9fa2-4223-91a7-d49d0951f2f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:45.496826 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1550ae4-9fa2-4223-91a7-d49d0951f2f2 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:45.497098 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1550ae4-9fa2-4223-91a7-d49d0951f2f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:45.497364 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1550ae4-9fa2-4223-91a7-d49d0951f2f2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:45.498551 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1550ae4-9fa2-4223-91a7-d49d0951f2f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:45.499984 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1550ae4-9fa2-4223-91a7-d49d0951f2f2 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:45.506729 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 529/1019] 10.222.0.118 () {56 vars in 1113 bytes} [Thu Jul 14 15:24:45 2022] GET /identity/v3/domains/default => generated 200 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:45.507973 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ea150c-ab05-46f1-8978-b994e8d7c8ca None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:45.607101 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ea150c-ab05-46f1-8978-b994e8d7c8ca None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:45.642957 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5f0a76-e9c7-4c0a-bf09-3a3485f07be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:45.643619 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5f0a76-e9c7-4c0a-bf09-3a3485f07be5 None admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:45.643894 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5f0a76-e9c7-4c0a-bf09-3a3485f07be5 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:45.644159 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5f0a76-e9c7-4c0a-bf09-3a3485f07be5 None admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:45.644874 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5f0a76-e9c7-4c0a-bf09-3a3485f07be5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:45.646332 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5f0a76-e9c7-4c0a-bf09-3a3485f07be5 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:45.665761 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:45.681988 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 491/1020] 10.222.0.118 () {60 vars in 1146 bytes} [Thu Jul 14 15:24:45 2022] POST /identity/v3/projects => generated 312 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:24:45.887126 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e5cd25-2d1f-41a2-900d-f7fbff59561e None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:45.887310 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e5cd25-2d1f-41a2-900d-f7fbff59561e None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:45.887584 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e5cd25-2d1f-41a2-900d-f7fbff59561e None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:45.888971 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 530/1021] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:24:45 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:24:45.895331 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda1dd0-9769-4d46-a466-482897cb19cc None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:45.895620 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda1dd0-9769-4d46-a466-482897cb19cc None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:45.895894 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda1dd0-9769-4d46-a466-482897cb19cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:45.913882 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-4cda1dd0-9769-4d46-a466-482897cb19cc None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:45.915097 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-4cda1dd0-9769-4d46-a466-482897cb19cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:45.982463 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 492/1022] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:24:45 2022] POST /identity/v3/auth/tokens => generated 1963 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 15:24:46.005262 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e5cd25-2d1f-41a2-900d-f7fbff59561e None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:46.017228 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:46.108924 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e5cd25-2d1f-41a2-900d-f7fbff59561e None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:46.146520 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb87c30-f681-440c-b731-102f642d5876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:46.147315 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb87c30-f681-440c-b731-102f642d5876 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:46.147588 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb87c30-f681-440c-b731-102f642d5876 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:46.147852 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb87c30-f681-440c-b731-102f642d5876 None admin] PATH_INFO: `/v3/services/image` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:46.148492 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb87c30-f681-440c-b731-102f642d5876 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:46.149850 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb87c30-f681-440c-b731-102f642d5876 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:46.161446 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-5cb87c30-f681-440c-b731-102f642d5876 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 15:24:46.161446 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:46.161446 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 15:24:46.161446 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 15:24:46.161446 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 15:24:46.161446 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 15:24:46.161446 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 15:24:46.161446 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:24:46.161446 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 15:24:46.161446 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:24:46.161446 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 15:24:46.161446 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:24:46.161446 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:46.161446 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:46.161446 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:46.161446 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:46.161446 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:46.162454 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:46.162454 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:46.162454 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:46.162454 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:46.162454 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:46.162454 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:46.162454 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 15:24:46.162454 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 15:24:46.162454 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 15:24:46.162454 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 15:24:46.162454 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:46.162454 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:46.162454 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:46.162454 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:46.162454 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:46.162454 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:46.163287 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:46.163287 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:46.163287 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:46.163287 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:46.163287 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:46.163287 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:46.163287 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:46.163287 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:46.163287 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:46.163287 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:46.163287 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 15:24:46.163287 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:24:46.163287 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 15:24:46.163287 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:24:46.166043 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 531/1023] 10.222.0.118 () {56 vars in 1110 bytes} [Thu Jul 14 15:24:46 2022] GET /identity/v3/services/image => generated 86 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:46.168858 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cda1dd0-9769-4d46-a466-482897cb19cc None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:46.270244 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cda1dd0-9769-4d46-a466-482897cb19cc None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:46.296676 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:46.305761 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb833d9-976c-4cf1-a030-704a864d497f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:46.306468 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb833d9-976c-4cf1-a030-704a864d497f None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:46.306750 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb833d9-976c-4cf1-a030-704a864d497f None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:46.307025 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb833d9-976c-4cf1-a030-704a864d497f None admin] PATH_INFO: `/v3/services` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:46.307730 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb833d9-976c-4cf1-a030-704a864d497f None admin] RBAC: Adding query filter params (name=image) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:46.308065 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb833d9-976c-4cf1-a030-704a864d497f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:46.309442 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb833d9-976c-4cf1-a030-704a864d497f None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:46.319730 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 493/1024] 10.222.0.118 () {56 vars in 1113 bytes} [Thu Jul 14 15:24:46 2022] GET /identity/v3/services?name=image => generated 123 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:46.320746 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb87c30-f681-440c-b731-102f642d5876 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:46.393360 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:46.426738 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb87c30-f681-440c-b731-102f642d5876 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:46.461538 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32e2226-0d3a-4a5e-b9b3-2660a1c0d627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:46.462233 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32e2226-0d3a-4a5e-b9b3-2660a1c0d627 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:46.462517 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32e2226-0d3a-4a5e-b9b3-2660a1c0d627 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:46.462793 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32e2226-0d3a-4a5e-b9b3-2660a1c0d627 None admin] PATH_INFO: `/v3/services` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:46.463508 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32e2226-0d3a-4a5e-b9b3-2660a1c0d627 None admin] RBAC: Adding query filter params (type=image) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:46.463819 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32e2226-0d3a-4a5e-b9b3-2660a1c0d627 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:46.465212 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32e2226-0d3a-4a5e-b9b3-2660a1c0d627 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:46.470662 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 532/1025] 10.222.0.118 () {56 vars in 1113 bytes} [Thu Jul 14 15:24:46 2022] GET /identity/v3/services?type=image => generated 352 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:24:46.476348 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb833d9-976c-4cf1-a030-704a864d497f None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:46.578605 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb833d9-976c-4cf1-a030-704a864d497f None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:46.612641 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70ee7e4-854a-4b14-bbb2-0f8ab0eaaebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:46.613377 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70ee7e4-854a-4b14-bbb2-0f8ab0eaaebf None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:46.613641 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70ee7e4-854a-4b14-bbb2-0f8ab0eaaebf None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:46.613939 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70ee7e4-854a-4b14-bbb2-0f8ab0eaaebf None admin] PATH_INFO: `/v3/endpoints` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:46.614758 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70ee7e4-854a-4b14-bbb2-0f8ab0eaaebf None admin] RBAC: Adding query filter params (interface=public, service_id=e1c8249f95744c179898dcb04a9457cf, region_id=RegionOne) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:46.615103 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70ee7e4-854a-4b14-bbb2-0f8ab0eaaebf None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:46.616484 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70ee7e4-854a-4b14-bbb2-0f8ab0eaaebf None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:46.626917 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 494/1026] 10.222.0.118 () {56 vars in 1256 bytes} [Thu Jul 14 15:24:46 2022] GET /identity/v3/endpoints?service_id=e1c8249f95744c179898dcb04a9457cf&interface=public®ion_id=RegionOne => generated 195 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:46.627997 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32e2226-0d3a-4a5e-b9b3-2660a1c0d627 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:46.696913 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b6d4a6-d235-4129-a2a2-d6e370368689 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:46.697127 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b6d4a6-d235-4129-a2a2-d6e370368689 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:46.697407 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b6d4a6-d235-4129-a2a2-d6e370368689 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:46.698827 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 495/1027] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:24:46 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:24:46.703736 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31f947c-7ec4-409a-bd29-a50580ba6324 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:46.704021 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31f947c-7ec4-409a-bd29-a50580ba6324 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:46.704296 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31f947c-7ec4-409a-bd29-a50580ba6324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:46.728773 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-e31f947c-7ec4-409a-bd29-a50580ba6324 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:46.729991 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-e31f947c-7ec4-409a-bd29-a50580ba6324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:46.735956 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32e2226-0d3a-4a5e-b9b3-2660a1c0d627 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:46.771644 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62769355-6d4e-4ec5-ae21-15a0bd5a347a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:46.772311 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62769355-6d4e-4ec5-ae21-15a0bd5a347a None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:46.772594 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62769355-6d4e-4ec5-ae21-15a0bd5a347a None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:46.772870 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62769355-6d4e-4ec5-ae21-15a0bd5a347a None admin] PATH_INFO: `/v3/services` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:46.773553 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62769355-6d4e-4ec5-ae21-15a0bd5a347a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:46.775000 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62769355-6d4e-4ec5-ae21-15a0bd5a347a None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:46.776986 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:46.782830 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:46.784506 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 533/1028] 10.222.0.118 () {56 vars in 1092 bytes} [Thu Jul 14 15:24:46 2022] GET /identity/v3/services => generated 1966 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:24:46.802199 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 496/1029] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:24:46 2022] POST /identity/v3/auth/tokens => generated 1963 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 15:24:46.826320 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62769355-6d4e-4ec5-ae21-15a0bd5a347a None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:46.936451 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62769355-6d4e-4ec5-ae21-15a0bd5a347a None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:46.973733 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8db49ce-3a36-45f4-8970-f852ce6b3c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:46.974493 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db49ce-3a36-45f4-8970-f852ce6b3c91 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:46.974773 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db49ce-3a36-45f4-8970-f852ce6b3c91 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:46.975049 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db49ce-3a36-45f4-8970-f852ce6b3c91 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:46.986062 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8db49ce-3a36-45f4-8970-f852ce6b3c91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:24:46.994116 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-f8db49ce-3a36-45f4-8970-f852ce6b3c91 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 15:24:46.994116 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:46.994116 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:46.994116 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:46.994116 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:46.994116 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:46.994116 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:46.994116 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:46.994116 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:46.994116 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:46.994116 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:46.994116 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:46.994116 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:24:46.994116 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:24:46.994116 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:24:46.994116 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:24:46.995214 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:24:46.995214 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:24:46.995214 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:24:46.995214 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:24:46.995214 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:46.995214 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:46.995214 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:46.995214 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:46.995214 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:46.995214 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:46.995214 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:46.995214 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:46.995214 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:46.995214 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:46.995214 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:46.995214 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:46.996340 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:46.996340 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:46.996340 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:46.996340 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:46.996340 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:24:46.996340 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:24:46.996340 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:24:46.996340 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:24:46.996340 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:24:46.996340 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:24:46.996340 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 15:24:46.996340 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:24:46.996340 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 534/1030] 10.222.0.118 () {56 vars in 1125 bytes} [Thu Jul 14 15:24:46 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:47.001377 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31f947c-7ec4-409a-bd29-a50580ba6324 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:47.102385 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31f947c-7ec4-409a-bd29-a50580ba6324 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:47.136627 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c994712-8590-4c96-a14f-feac2769666b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:47.137299 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c994712-8590-4c96-a14f-feac2769666b None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:47.137577 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c994712-8590-4c96-a14f-feac2769666b None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:47.137849 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c994712-8590-4c96-a14f-feac2769666b None admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:47.138624 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c994712-8590-4c96-a14f-feac2769666b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:47.138929 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c994712-8590-4c96-a14f-feac2769666b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:47.140312 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c994712-8590-4c96-a14f-feac2769666b None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:47.149309 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 497/1031] 10.222.0.118 () {56 vars in 1120 bytes} [Thu Jul 14 15:24:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 340 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:47.154758 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8db49ce-3a36-45f4-8970-f852ce6b3c91 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:47.214835 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:47.257851 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8db49ce-3a36-45f4-8970-f852ce6b3c91 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:47.291962 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512a7edd-9b26-447d-9b94-ad16dda6d537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:47.292759 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a7edd-9b26-447d-9b94-ad16dda6d537 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:47.293036 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a7edd-9b26-447d-9b94-ad16dda6d537 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:47.293308 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a7edd-9b26-447d-9b94-ad16dda6d537 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:47.304725 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512a7edd-9b26-447d-9b94-ad16dda6d537 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:47.306228 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512a7edd-9b26-447d-9b94-ad16dda6d537 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:47.323725 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-512a7edd-9b26-447d-9b94-ad16dda6d537 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:47.323725 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:47.323725 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:47.323725 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:47.323725 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:47.323725 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:47.323725 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:47.323725 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:47.323725 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:47.323725 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:47.323725 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:47.323725 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:47.323725 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:24:47.323725 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:24:47.323725 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:24:47.325104 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:24:47.325104 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:47.325104 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:47.325104 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:47.325104 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:47.325104 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:47.325104 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:47.325104 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:47.325104 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:47.325104 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:47.325104 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:47.325104 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:47.325104 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:47.325104 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:47.325104 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:47.325104 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:47.325104 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:47.326418 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:24:47.326418 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:24:47.326418 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:47.326418 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:24:47.326890 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 535/1032] 10.222.0.118 () {56 vars in 1113 bytes} [Thu Jul 14 15:24:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:47.330703 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c994712-8590-4c96-a14f-feac2769666b None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:47.380255 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:47.434240 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c994712-8590-4c96-a14f-feac2769666b None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:47.467914 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebcd11e-4fe6-412a-82b2-afb8ac5e0142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:47.468578 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebcd11e-4fe6-412a-82b2-afb8ac5e0142 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:47.468858 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebcd11e-4fe6-412a-82b2-afb8ac5e0142 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:47.469194 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebcd11e-4fe6-412a-82b2-afb8ac5e0142 None admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:47.469916 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebcd11e-4fe6-412a-82b2-afb8ac5e0142 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:47.470249 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebcd11e-4fe6-412a-82b2-afb8ac5e0142 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:47.471626 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebcd11e-4fe6-412a-82b2-afb8ac5e0142 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:47.483944 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 498/1033] 10.222.0.118 () {56 vars in 1114 bytes} [Thu Jul 14 15:24:47 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:24:47.489898 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512a7edd-9b26-447d-9b94-ad16dda6d537 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:47.590256 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512a7edd-9b26-447d-9b94-ad16dda6d537 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:47.603204 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:47.626457 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5917c227-541a-4a68-812e-bfb260c8ffe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:47.627250 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5917c227-541a-4a68-812e-bfb260c8ffe4 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:47.627529 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5917c227-541a-4a68-812e-bfb260c8ffe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:47.627805 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5917c227-541a-4a68-812e-bfb260c8ffe4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:47.635879 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5917c227-541a-4a68-812e-bfb260c8ffe4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:47.637434 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5917c227-541a-4a68-812e-bfb260c8ffe4 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:47.652683 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-5917c227-541a-4a68-812e-bfb260c8ffe4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 15:24:47.652683 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:47.652683 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:47.652683 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:47.652683 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:47.652683 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:47.652683 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:47.652683 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:47.652683 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:47.652683 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:47.652683 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:47.652683 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:47.652683 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 15:24:47.652683 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 15:24:47.652683 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 15:24:47.652683 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 15:24:47.653655 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:47.653655 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:47.653655 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 15:24:47.653655 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:24:47.653655 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 15:24:47.653655 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:24:47.653655 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:47.653655 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:47.653655 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:47.653655 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:47.653655 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:47.653655 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:47.653655 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:47.653655 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:47.653655 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:47.653655 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:47.653655 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:47.653655 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:47.654652 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:47.654652 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:47.654652 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 15:24:47.654652 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 15:24:47.654652 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 15:24:47.654652 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 15:24:47.654652 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 15:24:47.654652 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 15:24:47.654652 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 15:24:47.654652 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:24:47.654652 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 536/1034] 10.222.0.118 () {56 vars in 1098 bytes} [Thu Jul 14 15:24:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:47.661647 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebcd11e-4fe6-412a-82b2-afb8ac5e0142 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:47.769208 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebcd11e-4fe6-412a-82b2-afb8ac5e0142 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:47.779048 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:47.788907 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feef11d8-8094-4152-b7c2-1da197e9e8c9 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:47.789252 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feef11d8-8094-4152-b7c2-1da197e9e8c9 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:47.789839 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feef11d8-8094-4152-b7c2-1da197e9e8c9 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:47.791229 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 537/1035] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:24:47 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 14 15:24:47.796055 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473b11ef-f002-4395-830b-38192c058b6b None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:47.796336 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473b11ef-f002-4395-830b-38192c058b6b None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:47.796611 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473b11ef-f002-4395-830b-38192c058b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:47.808056 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c38fad-da05-4ba6-8a17-45c1077608f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:47.808725 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c38fad-da05-4ba6-8a17-45c1077608f5 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:47.809001 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c38fad-da05-4ba6-8a17-45c1077608f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:47.809529 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c38fad-da05-4ba6-8a17-45c1077608f5 None admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:47.810191 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c38fad-da05-4ba6-8a17-45c1077608f5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:47.810501 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c38fad-da05-4ba6-8a17-45c1077608f5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:47.812160 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c38fad-da05-4ba6-8a17-45c1077608f5 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:47.815541 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-473b11ef-f002-4395-830b-38192c058b6b None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:47.816778 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-473b11ef-f002-4395-830b-38192c058b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:47.830390 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 499/1036] 10.222.0.118 () {56 vars in 1138 bytes} [Thu Jul 14 15:24:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:47.835707 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c38fad-da05-4ba6-8a17-45c1077608f5 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:47.917183 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 538/1037] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:24:47 2022] POST /identity/v3/auth/tokens => generated 1963 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 15:24:47.941200 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473b11ef-f002-4395-830b-38192c058b6b None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:47.974376 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c38fad-da05-4ba6-8a17-45c1077608f5 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:48.011496 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad613aa-7674-44ad-8ea8-e8c65f011597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:48.012914 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad613aa-7674-44ad-8ea8-e8c65f011597 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:48.013391 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad613aa-7674-44ad-8ea8-e8c65f011597 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:48.013740 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad613aa-7674-44ad-8ea8-e8c65f011597 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:48.049602 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473b11ef-f002-4395-830b-38192c058b6b None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:48.050817 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:48.051354 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:48.087026 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a46be3-0eac-4198-af23-5dbc6e85e6ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:48.088101 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a46be3-0eac-4198-af23-5dbc6e85e6ab None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:48.088601 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a46be3-0eac-4198-af23-5dbc6e85e6ab None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:48.088882 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a46be3-0eac-4198-af23-5dbc6e85e6ab None admin] PATH_INFO: `/v3/domains/default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:48.089051 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad613aa-7674-44ad-8ea8-e8c65f011597 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:48.090098 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a46be3-0eac-4198-af23-5dbc6e85e6ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:48.090531 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad613aa-7674-44ad-8ea8-e8c65f011597 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:48.091534 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a46be3-0eac-4198-af23-5dbc6e85e6ab None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:48.094304 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 539/1038] 10.222.0.118 () {56 vars in 1113 bytes} [Thu Jul 14 15:24:47 2022] GET /identity/v3/domains/default => generated 200 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:24:48.098819 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a46be3-0eac-4198-af23-5dbc6e85e6ab None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:48.198623 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 500/1039] 10.222.0.118 () {58 vars in 1287 bytes} [Thu Jul 14 15:24:47 2022] GET /identity/v3/auth/tokens => generated 1963 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 14 15:24:48.204689 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad613aa-7674-44ad-8ea8-e8c65f011597 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:48.207715 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a46be3-0eac-4198-af23-5dbc6e85e6ab None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:48.255694 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e129969f-0129-4588-ad33-fe5550e0ab97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:48.256380 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e129969f-0129-4588-ad33-fe5550e0ab97 None admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:48.256656 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e129969f-0129-4588-ad33-fe5550e0ab97 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:48.256925 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e129969f-0129-4588-ad33-fe5550e0ab97 None admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:48.257649 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e129969f-0129-4588-ad33-fe5550e0ab97 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:48.259166 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e129969f-0129-4588-ad33-fe5550e0ab97 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:48.273510 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:48.284132 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 540/1040] 10.222.0.118 () {60 vars in 1137 bytes} [Thu Jul 14 15:24:48 2022] POST /identity/v3/users => generated 286 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:24:48.324248 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad613aa-7674-44ad-8ea8-e8c65f011597 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:48.363063 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3af39d0-74e2-41d8-841b-030b8c4dd90f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:48.363888 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3af39d0-74e2-41d8-841b-030b8c4dd90f None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:48.364164 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3af39d0-74e2-41d8-841b-030b8c4dd90f None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:48.364438 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3af39d0-74e2-41d8-841b-030b8c4dd90f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:48.376047 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3af39d0-74e2-41d8-841b-030b8c4dd90f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:48.377529 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3af39d0-74e2-41d8-841b-030b8c4dd90f None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:48.396719 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-a3af39d0-74e2-41d8-841b-030b8c4dd90f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:48.396719 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:48.396719 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:48.396719 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:48.396719 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:48.396719 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:48.396719 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:48.396719 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:48.396719 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:48.396719 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:48.396719 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:48.396719 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:48.396719 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:24:48.396719 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:24:48.396719 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:24:48.398326 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:24:48.398326 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:48.398326 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:48.398326 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:48.398326 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:48.398326 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:48.398326 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:48.398326 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:48.398326 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:48.398326 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:48.398326 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:48.398326 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:48.398326 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:48.398326 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:48.398326 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:48.398326 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:48.398326 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:48.399296 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:24:48.399296 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:24:48.399296 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:48.399296 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:24:48.399296 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 501/1041] 10.222.0.118 () {56 vars in 1113 bytes} [Thu Jul 14 15:24:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:24:48.407830 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e129969f-0129-4588-ad33-fe5550e0ab97 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:48.438074 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:48.517913 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e129969f-0129-4588-ad33-fe5550e0ab97 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:48.553274 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6fdad8-0f97-43c2-af59-6b0e616f4334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:48.553939 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6fdad8-0f97-43c2-af59-6b0e616f4334 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:48.554238 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6fdad8-0f97-43c2-af59-6b0e616f4334 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:48.554505 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6fdad8-0f97-43c2-af59-6b0e616f4334 None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:48.555219 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6fdad8-0f97-43c2-af59-6b0e616f4334 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:48.555517 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6fdad8-0f97-43c2-af59-6b0e616f4334 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:48.556871 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6fdad8-0f97-43c2-af59-6b0e616f4334 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:48.569353 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 541/1042] 10.222.0.118 () {56 vars in 1114 bytes} [Thu Jul 14 15:24:48 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:48.574734 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3af39d0-74e2-41d8-841b-030b8c4dd90f None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:48.676842 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3af39d0-74e2-41d8-841b-030b8c4dd90f None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:48.694717 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:48.722010 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786569ab-9f04-473f-a59e-55534d44edcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:48.722832 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786569ab-9f04-473f-a59e-55534d44edcc None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:48.723110 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786569ab-9f04-473f-a59e-55534d44edcc None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:48.723382 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786569ab-9f04-473f-a59e-55534d44edcc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:48.730646 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786569ab-9f04-473f-a59e-55534d44edcc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:48.732082 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786569ab-9f04-473f-a59e-55534d44edcc None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:48.746627 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-786569ab-9f04-473f-a59e-55534d44edcc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:24:48.746627 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:48.746627 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:48.746627 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:48.746627 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:48.746627 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:48.746627 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:48.746627 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:48.746627 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:48.746627 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:48.746627 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:48.746627 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:48.746627 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 15:24:48.746627 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 15:24:48.746627 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 15:24:48.747568 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 15:24:48.747568 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:48.747568 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:48.747568 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:48.747568 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:48.747568 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:48.747568 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:48.747568 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:48.747568 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:48.747568 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:48.747568 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:48.747568 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:48.747568 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:48.747568 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:48.747568 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:48.747568 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:48.747568 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:48.748440 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 15:24:48.748440 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 15:24:48.748440 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:24:48.748440 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:24:48.748440 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:24:48.748440 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:24:48.748440 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:24:48.748440 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:24:48.750034 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 502/1043] 10.222.0.118 () {56 vars in 1116 bytes} [Thu Jul 14 15:24:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:48.753872 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6fdad8-0f97-43c2-af59-6b0e616f4334 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:48.842975 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:48.859231 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6fdad8-0f97-43c2-af59-6b0e616f4334 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:48.867733 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85befbb-ed19-4710-a7e7-7a45d84c1236 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:48.868050 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85befbb-ed19-4710-a7e7-7a45d84c1236 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:48.868330 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85befbb-ed19-4710-a7e7-7a45d84c1236 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:48.873553 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 503/1044] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:24:48 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:24:48.874772 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552baaca-6495-4823-a2d6-3cc8e7ce9c22 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:48.875121 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552baaca-6495-4823-a2d6-3cc8e7ce9c22 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:48.876037 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552baaca-6495-4823-a2d6-3cc8e7ce9c22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:48.892914 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-552baaca-6495-4823-a2d6-3cc8e7ce9c22 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:48.894121 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-552baaca-6495-4823-a2d6-3cc8e7ce9c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:48.901132 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746dd6d9-233d-4876-b631-b6dbcc98c3da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:48.902233 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746dd6d9-233d-4876-b631-b6dbcc98c3da None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:48.902519 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746dd6d9-233d-4876-b631-b6dbcc98c3da None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:48.902796 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746dd6d9-233d-4876-b631-b6dbcc98c3da None admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:48.903955 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746dd6d9-233d-4876-b631-b6dbcc98c3da None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:48.904275 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746dd6d9-233d-4876-b631-b6dbcc98c3da None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:48.906136 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746dd6d9-233d-4876-b631-b6dbcc98c3da None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:48.919074 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 542/1045] 10.222.0.118 () {56 vars in 1153 bytes} [Thu Jul 14 15:24:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:48.925114 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746dd6d9-233d-4876-b631-b6dbcc98c3da None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:48.971947 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 504/1046] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:24:48 2022] POST /identity/v3/auth/tokens => generated 1963 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 15:24:48.995495 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552baaca-6495-4823-a2d6-3cc8e7ce9c22 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:49.037937 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746dd6d9-233d-4876-b631-b6dbcc98c3da None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:49.074392 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eea91eb-601d-4587-850c-1e837d037107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:49.075052 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eea91eb-601d-4587-850c-1e837d037107 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:49.075332 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eea91eb-601d-4587-850c-1e837d037107 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:49.075607 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eea91eb-601d-4587-850c-1e837d037107 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:49.076445 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eea91eb-601d-4587-850c-1e837d037107 None admin] RBAC: Adding query filter params (role.id=395d04a64fa447d88861d9397f70322e, scope.project.id=939bf9541f4a4afe86550f749d337680, user.id=f0177fc696ea40069902803da09f437c) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:49.076757 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eea91eb-601d-4587-850c-1e837d037107 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:49.078207 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eea91eb-601d-4587-850c-1e837d037107 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:49.086147 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 543/1047] 10.222.0.118 () {56 vars in 1379 bytes} [Thu Jul 14 15:24:48 2022] GET /identity/v3/role_assignments?user.id=f0177fc696ea40069902803da09f437c&scope.project.id=939bf9541f4a4afe86550f749d337680&role.id=395d04a64fa447d88861d9397f70322e => generated 260 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:24:49.108769 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552baaca-6495-4823-a2d6-3cc8e7ce9c22 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:49.121284 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:49.149977 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f89918-e1c6-4be7-92d4-1e9203ed97b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:49.150816 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f89918-e1c6-4be7-92d4-1e9203ed97b0 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:49.151097 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f89918-e1c6-4be7-92d4-1e9203ed97b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:49.151372 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f89918-e1c6-4be7-92d4-1e9203ed97b0 None admin] PATH_INFO: `/v3/services/image` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:49.152039 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f89918-e1c6-4be7-92d4-1e9203ed97b0 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:49.153485 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f89918-e1c6-4be7-92d4-1e9203ed97b0 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:49.167223 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-20f89918-e1c6-4be7-92d4-1e9203ed97b0 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 15:24:49.167223 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:49.167223 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 15:24:49.167223 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 15:24:49.167223 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 15:24:49.167223 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 15:24:49.167223 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 15:24:49.167223 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:24:49.167223 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 15:24:49.167223 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:24:49.167223 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 15:24:49.167223 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:24:49.167223 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:49.167223 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:49.167223 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:49.167223 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:49.167223 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:49.168366 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:49.168366 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:49.168366 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:49.168366 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:49.168366 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:49.168366 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:49.168366 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 15:24:49.168366 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 15:24:49.168366 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 15:24:49.168366 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 15:24:49.168366 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:49.168366 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:49.168366 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:49.168366 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:49.168366 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:49.168366 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:49.169199 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:49.169199 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:49.169199 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:49.169199 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:49.169199 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:49.169199 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:49.169199 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:49.169199 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:49.169199 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:49.169199 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:49.169199 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 15:24:49.169199 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:24:49.169199 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 15:24:49.169199 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:24:49.169199 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 505/1048] 10.222.0.118 () {56 vars in 1110 bytes} [Thu Jul 14 15:24:48 2022] GET /identity/v3/services/image => generated 86 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:24:49.175351 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eea91eb-601d-4587-850c-1e837d037107 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:49.189452 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:49.287674 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eea91eb-601d-4587-850c-1e837d037107 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:49.322943 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504c2996-f172-4aeb-b63d-e0182edae360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:49.323604 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504c2996-f172-4aeb-b63d-e0182edae360 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:49.323884 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504c2996-f172-4aeb-b63d-e0182edae360 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:49.324165 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504c2996-f172-4aeb-b63d-e0182edae360 None admin] PATH_INFO: `/v3/services` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:49.324873 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504c2996-f172-4aeb-b63d-e0182edae360 None admin] RBAC: Adding query filter params (name=image) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:49.325181 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504c2996-f172-4aeb-b63d-e0182edae360 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:49.326584 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504c2996-f172-4aeb-b63d-e0182edae360 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:49.332242 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 544/1049] 10.222.0.118 () {56 vars in 1113 bytes} [Thu Jul 14 15:24:49 2022] GET /identity/v3/services?name=image => generated 123 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:49.338331 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f89918-e1c6-4be7-92d4-1e9203ed97b0 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:49.456843 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f89918-e1c6-4be7-92d4-1e9203ed97b0 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:49.493653 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef11d38-c7ad-47bc-b031-9ec63cb43fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:49.494341 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef11d38-c7ad-47bc-b031-9ec63cb43fbd None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:49.494621 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef11d38-c7ad-47bc-b031-9ec63cb43fbd None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:49.494893 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef11d38-c7ad-47bc-b031-9ec63cb43fbd None admin] PATH_INFO: `/v3/services` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:49.495599 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef11d38-c7ad-47bc-b031-9ec63cb43fbd None admin] RBAC: Adding query filter params (type=image) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:49.495903 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef11d38-c7ad-47bc-b031-9ec63cb43fbd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:49.497275 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef11d38-c7ad-47bc-b031-9ec63cb43fbd None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:49.507553 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 506/1050] 10.222.0.118 () {56 vars in 1113 bytes} [Thu Jul 14 15:24:49 2022] GET /identity/v3/services?type=image => generated 352 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:49.509208 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504c2996-f172-4aeb-b63d-e0182edae360 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:49.586400 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:49.615051 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504c2996-f172-4aeb-b63d-e0182edae360 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:49.648530 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb561ed-2fcc-497c-8350-64b4c4e795e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:49.649182 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb561ed-2fcc-497c-8350-64b4c4e795e7 None admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:49.649461 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb561ed-2fcc-497c-8350-64b4c4e795e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:49.649732 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb561ed-2fcc-497c-8350-64b4c4e795e7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:49.650504 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb561ed-2fcc-497c-8350-64b4c4e795e7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:49.651865 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb561ed-2fcc-497c-8350-64b4c4e795e7 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:49.678003 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 545/1051] 10.222.0.118 () {60 vars in 1149 bytes} [Thu Jul 14 15:24:49 2022] POST /identity/v3/endpoints => generated 329 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:24:50.427443 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a295c-d49a-463f-beff-8b3170aca90a None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:50.427964 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a295c-d49a-463f-beff-8b3170aca90a None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:50.427964 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a295c-d49a-463f-beff-8b3170aca90a None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:50.429517 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 507/1052] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:24:50 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 14 15:24:50.434566 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbdf12a-6151-4bc6-9f94-8d935c2922d3 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:50.434860 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbdf12a-6151-4bc6-9f94-8d935c2922d3 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:50.435139 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbdf12a-6151-4bc6-9f94-8d935c2922d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:50.454094 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-cfbdf12a-6151-4bc6-9f94-8d935c2922d3 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:50.455293 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-cfbdf12a-6151-4bc6-9f94-8d935c2922d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:50.527670 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 546/1053] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:24:50 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:24:50.551721 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59a295c-d49a-463f-beff-8b3170aca90a None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:50.589938 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:50.660447 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59a295c-d49a-463f-beff-8b3170aca90a None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:50.695544 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d80d65-3fa2-48b2-a416-62fcb58a6e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:50.696289 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d80d65-3fa2-48b2-a416-62fcb58a6e0a None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:50.696570 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d80d65-3fa2-48b2-a416-62fcb58a6e0a None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:50.696866 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d80d65-3fa2-48b2-a416-62fcb58a6e0a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:50.714029 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d80d65-3fa2-48b2-a416-62fcb58a6e0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:24:50.720906 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-97d80d65-3fa2-48b2-a416-62fcb58a6e0a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:24:50.720906 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:50.720906 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:50.720906 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:50.720906 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:50.720906 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:50.720906 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:50.720906 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:50.720906 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:50.720906 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:50.720906 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:50.720906 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:50.720906 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:24:50.720906 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:24:50.720906 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:24:50.720906 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:24:50.721846 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:24:50.721846 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:24:50.721846 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:24:50.721846 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:24:50.721846 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:50.721846 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:50.721846 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:50.721846 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:50.721846 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:50.721846 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:50.721846 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:50.721846 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:50.721846 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:50.721846 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:50.721846 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:50.721846 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:50.722836 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:50.722836 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:50.722836 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:50.722836 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:50.722836 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:24:50.722836 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:24:50.722836 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:24:50.722836 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:24:50.722836 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:24:50.722836 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:24:50.722836 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:24:50.722836 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:24:50.722836 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 508/1054] 10.222.0.118 () {56 vars in 1101 bytes} [Thu Jul 14 15:24:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:50.727425 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbdf12a-6151-4bc6-9f94-8d935c2922d3 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:50.787489 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:50.837096 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbdf12a-6151-4bc6-9f94-8d935c2922d3 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:50.872510 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c1f0bc-a1fd-4a07-a94d-82a611db28d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:50.873179 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c1f0bc-a1fd-4a07-a94d-82a611db28d2 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:50.873457 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c1f0bc-a1fd-4a07-a94d-82a611db28d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:50.873810 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c1f0bc-a1fd-4a07-a94d-82a611db28d2 None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:50.874628 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c1f0bc-a1fd-4a07-a94d-82a611db28d2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:50.874936 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c1f0bc-a1fd-4a07-a94d-82a611db28d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:50.876892 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c1f0bc-a1fd-4a07-a94d-82a611db28d2 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:50.885888 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 547/1055] 10.222.0.118 () {56 vars in 1104 bytes} [Thu Jul 14 15:24:50 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:50.891887 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d80d65-3fa2-48b2-a416-62fcb58a6e0a None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:50.989357 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:50.996583 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d80d65-3fa2-48b2-a416-62fcb58a6e0a None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:51.032957 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c71c93-2167-4593-8ce2-aca0bd80651f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:51.033837 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c71c93-2167-4593-8ce2-aca0bd80651f None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:51.034149 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c71c93-2167-4593-8ce2-aca0bd80651f None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:51.034428 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c71c93-2167-4593-8ce2-aca0bd80651f None admin] PATH_INFO: `/v3/users/b0aef2a958c640c5abb47cdd51f3f5c5` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:51.049265 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c71c93-2167-4593-8ce2-aca0bd80651f None admin] RBAC: Authorizing `identity:get_user(user_id=b0aef2a958c640c5abb47cdd51f3f5c5)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:51.050755 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c71c93-2167-4593-8ce2-aca0bd80651f None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:51.057423 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 509/1056] 10.222.0.118 () {56 vars in 1182 bytes} [Thu Jul 14 15:24:50 2022] GET /identity/v3/users/b0aef2a958c640c5abb47cdd51f3f5c5 => generated 286 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:51.058446 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c1f0bc-a1fd-4a07-a94d-82a611db28d2 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:51.101105 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72635d0-f350-44d1-8dff-a7d262e8ee6d None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:51.101387 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72635d0-f350-44d1-8dff-a7d262e8ee6d None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:51.101805 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72635d0-f350-44d1-8dff-a7d262e8ee6d None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:51.103312 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 510/1057] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:24:51 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:24:51.109056 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1d9f49-5f94-4b7e-88b0-1c0ee1594d11 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:51.110145 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1d9f49-5f94-4b7e-88b0-1c0ee1594d11 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:51.110457 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1d9f49-5f94-4b7e-88b0-1c0ee1594d11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:51.127699 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-7e1d9f49-5f94-4b7e-88b0-1c0ee1594d11 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:51.129136 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-7e1d9f49-5f94-4b7e-88b0-1c0ee1594d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:51.166948 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c1f0bc-a1fd-4a07-a94d-82a611db28d2 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:51.184524 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:51.205542 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa51a19-12f7-493c-838d-267ec3091e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:51.206226 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa51a19-12f7-493c-838d-267ec3091e06 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:51.206508 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa51a19-12f7-493c-838d-267ec3091e06 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:51.206777 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa51a19-12f7-493c-838d-267ec3091e06 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:51.210285 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 511/1058] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:24:51 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 15:24:51.229537 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1d9f49-5f94-4b7e-88b0-1c0ee1594d11 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:51.280404 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa51a19-12f7-493c-838d-267ec3091e06 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:51.282348 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa51a19-12f7-493c-838d-267ec3091e06 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:51.320725 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:51.339905 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1d9f49-5f94-4b7e-88b0-1c0ee1594d11 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:51.394367 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d92711-6cda-43be-9b07-56fa086f2121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:51.395254 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d92711-6cda-43be-9b07-56fa086f2121 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:51.395548 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d92711-6cda-43be-9b07-56fa086f2121 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:51.395816 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d92711-6cda-43be-9b07-56fa086f2121 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:51.406130 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 548/1059] 10.222.0.118 () {58 vars in 1287 bytes} [Thu Jul 14 15:24:51 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 15:24:51.408910 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa51a19-12f7-493c-838d-267ec3091e06 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:51.413161 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d92711-6cda-43be-9b07-56fa086f2121 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:24:51.422693 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-54d92711-6cda-43be-9b07-56fa086f2121 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 15:24:51.422693 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:51.422693 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:51.422693 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:51.422693 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:51.422693 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:51.422693 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:51.422693 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:51.422693 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:51.422693 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:51.422693 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:51.422693 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:51.422693 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:24:51.422693 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:24:51.422693 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:24:51.422693 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:24:51.423736 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:24:51.423736 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:24:51.423736 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:24:51.423736 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:24:51.423736 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:51.423736 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:51.423736 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:51.423736 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:51.423736 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:51.423736 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:51.423736 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:51.423736 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:51.423736 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:51.423736 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:51.423736 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:51.423736 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:51.430712 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:51.430712 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:51.430712 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:51.430712 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:51.430712 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:24:51.430712 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:24:51.430712 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:24:51.430712 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:24:51.430712 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:24:51.430712 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:24:51.430712 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 15:24:51.430712 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:24:51.430712 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 512/1060] 10.222.0.118 () {56 vars in 1125 bytes} [Thu Jul 14 15:24:51 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:24:51.432127 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:51.432843 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d92711-6cda-43be-9b07-56fa086f2121 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:51.524640 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa51a19-12f7-493c-838d-267ec3091e06 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:51.541302 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d92711-6cda-43be-9b07-56fa086f2121 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:51.561595 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b257033-17f5-4403-9909-fbc5ed4cb0ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:51.562497 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b257033-17f5-4403-9909-fbc5ed4cb0ea None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:51.563282 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b257033-17f5-4403-9909-fbc5ed4cb0ea None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:51.563628 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b257033-17f5-4403-9909-fbc5ed4cb0ea None admin] PATH_INFO: `/v3/projects/101e0cb5f107433f8e499d953c927158` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:51.564960 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b257033-17f5-4403-9909-fbc5ed4cb0ea None admin] RBAC: Authorizing `identity:get_project(project_id=101e0cb5f107433f8e499d953c927158)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:51.566436 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b257033-17f5-4403-9909-fbc5ed4cb0ea None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:51.568477 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 549/1061] 10.222.0.118 () {56 vars in 1191 bytes} [Thu Jul 14 15:24:51 2022] GET /identity/v3/projects/101e0cb5f107433f8e499d953c927158 => generated 312 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:51.574027 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b257033-17f5-4403-9909-fbc5ed4cb0ea None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:51.583379 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1055a4d9-5967-46a5-b774-7bd867bfa3f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:51.584051 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1055a4d9-5967-46a5-b774-7bd867bfa3f7 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:51.584330 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1055a4d9-5967-46a5-b774-7bd867bfa3f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:51.584601 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1055a4d9-5967-46a5-b774-7bd867bfa3f7 None admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:51.585440 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1055a4d9-5967-46a5-b774-7bd867bfa3f7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:51.585753 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1055a4d9-5967-46a5-b774-7bd867bfa3f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:51.587162 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1055a4d9-5967-46a5-b774-7bd867bfa3f7 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:51.596348 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 513/1062] 10.222.0.118 () {56 vars in 1120 bytes} [Thu Jul 14 15:24:51 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 340 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:51.601805 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1055a4d9-5967-46a5-b774-7bd867bfa3f7 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:51.611700 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:51.666717 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:51.682602 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b257033-17f5-4403-9909-fbc5ed4cb0ea None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:51.715297 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1055a4d9-5967-46a5-b774-7bd867bfa3f7 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:51.724463 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9191eba-c03a-4c88-88c1-ac2e9e568ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:51.725122 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9191eba-c03a-4c88-88c1-ac2e9e568ad6 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:51.725404 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9191eba-c03a-4c88-88c1-ac2e9e568ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:51.725678 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9191eba-c03a-4c88-88c1-ac2e9e568ad6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:51.726559 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9191eba-c03a-4c88-88c1-ac2e9e568ad6 None admin] RBAC: Adding query filter params (role.id=3b880cef7dcf4baf87b50f8610c0c56e, scope.project.id=101e0cb5f107433f8e499d953c927158, user.id=b0aef2a958c640c5abb47cdd51f3f5c5) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:51.726873 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9191eba-c03a-4c88-88c1-ac2e9e568ad6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:51.728326 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9191eba-c03a-4c88-88c1-ac2e9e568ad6 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:51.741997 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 550/1063] 10.222.0.118 () {56 vars in 1379 bytes} [Thu Jul 14 15:24:51 2022] GET /identity/v3/role_assignments?user.id=b0aef2a958c640c5abb47cdd51f3f5c5&scope.project.id=101e0cb5f107433f8e499d953c927158&role.id=3b880cef7dcf4baf87b50f8610c0c56e => generated 260 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:51.756003 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fc97d1-dc30-413b-861c-f65e61b1210e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:51.756835 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fc97d1-dc30-413b-861c-f65e61b1210e None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:51.757112 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fc97d1-dc30-413b-861c-f65e61b1210e None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:51.757384 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fc97d1-dc30-413b-861c-f65e61b1210e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:51.771111 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fc97d1-dc30-413b-861c-f65e61b1210e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:51.772609 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fc97d1-dc30-413b-861c-f65e61b1210e None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:51.792418 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-d8fc97d1-dc30-413b-861c-f65e61b1210e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:51.792418 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:51.792418 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:51.792418 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:51.792418 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:51.792418 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:51.792418 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:51.792418 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:51.792418 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:51.792418 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:51.792418 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:51.792418 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:51.792418 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:24:51.792418 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:24:51.792418 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:24:51.793385 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:24:51.793385 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:51.793385 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:51.793385 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:51.793385 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:51.793385 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:51.793385 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:51.793385 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:51.793385 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:51.793385 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:51.793385 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:51.793385 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:51.793385 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:51.793385 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:51.793385 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:51.793385 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:51.793385 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:51.794327 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:24:51.794327 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:24:51.794327 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:51.794327 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:24:51.794327 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 514/1064] 10.222.0.118 () {56 vars in 1113 bytes} [Thu Jul 14 15:24:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:24:51.800196 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9191eba-c03a-4c88-88c1-ac2e9e568ad6 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:51.801580 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2109d039-edc9-4726-bfa2-d0692843cbd4 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:51.801879 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2109d039-edc9-4726-bfa2-d0692843cbd4 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:51.802165 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2109d039-edc9-4726-bfa2-d0692843cbd4 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:51.803606 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 515/1065] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:24:51 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 14 15:24:51.809398 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0784834-61e5-497c-be1e-8250953a6150 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:51.809680 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0784834-61e5-497c-be1e-8250953a6150 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:51.809952 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0784834-61e5-497c-be1e-8250953a6150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:51.829570 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-d0784834-61e5-497c-be1e-8250953a6150 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:51.830687 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-d0784834-61e5-497c-be1e-8250953a6150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:51.893259 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:51.912613 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 516/1066] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:24:51 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 15:24:51.918764 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9191eba-c03a-4c88-88c1-ac2e9e568ad6 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:51.935401 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0784834-61e5-497c-be1e-8250953a6150 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:51.956313 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e702b002-6239-4b78-bc62-d353dca18702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:51.957224 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702b002-6239-4b78-bc62-d353dca18702 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:51.957784 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702b002-6239-4b78-bc62-d353dca18702 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:51.958088 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702b002-6239-4b78-bc62-d353dca18702 None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:51.958807 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e702b002-6239-4b78-bc62-d353dca18702 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:51.959106 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e702b002-6239-4b78-bc62-d353dca18702 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:51.960594 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e702b002-6239-4b78-bc62-d353dca18702 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:51.978888 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 551/1067] 10.222.0.118 () {56 vars in 1114 bytes} [Thu Jul 14 15:24:51 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:51.979910 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e702b002-6239-4b78-bc62-d353dca18702 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:51.992811 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:52.050565 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0784834-61e5-497c-be1e-8250953a6150 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:52.085369 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e702b002-6239-4b78-bc62-d353dca18702 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:52.097228 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68267070-8623-4913-a2ff-05b5fbff3d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:52.097997 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68267070-8623-4913-a2ff-05b5fbff3d07 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:52.098287 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68267070-8623-4913-a2ff-05b5fbff3d07 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:52.098548 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68267070-8623-4913-a2ff-05b5fbff3d07 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:52.120685 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0d285d-1306-4a1e-8b90-21d89b963f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:52.121382 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d285d-1306-4a1e-8b90-21d89b963f2b None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:52.121651 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d285d-1306-4a1e-8b90-21d89b963f2b None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:52.121925 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d285d-1306-4a1e-8b90-21d89b963f2b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:52.130747 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0d285d-1306-4a1e-8b90-21d89b963f2b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:52.132223 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0d285d-1306-4a1e-8b90-21d89b963f2b None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:52.146612 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-bb0d285d-1306-4a1e-8b90-21d89b963f2b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 15:24:52.146612 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:52.146612 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:52.146612 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:52.146612 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:52.146612 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:52.146612 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:52.146612 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:52.146612 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:52.146612 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:52.146612 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:52.146612 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:52.146612 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 15:24:52.146612 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 15:24:52.146612 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 15:24:52.146612 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 15:24:52.147565 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:52.147565 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:52.147565 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 15:24:52.147565 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:24:52.147565 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 15:24:52.147565 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:24:52.147565 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:52.147565 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:52.147565 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:52.147565 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:52.147565 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:52.147565 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:52.147565 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:52.147565 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:52.147565 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:52.147565 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:52.147565 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:52.147565 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:52.149097 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:52.149097 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:52.149097 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 15:24:52.149097 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 15:24:52.149097 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 15:24:52.149097 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 15:24:52.149097 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 15:24:52.149097 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 15:24:52.149097 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 15:24:52.149097 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:24:52.149097 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 552/1068] 10.222.0.118 () {56 vars in 1098 bytes} [Thu Jul 14 15:24:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:52.153467 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0d285d-1306-4a1e-8b90-21d89b963f2b None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:52.166853 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:52.181736 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68267070-8623-4913-a2ff-05b5fbff3d07 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:52.183245 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68267070-8623-4913-a2ff-05b5fbff3d07 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:52.229822 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:52.264245 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0d285d-1306-4a1e-8b90-21d89b963f2b None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:52.294362 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 517/1069] 10.222.0.118 () {58 vars in 1287 bytes} [Thu Jul 14 15:24:51 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 14 15:24:52.300096 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68267070-8623-4913-a2ff-05b5fbff3d07 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:52.305340 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba965a4-8232-42f9-939b-ae9041a3f5c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:52.305991 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba965a4-8232-42f9-939b-ae9041a3f5c1 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:52.306265 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba965a4-8232-42f9-939b-ae9041a3f5c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:52.306538 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba965a4-8232-42f9-939b-ae9041a3f5c1 None admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:52.307383 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba965a4-8232-42f9-939b-ae9041a3f5c1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:52.307692 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba965a4-8232-42f9-939b-ae9041a3f5c1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:52.309119 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba965a4-8232-42f9-939b-ae9041a3f5c1 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:52.327583 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 553/1070] 10.222.0.118 () {56 vars in 1138 bytes} [Thu Jul 14 15:24:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:24:52.333626 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba965a4-8232-42f9-939b-ae9041a3f5c1 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:52.396606 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:52.411692 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68267070-8623-4913-a2ff-05b5fbff3d07 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:52.447940 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7726f40-b7be-4636-a04d-4c535fabbc71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:52.448736 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7726f40-b7be-4636-a04d-4c535fabbc71 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:52.449015 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7726f40-b7be-4636-a04d-4c535fabbc71 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:52.449292 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7726f40-b7be-4636-a04d-4c535fabbc71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:52.451402 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba965a4-8232-42f9-939b-ae9041a3f5c1 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:52.460509 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7726f40-b7be-4636-a04d-4c535fabbc71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:52.462005 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7726f40-b7be-4636-a04d-4c535fabbc71 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:52.480189 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:52.481653 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-b7726f40-b7be-4636-a04d-4c535fabbc71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:52.481653 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:52.481653 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:52.481653 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:52.481653 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:52.481653 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:52.481653 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:52.481653 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:52.481653 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:52.481653 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:52.481653 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:52.481653 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:52.481653 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:24:52.481653 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:24:52.481653 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:24:52.488598 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:24:52.488598 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:52.488598 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:52.488598 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:52.488598 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:52.488598 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:52.488598 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:52.488598 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:52.488598 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:52.488598 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:52.488598 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:52.488598 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:52.488598 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:52.488598 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:52.488598 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:52.488598 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:52.488598 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:52.489511 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:24:52.489511 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:24:52.489511 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:52.489511 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:24:52.489511 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 518/1071] 10.222.0.118 () {56 vars in 1113 bytes} [Thu Jul 14 15:24:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:24:52.489881 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7726f40-b7be-4636-a04d-4c535fabbc71 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:52.490296 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc70efca-0130-4df6-bdff-87151550a389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:52.491082 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc70efca-0130-4df6-bdff-87151550a389 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:52.491361 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc70efca-0130-4df6-bdff-87151550a389 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:52.492264 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc70efca-0130-4df6-bdff-87151550a389 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:52.505458 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc70efca-0130-4df6-bdff-87151550a389 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:52.506937 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc70efca-0130-4df6-bdff-87151550a389 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:52.526150 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-dc70efca-0130-4df6-bdff-87151550a389 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:52.526150 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:52.526150 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:52.526150 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:52.526150 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:52.526150 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:52.526150 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:52.526150 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:52.526150 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:52.526150 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:52.526150 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:52.526150 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:52.526150 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:24:52.526150 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:24:52.526150 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:24:52.527076 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:24:52.527076 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:52.527076 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:52.527076 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:52.527076 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:52.527076 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:52.527076 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:52.527076 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:52.527076 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:52.527076 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:52.527076 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:52.527076 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:52.527076 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:52.527076 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:52.527076 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:52.527076 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:52.527076 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:52.527941 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:24:52.527941 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:24:52.527941 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:52.527941 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:24:52.527941 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 554/1072] 10.222.0.118 () {56 vars in 1113 bytes} [Thu Jul 14 15:24:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:24:52.533513 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc70efca-0130-4df6-bdff-87151550a389 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:52.601353 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7726f40-b7be-4636-a04d-4c535fabbc71 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:52.638385 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1509dd-f5f2-4348-b2a4-4ee9aec0e1ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:52.639040 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc70efca-0130-4df6-bdff-87151550a389 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:52.639549 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1509dd-f5f2-4348-b2a4-4ee9aec0e1ae None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:52.639549 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1509dd-f5f2-4348-b2a4-4ee9aec0e1ae None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:52.639549 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1509dd-f5f2-4348-b2a4-4ee9aec0e1ae None admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:52.640283 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1509dd-f5f2-4348-b2a4-4ee9aec0e1ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:52.640790 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1509dd-f5f2-4348-b2a4-4ee9aec0e1ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:52.642243 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1509dd-f5f2-4348-b2a4-4ee9aec0e1ae None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:52.651000 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:52.666002 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 519/1073] 10.222.0.118 () {56 vars in 1114 bytes} [Thu Jul 14 15:24:52 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:52.692917 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5443925b-0d69-40d1-a1c8-af3dcda7f084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:52.693602 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5443925b-0d69-40d1-a1c8-af3dcda7f084 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:52.693881 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5443925b-0d69-40d1-a1c8-af3dcda7f084 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:52.694185 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5443925b-0d69-40d1-a1c8-af3dcda7f084 None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:52.694928 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5443925b-0d69-40d1-a1c8-af3dcda7f084 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:52.695231 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5443925b-0d69-40d1-a1c8-af3dcda7f084 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:52.696630 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5443925b-0d69-40d1-a1c8-af3dcda7f084 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:52.714897 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 555/1074] 10.222.0.118 () {56 vars in 1114 bytes} [Thu Jul 14 15:24:52 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:24:52.720853 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1509dd-f5f2-4348-b2a4-4ee9aec0e1ae None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:52.831547 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1509dd-f5f2-4348-b2a4-4ee9aec0e1ae None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:52.874435 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c19ef82-195a-4973-be94-ac8ba09aef2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:52.875633 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c19ef82-195a-4973-be94-ac8ba09aef2e None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:52.875633 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c19ef82-195a-4973-be94-ac8ba09aef2e None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:52.875811 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c19ef82-195a-4973-be94-ac8ba09aef2e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:52.883314 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c19ef82-195a-4973-be94-ac8ba09aef2e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:52.884777 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c19ef82-195a-4973-be94-ac8ba09aef2e None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:52.899474 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-7c19ef82-195a-4973-be94-ac8ba09aef2e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:24:52.899474 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:52.899474 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:52.899474 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:52.899474 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:52.899474 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:52.899474 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:52.899474 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:52.899474 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:52.899474 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:52.899474 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:52.899474 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:52.899474 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 15:24:52.899474 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 15:24:52.899474 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 15:24:52.900570 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 15:24:52.900570 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:52.900570 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:52.900570 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:52.900570 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:52.900570 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:52.900570 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:52.900570 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:52.900570 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:52.900570 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:52.900570 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:52.900570 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:52.900570 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:52.900570 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:52.900570 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:52.900570 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:52.900570 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:52.901818 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 15:24:52.901818 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 15:24:52.901818 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:24:52.901818 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:24:52.901818 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:24:52.901818 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:24:52.901818 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:24:52.901818 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:24:52.901818 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 520/1075] 10.222.0.118 () {56 vars in 1116 bytes} [Thu Jul 14 15:24:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:52.907602 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5443925b-0d69-40d1-a1c8-af3dcda7f084 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:52.954247 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:53.012305 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5443925b-0d69-40d1-a1c8-af3dcda7f084 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:53.044090 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e47081c-28ba-41e4-8804-b65540a2aae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:53.044736 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e47081c-28ba-41e4-8804-b65540a2aae4 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:53.045007 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e47081c-28ba-41e4-8804-b65540a2aae4 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:53.045271 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e47081c-28ba-41e4-8804-b65540a2aae4 None admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:53.046391 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e47081c-28ba-41e4-8804-b65540a2aae4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:53.046787 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e47081c-28ba-41e4-8804-b65540a2aae4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:53.049016 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e47081c-28ba-41e4-8804-b65540a2aae4 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:53.060613 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 556/1076] 10.222.0.118 () {56 vars in 1153 bytes} [Thu Jul 14 15:24:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:53.066661 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c19ef82-195a-4973-be94-ac8ba09aef2e None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:53.123949 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:53.164008 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c19ef82-195a-4973-be94-ac8ba09aef2e None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:53.201591 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd66a4a-2382-486a-a4f7-b96e222e9dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:53.202491 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd66a4a-2382-486a-a4f7-b96e222e9dde None admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:53.202766 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd66a4a-2382-486a-a4f7-b96e222e9dde None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:53.203031 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd66a4a-2382-486a-a4f7-b96e222e9dde None admin] PATH_INFO: `/v3/projects/939bf9541f4a4afe86550f749d337680/users/f0177fc696ea40069902803da09f437c/roles/395d04a64fa447d88861d9397f70322e` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:53.205759 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd66a4a-2382-486a-a4f7-b96e222e9dde None admin] RBAC: Authorizing `identity:create_grant(project_id=939bf9541f4a4afe86550f749d337680, user_id=f0177fc696ea40069902803da09f437c, role_id=395d04a64fa447d88861d9397f70322e)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:53.207224 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd66a4a-2382-486a-a4f7-b96e222e9dde None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:53.221692 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 521/1077] 10.222.0.118 () {58 vars in 1444 bytes} [Thu Jul 14 15:24:53 2022] PUT /identity/v3/projects/939bf9541f4a4afe86550f749d337680/users/f0177fc696ea40069902803da09f437c/roles/395d04a64fa447d88861d9397f70322e => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:24:53.787006 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb2d658-a36f-4c35-b9e5-ab4146dd5110 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:53.787528 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb2d658-a36f-4c35-b9e5-ab4146dd5110 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:53.787528 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb2d658-a36f-4c35-b9e5-ab4146dd5110 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:53.788931 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 557/1078] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:24:53 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:24:53.794281 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c9963-687e-440a-9db2-cbff11e4e5fb None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:53.794670 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c9963-687e-440a-9db2-cbff11e4e5fb None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:53.794928 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c9963-687e-440a-9db2-cbff11e4e5fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:53.811969 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-7c6c9963-687e-440a-9db2-cbff11e4e5fb None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:53.813197 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-7c6c9963-687e-440a-9db2-cbff11e4e5fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:53.878575 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 522/1079] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:24:53 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:24:53.901637 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb2d658-a36f-4c35-b9e5-ab4146dd5110 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:53.999508 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:54.004093 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb2d658-a36f-4c35-b9e5-ab4146dd5110 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:54.038155 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d993a6d-50da-4a64-84e8-6722d361890c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:54.038934 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d993a6d-50da-4a64-84e8-6722d361890c None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:54.039217 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d993a6d-50da-4a64-84e8-6722d361890c None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:54.039493 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d993a6d-50da-4a64-84e8-6722d361890c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:54.049342 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d993a6d-50da-4a64-84e8-6722d361890c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:24:54.058214 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-0d993a6d-50da-4a64-84e8-6722d361890c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:24:54.058214 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:54.058214 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:54.058214 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:54.058214 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:54.058214 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:54.058214 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:54.058214 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:54.058214 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:54.058214 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:54.058214 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:54.058214 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:54.058214 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:24:54.058214 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:24:54.058214 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:24:54.058214 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:24:54.059280 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:24:54.059280 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:24:54.059280 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:24:54.059280 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:24:54.059280 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:54.059280 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:54.059280 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:54.059280 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:54.059280 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:54.059280 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:54.059280 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:54.059280 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:54.059280 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:54.059280 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:54.059280 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:54.059280 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:54.060501 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:54.060501 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:54.060501 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:54.060501 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:54.060501 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:24:54.060501 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:24:54.060501 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:24:54.060501 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:24:54.060501 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:24:54.060501 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:24:54.060501 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:24:54.060501 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:24:54.060501 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 558/1080] 10.222.0.118 () {56 vars in 1101 bytes} [Thu Jul 14 15:24:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:54.065548 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6c9963-687e-440a-9db2-cbff11e4e5fb None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:54.115364 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:54.166193 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6c9963-687e-440a-9db2-cbff11e4e5fb None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:54.201248 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fee8dc-0bab-4867-8451-71db15508498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:54.201946 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fee8dc-0bab-4867-8451-71db15508498 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:54.202285 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fee8dc-0bab-4867-8451-71db15508498 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:54.202586 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fee8dc-0bab-4867-8451-71db15508498 None admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:54.203874 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fee8dc-0bab-4867-8451-71db15508498 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:54.204184 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fee8dc-0bab-4867-8451-71db15508498 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:54.205561 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fee8dc-0bab-4867-8451-71db15508498 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:54.213655 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 523/1081] 10.222.0.118 () {56 vars in 1104 bytes} [Thu Jul 14 15:24:54 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:54.220050 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d993a6d-50da-4a64-84e8-6722d361890c None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:54.323917 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d993a6d-50da-4a64-84e8-6722d361890c None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:54.357739 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cd53e7-ef30-4427-afd3-78166bbb695a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:54.358627 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cd53e7-ef30-4427-afd3-78166bbb695a None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:54.358907 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cd53e7-ef30-4427-afd3-78166bbb695a None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:54.359180 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cd53e7-ef30-4427-afd3-78166bbb695a None admin] PATH_INFO: `/v3/users/b0aef2a958c640c5abb47cdd51f3f5c5` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:54.360374 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cd53e7-ef30-4427-afd3-78166bbb695a None admin] RBAC: Authorizing `identity:get_user(user_id=b0aef2a958c640c5abb47cdd51f3f5c5)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:54.361815 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cd53e7-ef30-4427-afd3-78166bbb695a None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:54.363684 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 559/1082] 10.222.0.118 () {56 vars in 1182 bytes} [Thu Jul 14 15:24:54 2022] GET /identity/v3/users/b0aef2a958c640c5abb47cdd51f3f5c5 => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:24:54.369303 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fee8dc-0bab-4867-8451-71db15508498 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:54.468965 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fee8dc-0bab-4867-8451-71db15508498 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:54.481252 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:54.502184 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd828af-7d50-4792-bdb7-7699ee25ad1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:54.503032 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd828af-7d50-4792-bdb7-7699ee25ad1d None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:54.503308 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd828af-7d50-4792-bdb7-7699ee25ad1d None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:54.503581 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd828af-7d50-4792-bdb7-7699ee25ad1d None admin] PATH_INFO: `/v3/projects/101e0cb5f107433f8e499d953c927158` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:54.505013 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd828af-7d50-4792-bdb7-7699ee25ad1d None admin] RBAC: Authorizing `identity:get_project(project_id=101e0cb5f107433f8e499d953c927158)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:54.506518 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd828af-7d50-4792-bdb7-7699ee25ad1d None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:54.508215 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 524/1083] 10.222.0.118 () {56 vars in 1191 bytes} [Thu Jul 14 15:24:54 2022] GET /identity/v3/projects/101e0cb5f107433f8e499d953c927158 => generated 312 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:54.514117 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cd53e7-ef30-4427-afd3-78166bbb695a None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:54.542208 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:54.612318 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cd53e7-ef30-4427-afd3-78166bbb695a None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:54.644975 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e308dd-16a8-4942-81e6-be5a6ea07f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:54.645855 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e308dd-16a8-4942-81e6-be5a6ea07f28 None admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:54.646160 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e308dd-16a8-4942-81e6-be5a6ea07f28 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:54.646432 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e308dd-16a8-4942-81e6-be5a6ea07f28 None admin] PATH_INFO: `/v3/projects/101e0cb5f107433f8e499d953c927158/users/b0aef2a958c640c5abb47cdd51f3f5c5/roles/3b880cef7dcf4baf87b50f8610c0c56e` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:54.648370 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e308dd-16a8-4942-81e6-be5a6ea07f28 None admin] RBAC: Authorizing `identity:create_grant(project_id=101e0cb5f107433f8e499d953c927158, user_id=b0aef2a958c640c5abb47cdd51f3f5c5, role_id=3b880cef7dcf4baf87b50f8610c0c56e)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:54.649818 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e308dd-16a8-4942-81e6-be5a6ea07f28 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:54.668736 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 560/1084] 10.222.0.118 () {58 vars in 1444 bytes} [Thu Jul 14 15:24:54 2022] PUT /identity/v3/projects/101e0cb5f107433f8e499d953c927158/users/b0aef2a958c640c5abb47cdd51f3f5c5/roles/3b880cef7dcf4baf87b50f8610c0c56e => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:24:55.223452 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e79f802-618e-4f6c-89d7-b22cf291406e None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:55.224016 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e79f802-618e-4f6c-89d7-b22cf291406e None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:55.224016 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e79f802-618e-4f6c-89d7-b22cf291406e None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:55.225399 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 525/1085] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:24:55 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:24:55.230539 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3b9efa-7c9a-4833-8db8-e0f4455e6171 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:55.230925 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3b9efa-7c9a-4833-8db8-e0f4455e6171 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:55.231079 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3b9efa-7c9a-4833-8db8-e0f4455e6171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:55.247428 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-2a3b9efa-7c9a-4833-8db8-e0f4455e6171 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:55.248601 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-2a3b9efa-7c9a-4833-8db8-e0f4455e6171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:55.314851 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 561/1086] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:24:55 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:24:55.338463 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e79f802-618e-4f6c-89d7-b22cf291406e None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:55.441529 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e79f802-618e-4f6c-89d7-b22cf291406e None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:55.473285 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1fc908-abbf-4ea6-803f-3daa6b714820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:55.474185 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1fc908-abbf-4ea6-803f-3daa6b714820 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:55.474392 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1fc908-abbf-4ea6-803f-3daa6b714820 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:55.474666 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1fc908-abbf-4ea6-803f-3daa6b714820 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:55.485423 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1fc908-abbf-4ea6-803f-3daa6b714820 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:24:55.493515 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-1f1fc908-abbf-4ea6-803f-3daa6b714820 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 15:24:55.493515 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:55.493515 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:55.493515 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:55.493515 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:55.493515 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:55.493515 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:55.493515 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:55.493515 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:55.493515 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:55.493515 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:55.493515 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:55.493515 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:24:55.493515 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:24:55.493515 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:24:55.493515 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:24:55.494547 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:24:55.494547 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:24:55.494547 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:24:55.494547 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:24:55.494547 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:55.494547 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:55.494547 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:55.494547 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:55.494547 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:55.494547 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:55.494547 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:55.494547 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:55.494547 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:55.494547 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:55.494547 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:55.494547 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:55.495395 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:55.495395 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:55.495395 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:55.495395 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:55.495395 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:24:55.495395 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:24:55.495395 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:24:55.495395 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:24:55.495395 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:24:55.495395 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:24:55.495395 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 15:24:55.495395 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:24:55.495395 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 526/1087] 10.222.0.118 () {56 vars in 1125 bytes} [Thu Jul 14 15:24:55 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:55.501368 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3b9efa-7c9a-4833-8db8-e0f4455e6171 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:55.519832 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:55.599817 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3b9efa-7c9a-4833-8db8-e0f4455e6171 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:55.633830 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5a5afc-9175-410b-808b-49f0b0768240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:55.634528 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5a5afc-9175-410b-808b-49f0b0768240 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:55.634810 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5a5afc-9175-410b-808b-49f0b0768240 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:55.635086 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5a5afc-9175-410b-808b-49f0b0768240 None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:55.635837 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5a5afc-9175-410b-808b-49f0b0768240 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:55.636145 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5a5afc-9175-410b-808b-49f0b0768240 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:55.637516 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5a5afc-9175-410b-808b-49f0b0768240 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:55.645497 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 562/1088] 10.222.0.118 () {56 vars in 1120 bytes} [Thu Jul 14 15:24:55 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 340 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:55.651130 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1fc908-abbf-4ea6-803f-3daa6b714820 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:55.692662 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:55.756191 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1fc908-abbf-4ea6-803f-3daa6b714820 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:55.791004 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce788fd3-1719-45c5-af59-5ba322443317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:55.791795 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce788fd3-1719-45c5-af59-5ba322443317 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:55.792076 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce788fd3-1719-45c5-af59-5ba322443317 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:55.792350 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce788fd3-1719-45c5-af59-5ba322443317 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:55.802895 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce788fd3-1719-45c5-af59-5ba322443317 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:55.804348 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce788fd3-1719-45c5-af59-5ba322443317 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:55.821892 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-ce788fd3-1719-45c5-af59-5ba322443317 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:55.821892 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:55.821892 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:55.821892 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:55.821892 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:55.821892 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:55.821892 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:55.821892 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:55.821892 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:55.821892 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:55.821892 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:55.821892 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:55.821892 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:24:55.821892 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:24:55.821892 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:24:55.822948 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:24:55.822948 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:55.822948 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:55.822948 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:55.822948 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:55.822948 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:55.822948 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:55.822948 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:55.822948 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:55.822948 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:55.822948 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:55.822948 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:55.822948 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:55.822948 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:55.822948 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:55.822948 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:55.822948 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:55.823836 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:24:55.823836 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:24:55.823836 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:55.823836 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:24:55.826115 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 527/1089] 10.222.0.118 () {56 vars in 1113 bytes} [Thu Jul 14 15:24:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:55.828841 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5a5afc-9175-410b-808b-49f0b0768240 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:55.909422 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:55.928710 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5a5afc-9175-410b-808b-49f0b0768240 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:55.961905 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8940735-ff0f-4781-bdcb-829aff3b0b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:55.962583 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8940735-ff0f-4781-bdcb-829aff3b0b66 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:55.962864 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8940735-ff0f-4781-bdcb-829aff3b0b66 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:55.963138 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8940735-ff0f-4781-bdcb-829aff3b0b66 None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:55.963861 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8940735-ff0f-4781-bdcb-829aff3b0b66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:55.964168 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8940735-ff0f-4781-bdcb-829aff3b0b66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:55.965533 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8940735-ff0f-4781-bdcb-829aff3b0b66 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:55.977627 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 563/1090] 10.222.0.118 () {56 vars in 1114 bytes} [Thu Jul 14 15:24:55 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:55.983493 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce788fd3-1719-45c5-af59-5ba322443317 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:56.073535 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:56.084251 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce788fd3-1719-45c5-af59-5ba322443317 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:56.117509 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d020cf-2c6e-4c61-a8d0-737db2805516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:56.118327 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d020cf-2c6e-4c61-a8d0-737db2805516 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:56.118610 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d020cf-2c6e-4c61-a8d0-737db2805516 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:56.118884 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d020cf-2c6e-4c61-a8d0-737db2805516 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:56.126470 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d020cf-2c6e-4c61-a8d0-737db2805516 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:56.127911 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d020cf-2c6e-4c61-a8d0-737db2805516 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:56.142407 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-c9d020cf-2c6e-4c61-a8d0-737db2805516 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 15:24:56.142407 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:56.142407 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:56.142407 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:56.142407 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:56.142407 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:56.142407 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:56.142407 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:56.142407 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:56.142407 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:56.142407 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:56.142407 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:56.142407 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 15:24:56.142407 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 15:24:56.142407 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 15:24:56.142407 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 15:24:56.143371 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:56.143371 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:56.143371 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 15:24:56.143371 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:24:56.143371 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 15:24:56.143371 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:24:56.143371 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:56.143371 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:56.143371 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:56.143371 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:56.143371 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:56.143371 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:56.143371 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:56.143371 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:56.143371 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:56.143371 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:56.143371 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:56.143371 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:56.144619 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:56.144619 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:56.144619 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 15:24:56.144619 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 15:24:56.144619 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 15:24:56.144619 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 15:24:56.144619 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 15:24:56.144619 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 15:24:56.144619 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 15:24:56.144619 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:24:56.144619 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 528/1091] 10.222.0.118 () {56 vars in 1098 bytes} [Thu Jul 14 15:24:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:24:56.149392 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8940735-ff0f-4781-bdcb-829aff3b0b66 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:56.251152 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8940735-ff0f-4781-bdcb-829aff3b0b66 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:56.284623 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6553dc-37a6-4647-ab50-1366340ad0e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:56.285564 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6553dc-37a6-4647-ab50-1366340ad0e8 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:56.286297 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6553dc-37a6-4647-ab50-1366340ad0e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:56.286573 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6553dc-37a6-4647-ab50-1366340ad0e8 None admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:56.287411 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6553dc-37a6-4647-ab50-1366340ad0e8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:56.287721 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6553dc-37a6-4647-ab50-1366340ad0e8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:56.289136 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6553dc-37a6-4647-ab50-1366340ad0e8 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:56.298336 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:56.307163 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 564/1092] 10.222.0.118 () {56 vars in 1138 bytes} [Thu Jul 14 15:24:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:56.312949 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d020cf-2c6e-4c61-a8d0-737db2805516 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:56.412251 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d020cf-2c6e-4c61-a8d0-737db2805516 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:56.447708 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e60076f-a0d2-4d86-b407-6d07996faa01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:56.448354 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e60076f-a0d2-4d86-b407-6d07996faa01 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:56.448633 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e60076f-a0d2-4d86-b407-6d07996faa01 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:56.448904 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e60076f-a0d2-4d86-b407-6d07996faa01 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:56.469449 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:56.515216 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e60076f-a0d2-4d86-b407-6d07996faa01 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:56.516872 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e60076f-a0d2-4d86-b407-6d07996faa01 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:56.628123 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 529/1093] 10.222.0.118 () {58 vars in 1287 bytes} [Thu Jul 14 15:24:56 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 15:24:56.629325 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6553dc-37a6-4647-ab50-1366340ad0e8 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:56.711561 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdc122d-8858-44b5-bcd2-02ecbc0875f6 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:56.711765 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdc122d-8858-44b5-bcd2-02ecbc0875f6 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:56.712036 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdc122d-8858-44b5-bcd2-02ecbc0875f6 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:56.713407 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 530/1094] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:24:56 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 14 15:24:56.718499 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a157c9a-aa35-414a-9a1e-3f43a8d95d41 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:56.719360 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a157c9a-aa35-414a-9a1e-3f43a8d95d41 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:56.719625 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a157c9a-aa35-414a-9a1e-3f43a8d95d41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:56.732755 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6553dc-37a6-4647-ab50-1366340ad0e8 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:56.736437 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-9a157c9a-aa35-414a-9a1e-3f43a8d95d41 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:56.737634 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-9a157c9a-aa35-414a-9a1e-3f43a8d95d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:56.766610 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e401b8df-47f2-48f3-9a69-773b30231b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:56.767387 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e401b8df-47f2-48f3-9a69-773b30231b70 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:56.767660 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e401b8df-47f2-48f3-9a69-773b30231b70 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:56.767926 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e401b8df-47f2-48f3-9a69-773b30231b70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:56.777654 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e401b8df-47f2-48f3-9a69-773b30231b70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:56.779118 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e401b8df-47f2-48f3-9a69-773b30231b70 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:56.784062 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:56.796679 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-e401b8df-47f2-48f3-9a69-773b30231b70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:56.796679 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:56.796679 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:56.796679 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:56.796679 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:56.796679 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:56.796679 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:56.796679 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:56.796679 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:56.796679 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:56.796679 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:56.796679 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:56.796679 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:24:56.796679 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:24:56.796679 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:24:56.797635 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:24:56.797635 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:56.797635 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:56.797635 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:56.797635 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:56.797635 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:56.797635 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:56.797635 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:56.797635 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:56.797635 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:56.797635 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:56.797635 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:56.797635 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:56.797635 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:56.797635 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:56.797635 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:56.797635 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:56.798842 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:24:56.798842 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:24:56.798842 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:56.798842 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:24:56.798842 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 565/1095] 10.222.0.118 () {56 vars in 1113 bytes} [Thu Jul 14 15:24:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:24:56.803454 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e401b8df-47f2-48f3-9a69-773b30231b70 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:56.808837 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 531/1096] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:24:56 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 15:24:56.833138 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a157c9a-aa35-414a-9a1e-3f43a8d95d41 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:56.853407 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:56.902534 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e401b8df-47f2-48f3-9a69-773b30231b70 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:56.931832 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a157c9a-aa35-414a-9a1e-3f43a8d95d41 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:56.935339 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ca55ad-faad-4160-b966-ae13162d4d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:56.935987 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ca55ad-faad-4160-b966-ae13162d4d88 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:56.936263 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ca55ad-faad-4160-b966-ae13162d4d88 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:56.936530 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ca55ad-faad-4160-b966-ae13162d4d88 None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:56.937239 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ca55ad-faad-4160-b966-ae13162d4d88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:56.938149 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ca55ad-faad-4160-b966-ae13162d4d88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:56.939508 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ca55ad-faad-4160-b966-ae13162d4d88 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:56.950706 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 566/1097] 10.222.0.118 () {56 vars in 1114 bytes} [Thu Jul 14 15:24:56 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:24:56.956484 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ca55ad-faad-4160-b966-ae13162d4d88 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:56.967263 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabb029c-397a-4e8f-b1a0-7b092244a724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:56.967858 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb029c-397a-4e8f-b1a0-7b092244a724 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:56.968144 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb029c-397a-4e8f-b1a0-7b092244a724 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:56.968417 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb029c-397a-4e8f-b1a0-7b092244a724 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:56.978425 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabb029c-397a-4e8f-b1a0-7b092244a724 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:24:56.986523 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-dabb029c-397a-4e8f-b1a0-7b092244a724 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:24:56.986523 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:56.986523 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:56.986523 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:56.986523 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:56.986523 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:56.986523 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:56.986523 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:56.986523 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:56.986523 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:56.986523 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:56.986523 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:56.986523 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:24:56.986523 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:24:56.986523 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:24:56.986523 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:24:56.987433 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:24:56.987433 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:24:56.987433 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:24:56.987433 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:24:56.987433 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:56.987433 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:56.987433 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:56.987433 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:56.987433 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:56.987433 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:56.987433 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:56.987433 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:56.987433 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:56.987433 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:56.987433 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:56.987433 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:56.988261 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:56.988261 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:56.988261 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:56.988261 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:56.988261 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:24:56.988261 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:24:56.988261 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:24:56.988261 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:24:56.988261 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:24:56.988261 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:24:56.988261 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:24:56.988261 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:24:56.988261 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 532/1098] 10.222.0.118 () {56 vars in 1101 bytes} [Thu Jul 14 15:24:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:24:56.993628 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabb029c-397a-4e8f-b1a0-7b092244a724 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:57.036325 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:57.057215 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ca55ad-faad-4160-b966-ae13162d4d88 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:57.067894 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:57.091832 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d886b4-dfda-4e10-b973-7571920ba02f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:57.092242 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabb029c-397a-4e8f-b1a0-7b092244a724 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:57.092611 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d886b4-dfda-4e10-b973-7571920ba02f None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:57.092884 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d886b4-dfda-4e10-b973-7571920ba02f None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:57.093151 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d886b4-dfda-4e10-b973-7571920ba02f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:57.100119 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d886b4-dfda-4e10-b973-7571920ba02f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:57.101551 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d886b4-dfda-4e10-b973-7571920ba02f None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:57.115881 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-11d886b4-dfda-4e10-b973-7571920ba02f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:24:57.115881 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:57.115881 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:57.115881 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:57.115881 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:57.115881 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:57.115881 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:57.115881 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:57.115881 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:57.115881 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:57.115881 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:57.115881 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:57.115881 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 15:24:57.115881 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 15:24:57.115881 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 15:24:57.116862 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 15:24:57.116862 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:57.116862 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:57.116862 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:57.116862 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:57.116862 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:57.116862 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:57.116862 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:57.116862 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:57.116862 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:57.116862 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:57.116862 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:57.116862 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:57.116862 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:57.116862 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:57.116862 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:57.116862 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:57.117732 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 15:24:57.117732 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 15:24:57.117732 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:24:57.117732 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:24:57.117732 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:24:57.117732 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:24:57.117732 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:24:57.117732 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:24:57.117732 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 567/1099] 10.222.0.118 () {56 vars in 1116 bytes} [Thu Jul 14 15:24:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:24:57.122941 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d886b4-dfda-4e10-b973-7571920ba02f None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:57.127327 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571fcfcd-6644-4a3d-af9c-c7eea409d35d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:57.127992 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571fcfcd-6644-4a3d-af9c-c7eea409d35d None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:57.128267 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571fcfcd-6644-4a3d-af9c-c7eea409d35d None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:57.128536 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571fcfcd-6644-4a3d-af9c-c7eea409d35d None admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:57.129276 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571fcfcd-6644-4a3d-af9c-c7eea409d35d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:57.129830 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571fcfcd-6644-4a3d-af9c-c7eea409d35d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:57.131228 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571fcfcd-6644-4a3d-af9c-c7eea409d35d None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:57.140069 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 533/1100] 10.222.0.118 () {56 vars in 1104 bytes} [Thu Jul 14 15:24:56 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:24:57.145564 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571fcfcd-6644-4a3d-af9c-c7eea409d35d None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:57.222339 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d886b4-dfda-4e10-b973-7571920ba02f None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:57.242703 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571fcfcd-6644-4a3d-af9c-c7eea409d35d None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:57.244981 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:57.256921 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9343fdfb-5f54-4054-a9d3-1c42f6976e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:57.257574 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9343fdfb-5f54-4054-a9d3-1c42f6976e5a None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:57.257848 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9343fdfb-5f54-4054-a9d3-1c42f6976e5a None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:57.258151 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9343fdfb-5f54-4054-a9d3-1c42f6976e5a None admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:57.258931 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9343fdfb-5f54-4054-a9d3-1c42f6976e5a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:57.259245 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9343fdfb-5f54-4054-a9d3-1c42f6976e5a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:57.260678 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9343fdfb-5f54-4054-a9d3-1c42f6976e5a None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:57.271880 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 568/1101] 10.222.0.118 () {56 vars in 1153 bytes} [Thu Jul 14 15:24:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:24:57.277841 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9343fdfb-5f54-4054-a9d3-1c42f6976e5a None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:57.278811 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b678d4d-ba5b-433e-a9da-4a987fe277b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:57.279768 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b678d4d-ba5b-433e-a9da-4a987fe277b9 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:57.280059 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b678d4d-ba5b-433e-a9da-4a987fe277b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:57.280338 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b678d4d-ba5b-433e-a9da-4a987fe277b9 None admin] PATH_INFO: `/v3/users/b0aef2a958c640c5abb47cdd51f3f5c5` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:57.282103 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b678d4d-ba5b-433e-a9da-4a987fe277b9 None admin] RBAC: Authorizing `identity:get_user(user_id=b0aef2a958c640c5abb47cdd51f3f5c5)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:57.283550 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b678d4d-ba5b-433e-a9da-4a987fe277b9 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:57.289854 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 534/1102] 10.222.0.118 () {56 vars in 1182 bytes} [Thu Jul 14 15:24:57 2022] GET /identity/v3/users/b0aef2a958c640c5abb47cdd51f3f5c5 => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:24:57.290990 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b678d4d-ba5b-433e-a9da-4a987fe277b9 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:57.308448 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:57.377869 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9343fdfb-5f54-4054-a9d3-1c42f6976e5a None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:57.394081 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b678d4d-ba5b-433e-a9da-4a987fe277b9 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:57.414055 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a71a3f-9aec-40ae-8705-0f0b06f208b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:57.414713 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a71a3f-9aec-40ae-8705-0f0b06f208b0 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:57.415044 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a71a3f-9aec-40ae-8705-0f0b06f208b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:57.415327 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a71a3f-9aec-40ae-8705-0f0b06f208b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:57.416159 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a71a3f-9aec-40ae-8705-0f0b06f208b0 None admin] RBAC: Adding query filter params (role.id=395d04a64fa447d88861d9397f70322e, scope.project.id=939bf9541f4a4afe86550f749d337680, user.id=f0177fc696ea40069902803da09f437c) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:57.416470 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a71a3f-9aec-40ae-8705-0f0b06f208b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:57.417890 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a71a3f-9aec-40ae-8705-0f0b06f208b0 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:57.437998 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 569/1103] 10.222.0.118 () {56 vars in 1379 bytes} [Thu Jul 14 15:24:57 2022] GET /identity/v3/role_assignments?user.id=f0177fc696ea40069902803da09f437c&scope.project.id=939bf9541f4a4afe86550f749d337680&role.id=395d04a64fa447d88861d9397f70322e => generated 610 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:24:57.438278 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5db0ba-4665-4eee-8422-28f8e1a0f9c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:57.438278 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5db0ba-4665-4eee-8422-28f8e1a0f9c6 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:57.438278 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5db0ba-4665-4eee-8422-28f8e1a0f9c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:57.438278 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5db0ba-4665-4eee-8422-28f8e1a0f9c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:57.478115 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:57.506288 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5db0ba-4665-4eee-8422-28f8e1a0f9c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:57.507773 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5db0ba-4665-4eee-8422-28f8e1a0f9c6 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:57.612328 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 535/1104] 10.222.0.118 () {58 vars in 1287 bytes} [Thu Jul 14 15:24:57 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 14 15:24:57.619130 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a71a3f-9aec-40ae-8705-0f0b06f208b0 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:57.714182 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:57.722829 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a71a3f-9aec-40ae-8705-0f0b06f208b0 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:57.756833 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a70264-4796-4a83-b8cd-905b84dfb4e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:57.757631 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a70264-4796-4a83-b8cd-905b84dfb4e3 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:57.757911 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a70264-4796-4a83-b8cd-905b84dfb4e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:57.758234 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a70264-4796-4a83-b8cd-905b84dfb4e3 None admin] PATH_INFO: `/v3/projects/101e0cb5f107433f8e499d953c927158` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:57.759470 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a70264-4796-4a83-b8cd-905b84dfb4e3 None admin] RBAC: Authorizing `identity:get_project(project_id=101e0cb5f107433f8e499d953c927158)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:57.760902 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a70264-4796-4a83-b8cd-905b84dfb4e3 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:57.762748 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 570/1105] 10.222.0.118 () {56 vars in 1191 bytes} [Thu Jul 14 15:24:57 2022] GET /identity/v3/projects/101e0cb5f107433f8e499d953c927158 => generated 312 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:57.769338 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5db0ba-4665-4eee-8422-28f8e1a0f9c6 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:57.840260 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:57.878053 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5db0ba-4665-4eee-8422-28f8e1a0f9c6 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:57.916520 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffc2bae-7234-47cc-864e-7fa4276e9c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:57.917184 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffc2bae-7234-47cc-864e-7fa4276e9c86 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:57.917464 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffc2bae-7234-47cc-864e-7fa4276e9c86 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:57.917739 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffc2bae-7234-47cc-864e-7fa4276e9c86 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:57.918614 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffc2bae-7234-47cc-864e-7fa4276e9c86 None admin] RBAC: Adding query filter params (role.id=3b880cef7dcf4baf87b50f8610c0c56e, scope.project.id=101e0cb5f107433f8e499d953c927158, user.id=b0aef2a958c640c5abb47cdd51f3f5c5) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:57.918929 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffc2bae-7234-47cc-864e-7fa4276e9c86 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:57.920381 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffc2bae-7234-47cc-864e-7fa4276e9c86 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:57.926630 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 536/1106] 10.222.0.118 () {56 vars in 1379 bytes} [Thu Jul 14 15:24:57 2022] GET /identity/v3/role_assignments?user.id=b0aef2a958c640c5abb47cdd51f3f5c5&scope.project.id=101e0cb5f107433f8e499d953c927158&role.id=3b880cef7dcf4baf87b50f8610c0c56e => generated 610 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:59.976352 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115cc1c6-f1fe-485e-8c11-175ef518bb56 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:59.976914 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115cc1c6-f1fe-485e-8c11-175ef518bb56 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:59.976914 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115cc1c6-f1fe-485e-8c11-175ef518bb56 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:59.978196 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 571/1107] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:24:59 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:24:59.983429 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e72cdb4-7862-4fab-871a-784518bae370 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:59.983852 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e72cdb4-7862-4fab-871a-784518bae370 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:59.983973 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e72cdb4-7862-4fab-871a-784518bae370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:00.000321 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-8e72cdb4-7862-4fab-871a-784518bae370 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:25:00.001513 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-8e72cdb4-7862-4fab-871a-784518bae370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:25:00.066422 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 537/1108] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:24:59 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:25:00.090882 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115cc1c6-f1fe-485e-8c11-175ef518bb56 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:00.193408 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115cc1c6-f1fe-485e-8c11-175ef518bb56 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:00.226810 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b71326-6973-4e3a-aa86-fa2489176bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:00.227523 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b71326-6973-4e3a-aa86-fa2489176bd8 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:00.227804 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b71326-6973-4e3a-aa86-fa2489176bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:00.228078 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b71326-6973-4e3a-aa86-fa2489176bd8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:00.229258 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b71326-6973-4e3a-aa86-fa2489176bd8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:00.230723 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b71326-6973-4e3a-aa86-fa2489176bd8 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:00.232361 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 572/1109] 10.222.0.118 () {56 vars in 1113 bytes} [Thu Jul 14 15:25:00 2022] GET /identity/v3/domains/default => generated 200 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:00.238271 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e72cdb4-7862-4fab-871a-784518bae370 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:00.302480 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:00.336289 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e72cdb4-7862-4fab-871a-784518bae370 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:00.368844 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7023b2c7-60e2-42e4-b2a9-8e1dbc9d251c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:00.369502 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7023b2c7-60e2-42e4-b2a9-8e1dbc9d251c None admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:00.369779 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7023b2c7-60e2-42e4-b2a9-8e1dbc9d251c None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:00.370081 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7023b2c7-60e2-42e4-b2a9-8e1dbc9d251c None admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:00.370790 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7023b2c7-60e2-42e4-b2a9-8e1dbc9d251c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:00.372215 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7023b2c7-60e2-42e4-b2a9-8e1dbc9d251c None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:00.393656 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 538/1110] 10.222.0.118 () {60 vars in 1137 bytes} [Thu Jul 14 15:25:00 2022] POST /identity/v3/users => generated 287 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:25:02.432281 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71233fe3-4813-484c-bbc3-1737cb50014f None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:02.432800 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71233fe3-4813-484c-bbc3-1737cb50014f None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:02.432800 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71233fe3-4813-484c-bbc3-1737cb50014f None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:02.434240 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 573/1111] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:25:02 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:25:02.439940 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e24308-cccc-4132-a9e2-ae9698bc670d None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:02.440348 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e24308-cccc-4132-a9e2-ae9698bc670d None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:02.440488 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e24308-cccc-4132-a9e2-ae9698bc670d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:02.457432 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-82e24308-cccc-4132-a9e2-ae9698bc670d None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:25:02.458652 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-82e24308-cccc-4132-a9e2-ae9698bc670d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:25:02.523976 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 539/1112] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:25:02 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:25:02.548322 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71233fe3-4813-484c-bbc3-1737cb50014f None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:02.577594 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:02.650545 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71233fe3-4813-484c-bbc3-1737cb50014f None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:02.688242 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f4ffcf-102d-403d-8eb7-5c669efb9f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:02.689084 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f4ffcf-102d-403d-8eb7-5c669efb9f85 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:02.689356 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f4ffcf-102d-403d-8eb7-5c669efb9f85 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:02.689768 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f4ffcf-102d-403d-8eb7-5c669efb9f85 None admin] PATH_INFO: `/v3/roles/f4e85c621e6d4e749149099dd9303934` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:02.691315 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f4ffcf-102d-403d-8eb7-5c669efb9f85 None admin] RBAC: Authorizing `identity:get_role(role_id=f4e85c621e6d4e749149099dd9303934)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:02.692807 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f4ffcf-102d-403d-8eb7-5c669efb9f85 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:02.694316 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 574/1113] 10.222.0.118 () {56 vars in 1182 bytes} [Thu Jul 14 15:25:02 2022] GET /identity/v3/roles/f4e85c621e6d4e749149099dd9303934 => generated 224 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:02.700132 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e24308-cccc-4132-a9e2-ae9698bc670d None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:02.751746 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:02.798684 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e24308-cccc-4132-a9e2-ae9698bc670d None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:02.830699 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b148f8-6bda-4700-9db5-74b133354417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:02.831555 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b148f8-6bda-4700-9db5-74b133354417 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:02.831827 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b148f8-6bda-4700-9db5-74b133354417 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:02.832091 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b148f8-6bda-4700-9db5-74b133354417 None admin] PATH_INFO: `/v3/users/519060de57a049d8834bc48938e91d1d` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:02.844954 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b148f8-6bda-4700-9db5-74b133354417 None admin] RBAC: Authorizing `identity:get_user(user_id=519060de57a049d8834bc48938e91d1d)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:02.846416 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b148f8-6bda-4700-9db5-74b133354417 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:02.848049 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 540/1114] 10.222.0.118 () {56 vars in 1182 bytes} [Thu Jul 14 15:25:02 2022] GET /identity/v3/users/519060de57a049d8834bc48938e91d1d => generated 287 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:02.853758 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f4ffcf-102d-403d-8eb7-5c669efb9f85 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:02.947618 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:02.951530 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f4ffcf-102d-403d-8eb7-5c669efb9f85 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:02.984764 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21295aa-1413-4173-83b4-96d0a98355ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:02.985400 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21295aa-1413-4173-83b4-96d0a98355ff None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:02.985673 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21295aa-1413-4173-83b4-96d0a98355ff None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:02.985938 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21295aa-1413-4173-83b4-96d0a98355ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:03.050202 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21295aa-1413-4173-83b4-96d0a98355ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:03.051620 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21295aa-1413-4173-83b4-96d0a98355ff None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:03.141622 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:03.147427 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 575/1115] 10.222.0.118 () {58 vars in 1287 bytes} [Thu Jul 14 15:25:02 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 15:25:03.152220 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b148f8-6bda-4700-9db5-74b133354417 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:03.251625 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b148f8-6bda-4700-9db5-74b133354417 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:03.262134 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:03.285988 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3143f755-12e5-4697-80ff-4840768bfc33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:03.286852 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3143f755-12e5-4697-80ff-4840768bfc33 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:03.287134 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3143f755-12e5-4697-80ff-4840768bfc33 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:03.287412 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3143f755-12e5-4697-80ff-4840768bfc33 None admin] PATH_INFO: `/v3/projects/101e0cb5f107433f8e499d953c927158` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:03.288588 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3143f755-12e5-4697-80ff-4840768bfc33 None admin] RBAC: Authorizing `identity:get_project(project_id=101e0cb5f107433f8e499d953c927158)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:03.290061 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3143f755-12e5-4697-80ff-4840768bfc33 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:03.291756 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 541/1116] 10.222.0.118 () {56 vars in 1191 bytes} [Thu Jul 14 15:25:03 2022] GET /identity/v3/projects/101e0cb5f107433f8e499d953c927158 => generated 312 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:03.298530 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21295aa-1413-4173-83b4-96d0a98355ff None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:03.394167 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21295aa-1413-4173-83b4-96d0a98355ff None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:03.428390 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96f44ff-1b3d-4718-9bfe-a958f721719c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:03.429027 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f44ff-1b3d-4718-9bfe-a958f721719c None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:03.429309 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f44ff-1b3d-4718-9bfe-a958f721719c None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:03.429581 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f44ff-1b3d-4718-9bfe-a958f721719c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:03.430442 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96f44ff-1b3d-4718-9bfe-a958f721719c None admin] RBAC: Adding query filter params (role.id=f4e85c621e6d4e749149099dd9303934, scope.project.id=101e0cb5f107433f8e499d953c927158, user.id=519060de57a049d8834bc48938e91d1d) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:25:03.430756 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96f44ff-1b3d-4718-9bfe-a958f721719c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:03.432173 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96f44ff-1b3d-4718-9bfe-a958f721719c None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:03.437580 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 576/1117] 10.222.0.118 () {56 vars in 1379 bytes} [Thu Jul 14 15:25:03 2022] GET /identity/v3/role_assignments?user.id=519060de57a049d8834bc48938e91d1d&scope.project.id=101e0cb5f107433f8e499d953c927158&role.id=f4e85c621e6d4e749149099dd9303934 => generated 260 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:05.468078 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0e478b-6026-4cd9-b7f7-389bee5cb24e None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:05.468665 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0e478b-6026-4cd9-b7f7-389bee5cb24e None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:05.468665 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0e478b-6026-4cd9-b7f7-389bee5cb24e None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:05.470024 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 542/1118] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:25:05 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:25:05.475835 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2339c03d-0567-4605-bbcd-99f6faabd4f3 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:05.476249 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2339c03d-0567-4605-bbcd-99f6faabd4f3 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:05.476380 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2339c03d-0567-4605-bbcd-99f6faabd4f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:05.492612 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-2339c03d-0567-4605-bbcd-99f6faabd4f3 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:25:05.493789 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-2339c03d-0567-4605-bbcd-99f6faabd4f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:25:05.547894 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:05.558188 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 577/1119] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:25:05 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:25:05.580944 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0e478b-6026-4cd9-b7f7-389bee5cb24e None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:05.680152 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0e478b-6026-4cd9-b7f7-389bee5cb24e None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:05.713238 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a8911e-fa23-4337-9100-cc83d266ac3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:05.714117 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a8911e-fa23-4337-9100-cc83d266ac3e None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:05.714397 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a8911e-fa23-4337-9100-cc83d266ac3e None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:05.714668 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a8911e-fa23-4337-9100-cc83d266ac3e None admin] PATH_INFO: `/v3/roles/f4e85c621e6d4e749149099dd9303934` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:05.716137 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a8911e-fa23-4337-9100-cc83d266ac3e None admin] RBAC: Authorizing `identity:get_role(role_id=f4e85c621e6d4e749149099dd9303934)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:05.717508 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a8911e-fa23-4337-9100-cc83d266ac3e None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:05.719570 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 543/1120] 10.222.0.118 () {56 vars in 1182 bytes} [Thu Jul 14 15:25:05 2022] GET /identity/v3/roles/f4e85c621e6d4e749149099dd9303934 => generated 224 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:05.725474 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2339c03d-0567-4605-bbcd-99f6faabd4f3 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:05.821325 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2339c03d-0567-4605-bbcd-99f6faabd4f3 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:05.854830 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3ec931-8d8c-4459-89cc-341ae057a891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:05.855687 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3ec931-8d8c-4459-89cc-341ae057a891 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:05.855966 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3ec931-8d8c-4459-89cc-341ae057a891 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:05.856241 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3ec931-8d8c-4459-89cc-341ae057a891 None admin] PATH_INFO: `/v3/users/519060de57a049d8834bc48938e91d1d` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:05.857428 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3ec931-8d8c-4459-89cc-341ae057a891 None admin] RBAC: Authorizing `identity:get_user(user_id=519060de57a049d8834bc48938e91d1d)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:05.858914 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3ec931-8d8c-4459-89cc-341ae057a891 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:05.860539 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 578/1121] 10.222.0.118 () {56 vars in 1182 bytes} [Thu Jul 14 15:25:05 2022] GET /identity/v3/users/519060de57a049d8834bc48938e91d1d => generated 287 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:05.866496 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a8911e-fa23-4337-9100-cc83d266ac3e None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:05.917290 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:05.969121 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a8911e-fa23-4337-9100-cc83d266ac3e None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:06.001988 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4994dc68-073c-4066-9872-ae475b9cfae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:06.002783 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4994dc68-073c-4066-9872-ae475b9cfae2 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:06.003065 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4994dc68-073c-4066-9872-ae475b9cfae2 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:06.003342 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4994dc68-073c-4066-9872-ae475b9cfae2 None admin] PATH_INFO: `/v3/projects/101e0cb5f107433f8e499d953c927158` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:06.004829 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4994dc68-073c-4066-9872-ae475b9cfae2 None admin] RBAC: Authorizing `identity:get_project(project_id=101e0cb5f107433f8e499d953c927158)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:06.006295 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4994dc68-073c-4066-9872-ae475b9cfae2 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:06.007987 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 544/1122] 10.222.0.118 () {56 vars in 1191 bytes} [Thu Jul 14 15:25:05 2022] GET /identity/v3/projects/101e0cb5f107433f8e499d953c927158 => generated 312 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:06.014186 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3ec931-8d8c-4459-89cc-341ae057a891 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:06.072880 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:06.113565 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3ec931-8d8c-4459-89cc-341ae057a891 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:06.147934 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a30ca2-5bc3-4008-b0b4-0e57b118a6f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:06.148809 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a30ca2-5bc3-4008-b0b4-0e57b118a6f2 None admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:06.149087 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a30ca2-5bc3-4008-b0b4-0e57b118a6f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:06.149361 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a30ca2-5bc3-4008-b0b4-0e57b118a6f2 None admin] PATH_INFO: `/v3/projects/101e0cb5f107433f8e499d953c927158/users/519060de57a049d8834bc48938e91d1d/roles/f4e85c621e6d4e749149099dd9303934` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:06.151583 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a30ca2-5bc3-4008-b0b4-0e57b118a6f2 None admin] RBAC: Authorizing `identity:create_grant(project_id=101e0cb5f107433f8e499d953c927158, user_id=519060de57a049d8834bc48938e91d1d, role_id=f4e85c621e6d4e749149099dd9303934)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:06.153015 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a30ca2-5bc3-4008-b0b4-0e57b118a6f2 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:06.165525 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 579/1123] 10.222.0.118 () {58 vars in 1444 bytes} [Thu Jul 14 15:25:06 2022] PUT /identity/v3/projects/101e0cb5f107433f8e499d953c927158/users/519060de57a049d8834bc48938e91d1d/roles/f4e85c621e6d4e749149099dd9303934 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:25:08.208007 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73eb44c-d978-4a23-89e1-e0f2cabebd68 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:08.210434 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73eb44c-d978-4a23-89e1-e0f2cabebd68 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:08.210434 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73eb44c-d978-4a23-89e1-e0f2cabebd68 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:08.210434 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 545/1124] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:25:08 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:25:08.215264 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc4895-c8db-4955-83ed-758cf631bfca None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:08.215668 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc4895-c8db-4955-83ed-758cf631bfca None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:08.215807 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc4895-c8db-4955-83ed-758cf631bfca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:08.232556 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-ccfc4895-c8db-4955-83ed-758cf631bfca None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:25:08.234380 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-ccfc4895-c8db-4955-83ed-758cf631bfca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:25:08.298227 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 580/1125] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:25:08 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 15:25:08.321925 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73eb44c-d978-4a23-89e1-e0f2cabebd68 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:08.420636 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73eb44c-d978-4a23-89e1-e0f2cabebd68 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:08.435837 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:08.455717 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162d3447-a9fc-4c91-bdce-542a9adb04fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:08.456559 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162d3447-a9fc-4c91-bdce-542a9adb04fd None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:08.456836 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162d3447-a9fc-4c91-bdce-542a9adb04fd None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:08.457105 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162d3447-a9fc-4c91-bdce-542a9adb04fd None admin] PATH_INFO: `/v3/roles/f4e85c621e6d4e749149099dd9303934` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:08.458642 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162d3447-a9fc-4c91-bdce-542a9adb04fd None admin] RBAC: Authorizing `identity:get_role(role_id=f4e85c621e6d4e749149099dd9303934)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:08.459960 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162d3447-a9fc-4c91-bdce-542a9adb04fd None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:08.461322 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 546/1126] 10.222.0.118 () {56 vars in 1182 bytes} [Thu Jul 14 15:25:08 2022] GET /identity/v3/roles/f4e85c621e6d4e749149099dd9303934 => generated 224 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:08.467116 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfc4895-c8db-4955-83ed-758cf631bfca None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:08.516129 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:08.564710 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfc4895-c8db-4955-83ed-758cf631bfca None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:08.598134 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca3b4d1-fcdd-41aa-a554-a83ba29be687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:08.598995 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca3b4d1-fcdd-41aa-a554-a83ba29be687 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:08.599273 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca3b4d1-fcdd-41aa-a554-a83ba29be687 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:08.599546 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca3b4d1-fcdd-41aa-a554-a83ba29be687 None admin] PATH_INFO: `/v3/users/519060de57a049d8834bc48938e91d1d` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:08.600725 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca3b4d1-fcdd-41aa-a554-a83ba29be687 None admin] RBAC: Authorizing `identity:get_user(user_id=519060de57a049d8834bc48938e91d1d)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:08.602185 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca3b4d1-fcdd-41aa-a554-a83ba29be687 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:08.603807 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 581/1127] 10.222.0.118 () {56 vars in 1182 bytes} [Thu Jul 14 15:25:08 2022] GET /identity/v3/users/519060de57a049d8834bc48938e91d1d => generated 287 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:08.609532 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162d3447-a9fc-4c91-bdce-542a9adb04fd None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:08.704145 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162d3447-a9fc-4c91-bdce-542a9adb04fd None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:08.737461 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a71f8d-57a3-4460-832e-828e76a55501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:08.738145 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a71f8d-57a3-4460-832e-828e76a55501 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:08.738423 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a71f8d-57a3-4460-832e-828e76a55501 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:08.738691 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a71f8d-57a3-4460-832e-828e76a55501 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:08.785729 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:08.804866 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a71f8d-57a3-4460-832e-828e76a55501 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:08.806348 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a71f8d-57a3-4460-832e-828e76a55501 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:08.903596 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 547/1128] 10.222.0.118 () {58 vars in 1287 bytes} [Thu Jul 14 15:25:08 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 15:25:08.910040 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca3b4d1-fcdd-41aa-a554-a83ba29be687 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:09.006178 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca3b4d1-fcdd-41aa-a554-a83ba29be687 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:09.023142 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:09.040085 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972c7a44-c46c-42a2-a0d6-c80ee52d3981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:09.040937 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972c7a44-c46c-42a2-a0d6-c80ee52d3981 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:09.041215 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972c7a44-c46c-42a2-a0d6-c80ee52d3981 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:09.041485 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972c7a44-c46c-42a2-a0d6-c80ee52d3981 None admin] PATH_INFO: `/v3/projects/101e0cb5f107433f8e499d953c927158` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:09.042678 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972c7a44-c46c-42a2-a0d6-c80ee52d3981 None admin] RBAC: Authorizing `identity:get_project(project_id=101e0cb5f107433f8e499d953c927158)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:09.044115 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972c7a44-c46c-42a2-a0d6-c80ee52d3981 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:09.045822 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 582/1129] 10.222.0.118 () {56 vars in 1191 bytes} [Thu Jul 14 15:25:08 2022] GET /identity/v3/projects/101e0cb5f107433f8e499d953c927158 => generated 312 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:09.052069 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a71f8d-57a3-4460-832e-828e76a55501 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:09.129647 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:09.148269 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a71f8d-57a3-4460-832e-828e76a55501 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:09.190216 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e171b0-4d5a-4c70-80cf-8b9359d0d7e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:09.190865 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e171b0-4d5a-4c70-80cf-8b9359d0d7e3 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:09.191147 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e171b0-4d5a-4c70-80cf-8b9359d0d7e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:09.191418 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e171b0-4d5a-4c70-80cf-8b9359d0d7e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:09.192243 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e171b0-4d5a-4c70-80cf-8b9359d0d7e3 None admin] RBAC: Adding query filter params (role.id=f4e85c621e6d4e749149099dd9303934, scope.project.id=101e0cb5f107433f8e499d953c927158, user.id=519060de57a049d8834bc48938e91d1d) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:25:09.192551 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e171b0-4d5a-4c70-80cf-8b9359d0d7e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:09.193991 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e171b0-4d5a-4c70-80cf-8b9359d0d7e3 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:09.209459 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 548/1130] 10.222.0.118 () {56 vars in 1379 bytes} [Thu Jul 14 15:25:09 2022] GET /identity/v3/role_assignments?user.id=519060de57a049d8834bc48938e91d1d&scope.project.id=101e0cb5f107433f8e499d953c927158&role.id=f4e85c621e6d4e749149099dd9303934 => generated 610 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:11.228035 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f749f-657b-4571-bff1-3ae6638908ba None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:11.228606 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f749f-657b-4571-bff1-3ae6638908ba None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:11.228606 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f749f-657b-4571-bff1-3ae6638908ba None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:11.229952 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 583/1131] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:25:11 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:25:11.235617 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7170e03-6c94-4b8a-880a-6649148bd990 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:11.236052 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7170e03-6c94-4b8a-880a-6649148bd990 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:11.236184 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7170e03-6c94-4b8a-880a-6649148bd990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:11.252344 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-a7170e03-6c94-4b8a-880a-6649148bd990 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:25:11.253521 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-a7170e03-6c94-4b8a-880a-6649148bd990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:25:11.316919 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 549/1132] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:25:11 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:25:11.340229 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9f749f-657b-4571-bff1-3ae6638908ba None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:11.439902 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9f749f-657b-4571-bff1-3ae6638908ba None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:11.472297 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d4e94a-2c7f-4a5e-af35-34e8b3797df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:11.473073 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d4e94a-2c7f-4a5e-af35-34e8b3797df1 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:11.473353 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d4e94a-2c7f-4a5e-af35-34e8b3797df1 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:11.473624 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d4e94a-2c7f-4a5e-af35-34e8b3797df1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:11.474825 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d4e94a-2c7f-4a5e-af35-34e8b3797df1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:11.476253 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d4e94a-2c7f-4a5e-af35-34e8b3797df1 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:11.477869 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 584/1133] 10.222.0.118 () {56 vars in 1113 bytes} [Thu Jul 14 15:25:11 2022] GET /identity/v3/domains/default => generated 200 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:11.484472 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7170e03-6c94-4b8a-880a-6649148bd990 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:11.557302 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:11.579694 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7170e03-6c94-4b8a-880a-6649148bd990 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:11.612205 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249b8eae-3e36-482b-8c31-42f5620cc521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:11.612848 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b8eae-3e36-482b-8c31-42f5620cc521 None admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:11.613124 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b8eae-3e36-482b-8c31-42f5620cc521 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:11.613396 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b8eae-3e36-482b-8c31-42f5620cc521 None admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:11.614118 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249b8eae-3e36-482b-8c31-42f5620cc521 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:11.615544 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249b8eae-3e36-482b-8c31-42f5620cc521 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:11.640230 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 550/1134] 10.222.0.118 () {60 vars in 1146 bytes} [Thu Jul 14 15:25:11 2022] POST /identity/v3/projects => generated 312 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:25:13.694152 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52e19d0-edff-4b83-9201-6547b7e60c9b None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:13.694708 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52e19d0-edff-4b83-9201-6547b7e60c9b None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:13.694708 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52e19d0-edff-4b83-9201-6547b7e60c9b None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:13.696037 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 585/1135] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:25:13 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:25:13.701333 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cacecd-6313-4202-b3cc-52ffb9a4d9a6 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:13.701858 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cacecd-6313-4202-b3cc-52ffb9a4d9a6 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:13.702038 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cacecd-6313-4202-b3cc-52ffb9a4d9a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:13.719772 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-64cacecd-6313-4202-b3cc-52ffb9a4d9a6 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:25:13.720974 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-64cacecd-6313-4202-b3cc-52ffb9a4d9a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:25:13.787054 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 551/1136] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:25:13 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:25:13.811593 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52e19d0-edff-4b83-9201-6547b7e60c9b None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:13.867820 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:13.913466 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52e19d0-edff-4b83-9201-6547b7e60c9b None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:13.946343 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a742af9-9769-4207-b986-11f757349aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:13.947051 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a742af9-9769-4207-b986-11f757349aa5 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:13.947327 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a742af9-9769-4207-b986-11f757349aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:13.947595 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a742af9-9769-4207-b986-11f757349aa5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:13.948759 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a742af9-9769-4207-b986-11f757349aa5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:13.950327 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a742af9-9769-4207-b986-11f757349aa5 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:13.951940 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 586/1137] 10.222.0.118 () {56 vars in 1113 bytes} [Thu Jul 14 15:25:13 2022] GET /identity/v3/domains/default => generated 200 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:13.958214 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cacecd-6313-4202-b3cc-52ffb9a4d9a6 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:14.014138 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:14.055895 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cacecd-6313-4202-b3cc-52ffb9a4d9a6 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:14.088530 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820924bb-b87b-475f-ace0-16caa904e83f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:14.089192 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820924bb-b87b-475f-ace0-16caa904e83f None admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:14.089474 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820924bb-b87b-475f-ace0-16caa904e83f None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:14.089748 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820924bb-b87b-475f-ace0-16caa904e83f None admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:14.090478 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820924bb-b87b-475f-ace0-16caa904e83f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:14.091918 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820924bb-b87b-475f-ace0-16caa904e83f None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:14.112029 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 552/1138] 10.222.0.118 () {60 vars in 1137 bytes} [Thu Jul 14 15:25:13 2022] POST /identity/v3/users => generated 287 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:25:16.171508 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54821aaf-f70d-4526-8e2a-cd3d96c6e5aa None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:16.172047 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54821aaf-f70d-4526-8e2a-cd3d96c6e5aa None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:16.172047 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54821aaf-f70d-4526-8e2a-cd3d96c6e5aa None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:16.173434 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 587/1139] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:25:16 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:25:16.178513 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aabf01-cc2b-4fee-9f52-0404b54af177 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:16.178902 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aabf01-cc2b-4fee-9f52-0404b54af177 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:16.179062 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aabf01-cc2b-4fee-9f52-0404b54af177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:16.195463 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-f2aabf01-cc2b-4fee-9f52-0404b54af177 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:25:16.196638 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-f2aabf01-cc2b-4fee-9f52-0404b54af177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:25:16.261033 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 553/1140] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:25:16 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:25:16.285939 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54821aaf-f70d-4526-8e2a-cd3d96c6e5aa None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:16.384092 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54821aaf-f70d-4526-8e2a-cd3d96c6e5aa None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:16.405871 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:16.417821 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9813013-63ef-4969-a747-c9fb58f5f004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:16.418624 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9813013-63ef-4969-a747-c9fb58f5f004 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:16.418902 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9813013-63ef-4969-a747-c9fb58f5f004 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:16.419170 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9813013-63ef-4969-a747-c9fb58f5f004 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:16.429135 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9813013-63ef-4969-a747-c9fb58f5f004 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:25:16.437271 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-e9813013-63ef-4969-a747-c9fb58f5f004 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:25:16.437271 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:25:16.437271 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:25:16.437271 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:25:16.437271 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:25:16.437271 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:25:16.437271 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:25:16.437271 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:25:16.437271 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:25:16.437271 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:25:16.437271 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:25:16.437271 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:25:16.437271 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:25:16.437271 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:25:16.437271 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:25:16.437271 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:25:16.438331 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:25:16.438331 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:25:16.438331 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:25:16.438331 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:25:16.438331 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:25:16.438331 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:25:16.438331 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:25:16.438331 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:25:16.438331 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:25:16.438331 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:25:16.438331 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:25:16.438331 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:25:16.438331 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:25:16.438331 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:25:16.438331 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:25:16.438331 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:25:16.439267 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:25:16.439267 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:25:16.439267 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:25:16.439267 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:25:16.439267 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:25:16.439267 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:25:16.439267 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:25:16.439267 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:25:16.439267 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:25:16.439267 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:25:16.439267 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:25:16.439267 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:25:16.439267 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 588/1141] 10.222.0.118 () {56 vars in 1101 bytes} [Thu Jul 14 15:25:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:25:16.447744 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aabf01-cc2b-4fee-9f52-0404b54af177 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:16.492081 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:16.546764 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aabf01-cc2b-4fee-9f52-0404b54af177 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:16.579539 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c6fed9-5247-479a-9141-175906fb2283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:16.580191 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c6fed9-5247-479a-9141-175906fb2283 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:16.580477 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c6fed9-5247-479a-9141-175906fb2283 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:16.580752 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c6fed9-5247-479a-9141-175906fb2283 None admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:16.581495 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c6fed9-5247-479a-9141-175906fb2283 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:25:16.581804 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c6fed9-5247-479a-9141-175906fb2283 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:16.583205 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c6fed9-5247-479a-9141-175906fb2283 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:16.591094 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 554/1142] 10.222.0.118 () {56 vars in 1104 bytes} [Thu Jul 14 15:25:16 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:16.597334 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9813013-63ef-4969-a747-c9fb58f5f004 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:16.694940 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9813013-63ef-4969-a747-c9fb58f5f004 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:16.727703 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bde5ab1-c4c1-4a66-874f-1d3d82b93acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:16.728575 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde5ab1-c4c1-4a66-874f-1d3d82b93acb None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:16.728856 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde5ab1-c4c1-4a66-874f-1d3d82b93acb None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:16.729131 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde5ab1-c4c1-4a66-874f-1d3d82b93acb None admin] PATH_INFO: `/v3/users/38ebbcad25c249188d4cea79d7d338b3` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:16.742954 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bde5ab1-c4c1-4a66-874f-1d3d82b93acb None admin] RBAC: Authorizing `identity:get_user(user_id=38ebbcad25c249188d4cea79d7d338b3)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:16.744401 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bde5ab1-c4c1-4a66-874f-1d3d82b93acb None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:16.746091 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 589/1143] 10.222.0.118 () {56 vars in 1182 bytes} [Thu Jul 14 15:25:16 2022] GET /identity/v3/users/38ebbcad25c249188d4cea79d7d338b3 => generated 287 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:16.752017 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c6fed9-5247-479a-9141-175906fb2283 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:16.848345 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c6fed9-5247-479a-9141-175906fb2283 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:16.854937 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:16.881373 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab9abda-79a4-4d96-92fc-bb0e0fcda1a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:16.882038 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab9abda-79a4-4d96-92fc-bb0e0fcda1a4 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:16.882320 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab9abda-79a4-4d96-92fc-bb0e0fcda1a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:16.882593 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab9abda-79a4-4d96-92fc-bb0e0fcda1a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:16.947223 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab9abda-79a4-4d96-92fc-bb0e0fcda1a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:16.948605 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab9abda-79a4-4d96-92fc-bb0e0fcda1a4 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:17.043698 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 555/1144] 10.222.0.118 () {58 vars in 1287 bytes} [Thu Jul 14 15:25:16 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 15:25:17.050223 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bde5ab1-c4c1-4a66-874f-1d3d82b93acb None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:17.090563 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:17.148459 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bde5ab1-c4c1-4a66-874f-1d3d82b93acb None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:17.182270 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa70d55-977f-4aab-93ed-7f422f28cf8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:17.183119 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa70d55-977f-4aab-93ed-7f422f28cf8e None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:17.183398 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa70d55-977f-4aab-93ed-7f422f28cf8e None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:17.183671 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa70d55-977f-4aab-93ed-7f422f28cf8e None admin] PATH_INFO: `/v3/projects/7bb9e2d0f8a04232be8123c35ee9c93f` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:17.184850 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa70d55-977f-4aab-93ed-7f422f28cf8e None admin] RBAC: Authorizing `identity:get_project(project_id=7bb9e2d0f8a04232be8123c35ee9c93f)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:17.186318 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa70d55-977f-4aab-93ed-7f422f28cf8e None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:17.188020 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 590/1145] 10.222.0.118 () {56 vars in 1191 bytes} [Thu Jul 14 15:25:17 2022] GET /identity/v3/projects/7bb9e2d0f8a04232be8123c35ee9c93f => generated 312 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:17.194278 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab9abda-79a4-4d96-92fc-bb0e0fcda1a4 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:17.202233 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:17.289853 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab9abda-79a4-4d96-92fc-bb0e0fcda1a4 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:17.321925 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12bd64b-0a77-4b73-af30-a3b43e284d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:17.322593 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12bd64b-0a77-4b73-af30-a3b43e284d8f None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:17.322865 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12bd64b-0a77-4b73-af30-a3b43e284d8f None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:17.323134 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12bd64b-0a77-4b73-af30-a3b43e284d8f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:17.323944 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12bd64b-0a77-4b73-af30-a3b43e284d8f None admin] RBAC: Adding query filter params (role.id=3b880cef7dcf4baf87b50f8610c0c56e, scope.project.id=7bb9e2d0f8a04232be8123c35ee9c93f, user.id=38ebbcad25c249188d4cea79d7d338b3) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:25:17.324250 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12bd64b-0a77-4b73-af30-a3b43e284d8f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:17.325665 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12bd64b-0a77-4b73-af30-a3b43e284d8f None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:17.332472 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 556/1146] 10.222.0.118 () {56 vars in 1379 bytes} [Thu Jul 14 15:25:17 2022] GET /identity/v3/role_assignments?user.id=38ebbcad25c249188d4cea79d7d338b3&scope.project.id=7bb9e2d0f8a04232be8123c35ee9c93f&role.id=3b880cef7dcf4baf87b50f8610c0c56e => generated 260 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:19.303315 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de45cea0-77c3-47da-95a2-4c43006d324d None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:19.303849 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de45cea0-77c3-47da-95a2-4c43006d324d None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:19.303849 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de45cea0-77c3-47da-95a2-4c43006d324d None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:19.305214 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 591/1147] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:25:19 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:25:19.310726 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71bcda2-4ce2-4abe-8bd6-911a5c4fc815 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:19.311164 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71bcda2-4ce2-4abe-8bd6-911a5c4fc815 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:19.311268 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71bcda2-4ce2-4abe-8bd6-911a5c4fc815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:19.328132 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-d71bcda2-4ce2-4abe-8bd6-911a5c4fc815 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:25:19.329340 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-d71bcda2-4ce2-4abe-8bd6-911a5c4fc815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:25:19.404831 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:19.410090 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 557/1148] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:25:19 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:25:19.432739 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de45cea0-77c3-47da-95a2-4c43006d324d None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:19.529573 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de45cea0-77c3-47da-95a2-4c43006d324d None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:19.538975 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:19.564095 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc10801-2bd2-4374-863b-9f3435304044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:19.564805 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc10801-2bd2-4374-863b-9f3435304044 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:19.565080 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc10801-2bd2-4374-863b-9f3435304044 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:19.565346 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc10801-2bd2-4374-863b-9f3435304044 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:19.574993 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc10801-2bd2-4374-863b-9f3435304044 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:25:19.582375 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-3fc10801-2bd2-4374-863b-9f3435304044 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:25:19.582375 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:25:19.582375 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:25:19.582375 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:25:19.582375 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:25:19.582375 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:25:19.582375 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:25:19.582375 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:25:19.582375 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:25:19.582375 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:25:19.582375 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:25:19.582375 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:25:19.582375 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:25:19.582375 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:25:19.582375 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:25:19.582375 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:25:19.583456 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:25:19.583456 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:25:19.583456 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:25:19.583456 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:25:19.583456 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:25:19.583456 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:25:19.583456 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:25:19.583456 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:25:19.583456 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:25:19.583456 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:25:19.583456 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:25:19.583456 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:25:19.583456 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:25:19.583456 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:25:19.583456 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:25:19.583456 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:25:19.584496 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:25:19.584496 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:25:19.584496 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:25:19.584496 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:25:19.584496 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:25:19.584496 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:25:19.584496 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:25:19.584496 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:25:19.584496 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:25:19.584496 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:25:19.584496 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:25:19.584496 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:25:19.584496 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 592/1149] 10.222.0.118 () {56 vars in 1101 bytes} [Thu Jul 14 15:25:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:25:19.589590 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71bcda2-4ce2-4abe-8bd6-911a5c4fc815 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:19.684401 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71bcda2-4ce2-4abe-8bd6-911a5c4fc815 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:19.717263 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15421a5-536a-4295-8c37-a58be5e28891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:19.718504 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15421a5-536a-4295-8c37-a58be5e28891 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:19.718780 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15421a5-536a-4295-8c37-a58be5e28891 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:19.719051 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15421a5-536a-4295-8c37-a58be5e28891 None admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:19.719800 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15421a5-536a-4295-8c37-a58be5e28891 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:25:19.720108 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15421a5-536a-4295-8c37-a58be5e28891 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:19.721503 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15421a5-536a-4295-8c37-a58be5e28891 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:19.730130 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 558/1150] 10.222.0.118 () {56 vars in 1104 bytes} [Thu Jul 14 15:25:19 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:19.736760 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc10801-2bd2-4374-863b-9f3435304044 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:19.835422 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc10801-2bd2-4374-863b-9f3435304044 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:19.867841 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee1af71-fff9-406b-b76a-3819369fc420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:19.868692 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee1af71-fff9-406b-b76a-3819369fc420 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:19.868974 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee1af71-fff9-406b-b76a-3819369fc420 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:19.869250 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee1af71-fff9-406b-b76a-3819369fc420 None admin] PATH_INFO: `/v3/users/38ebbcad25c249188d4cea79d7d338b3` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:19.870554 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee1af71-fff9-406b-b76a-3819369fc420 None admin] RBAC: Authorizing `identity:get_user(user_id=38ebbcad25c249188d4cea79d7d338b3)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:19.871988 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee1af71-fff9-406b-b76a-3819369fc420 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:19.873603 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 593/1151] 10.222.0.118 () {56 vars in 1182 bytes} [Thu Jul 14 15:25:19 2022] GET /identity/v3/users/38ebbcad25c249188d4cea79d7d338b3 => generated 287 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:19.880265 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15421a5-536a-4295-8c37-a58be5e28891 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:19.939333 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:19.975486 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15421a5-536a-4295-8c37-a58be5e28891 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:20.008245 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf0b16c-6b46-46cb-8316-fe9f2e989e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:20.009088 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf0b16c-6b46-46cb-8316-fe9f2e989e29 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:20.009362 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf0b16c-6b46-46cb-8316-fe9f2e989e29 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:20.009629 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf0b16c-6b46-46cb-8316-fe9f2e989e29 None admin] PATH_INFO: `/v3/projects/7bb9e2d0f8a04232be8123c35ee9c93f` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:20.010808 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf0b16c-6b46-46cb-8316-fe9f2e989e29 None admin] RBAC: Authorizing `identity:get_project(project_id=7bb9e2d0f8a04232be8123c35ee9c93f)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:20.012233 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf0b16c-6b46-46cb-8316-fe9f2e989e29 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:20.013916 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 559/1152] 10.222.0.118 () {56 vars in 1191 bytes} [Thu Jul 14 15:25:19 2022] GET /identity/v3/projects/7bb9e2d0f8a04232be8123c35ee9c93f => generated 312 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:20.020090 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee1af71-fff9-406b-b76a-3819369fc420 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:20.055431 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:20.119487 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee1af71-fff9-406b-b76a-3819369fc420 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:20.151804 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee9f5fa-31a3-4e50-882e-1d029a966f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:20.152678 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee9f5fa-31a3-4e50-882e-1d029a966f59 None admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:20.152952 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee9f5fa-31a3-4e50-882e-1d029a966f59 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:20.153222 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee9f5fa-31a3-4e50-882e-1d029a966f59 None admin] PATH_INFO: `/v3/projects/7bb9e2d0f8a04232be8123c35ee9c93f/users/38ebbcad25c249188d4cea79d7d338b3/roles/3b880cef7dcf4baf87b50f8610c0c56e` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:20.157426 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee9f5fa-31a3-4e50-882e-1d029a966f59 None admin] RBAC: Authorizing `identity:create_grant(project_id=7bb9e2d0f8a04232be8123c35ee9c93f, user_id=38ebbcad25c249188d4cea79d7d338b3, role_id=3b880cef7dcf4baf87b50f8610c0c56e)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:20.158891 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee9f5fa-31a3-4e50-882e-1d029a966f59 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:20.171712 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 594/1153] 10.222.0.118 () {58 vars in 1444 bytes} [Thu Jul 14 15:25:20 2022] PUT /identity/v3/projects/7bb9e2d0f8a04232be8123c35ee9c93f/users/38ebbcad25c249188d4cea79d7d338b3/roles/3b880cef7dcf4baf87b50f8610c0c56e => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:25:22.181715 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f69a07-5cdd-4bdb-b20f-853384dded2e None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:22.182266 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f69a07-5cdd-4bdb-b20f-853384dded2e None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:22.182378 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f69a07-5cdd-4bdb-b20f-853384dded2e None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:22.183678 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 560/1154] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:25:22 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:25:22.188925 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf8a8a3-4659-4189-bc33-5a15c51de01b None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:22.189368 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf8a8a3-4659-4189-bc33-5a15c51de01b None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:22.189471 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf8a8a3-4659-4189-bc33-5a15c51de01b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:22.206933 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-ebf8a8a3-4659-4189-bc33-5a15c51de01b None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:25:22.208127 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-ebf8a8a3-4659-4189-bc33-5a15c51de01b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:25:22.273048 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 595/1155] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:25:22 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:25:22.296873 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f69a07-5cdd-4bdb-b20f-853384dded2e None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:22.397186 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f69a07-5cdd-4bdb-b20f-853384dded2e None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:22.424495 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:22.430287 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791dcc38-f928-4d65-adc9-dd6b2efce69f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:22.431066 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791dcc38-f928-4d65-adc9-dd6b2efce69f None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:22.431346 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791dcc38-f928-4d65-adc9-dd6b2efce69f None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:22.431619 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791dcc38-f928-4d65-adc9-dd6b2efce69f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:22.442598 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791dcc38-f928-4d65-adc9-dd6b2efce69f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:25:22.450084 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-791dcc38-f928-4d65-adc9-dd6b2efce69f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:25:22.450084 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:25:22.450084 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:25:22.450084 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:25:22.450084 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:25:22.450084 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:25:22.450084 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:25:22.450084 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:25:22.450084 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:25:22.450084 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:25:22.450084 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:25:22.450084 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:25:22.450084 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:25:22.450084 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:25:22.450084 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:25:22.450084 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:25:22.451280 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:25:22.451280 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:25:22.451280 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:25:22.451280 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:25:22.451280 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:25:22.451280 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:25:22.451280 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:25:22.451280 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:25:22.451280 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:25:22.451280 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:25:22.451280 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:25:22.451280 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:25:22.451280 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:25:22.451280 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:25:22.451280 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:25:22.451280 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:25:22.453036 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:25:22.453036 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:25:22.453036 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:25:22.453036 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:25:22.453036 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:25:22.453036 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:25:22.453036 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:25:22.453036 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:25:22.453036 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:25:22.453036 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:25:22.453036 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:25:22.453036 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:25:22.453036 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 561/1156] 10.222.0.118 () {56 vars in 1101 bytes} [Thu Jul 14 15:25:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:25:22.458958 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf8a8a3-4659-4189-bc33-5a15c51de01b None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:22.486202 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:22.561637 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf8a8a3-4659-4189-bc33-5a15c51de01b None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:22.594140 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d3cd88-e173-42f3-91b6-e69baa9b7bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:22.594800 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d3cd88-e173-42f3-91b6-e69baa9b7bbe None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:22.595078 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d3cd88-e173-42f3-91b6-e69baa9b7bbe None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:22.595349 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d3cd88-e173-42f3-91b6-e69baa9b7bbe None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:22.596087 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d3cd88-e173-42f3-91b6-e69baa9b7bbe None admin] RBAC: Adding query filter params (name=admin) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:25:22.596392 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d3cd88-e173-42f3-91b6-e69baa9b7bbe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:22.597762 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d3cd88-e173-42f3-91b6-e69baa9b7bbe None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:22.605576 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 596/1157] 10.222.0.118 () {56 vars in 1104 bytes} [Thu Jul 14 15:25:22 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:22.611384 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791dcc38-f928-4d65-adc9-dd6b2efce69f None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:22.709561 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791dcc38-f928-4d65-adc9-dd6b2efce69f None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:22.742732 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780e7f24-addf-4376-9f66-bcf87a4f9011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:22.743602 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e7f24-addf-4376-9f66-bcf87a4f9011 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:22.743883 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e7f24-addf-4376-9f66-bcf87a4f9011 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:22.744157 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e7f24-addf-4376-9f66-bcf87a4f9011 None admin] PATH_INFO: `/v3/users/38ebbcad25c249188d4cea79d7d338b3` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:22.745334 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780e7f24-addf-4376-9f66-bcf87a4f9011 None admin] RBAC: Authorizing `identity:get_user(user_id=38ebbcad25c249188d4cea79d7d338b3)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:22.746794 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780e7f24-addf-4376-9f66-bcf87a4f9011 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:22.748994 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 562/1158] 10.222.0.118 () {56 vars in 1182 bytes} [Thu Jul 14 15:25:22 2022] GET /identity/v3/users/38ebbcad25c249188d4cea79d7d338b3 => generated 287 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:22.755101 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d3cd88-e173-42f3-91b6-e69baa9b7bbe None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:22.856016 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:22.868847 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d3cd88-e173-42f3-91b6-e69baa9b7bbe None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:22.901910 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5464dbc-86a2-42ae-8989-9da17a0998cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:22.902574 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5464dbc-86a2-42ae-8989-9da17a0998cb None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:22.902847 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5464dbc-86a2-42ae-8989-9da17a0998cb None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:22.903115 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5464dbc-86a2-42ae-8989-9da17a0998cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:22.969018 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5464dbc-86a2-42ae-8989-9da17a0998cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:22.970417 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5464dbc-86a2-42ae-8989-9da17a0998cb None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:23.053451 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:23.067122 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 597/1159] 10.222.0.118 () {58 vars in 1287 bytes} [Thu Jul 14 15:25:22 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 15:25:23.073004 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780e7f24-addf-4376-9f66-bcf87a4f9011 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:23.129682 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:23.170253 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780e7f24-addf-4376-9f66-bcf87a4f9011 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:23.211212 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb173c5-26ca-43bf-b9b7-0d07982a5f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:23.212113 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb173c5-26ca-43bf-b9b7-0d07982a5f58 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:23.212381 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb173c5-26ca-43bf-b9b7-0d07982a5f58 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:23.212643 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb173c5-26ca-43bf-b9b7-0d07982a5f58 None admin] PATH_INFO: `/v3/projects/7bb9e2d0f8a04232be8123c35ee9c93f` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:23.213817 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb173c5-26ca-43bf-b9b7-0d07982a5f58 None admin] RBAC: Authorizing `identity:get_project(project_id=7bb9e2d0f8a04232be8123c35ee9c93f)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:23.215271 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb173c5-26ca-43bf-b9b7-0d07982a5f58 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:23.216962 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 563/1160] 10.222.0.118 () {56 vars in 1191 bytes} [Thu Jul 14 15:25:23 2022] GET /identity/v3/projects/7bb9e2d0f8a04232be8123c35ee9c93f => generated 312 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:23.223659 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5464dbc-86a2-42ae-8989-9da17a0998cb None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:23.320101 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5464dbc-86a2-42ae-8989-9da17a0998cb None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:23.353058 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e37651-3634-4312-9618-9eb6b08e5698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:23.353700 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e37651-3634-4312-9618-9eb6b08e5698 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:23.353990 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e37651-3634-4312-9618-9eb6b08e5698 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:23.354270 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e37651-3634-4312-9618-9eb6b08e5698 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:23.355113 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e37651-3634-4312-9618-9eb6b08e5698 None admin] RBAC: Adding query filter params (role.id=3b880cef7dcf4baf87b50f8610c0c56e, scope.project.id=7bb9e2d0f8a04232be8123c35ee9c93f, user.id=38ebbcad25c249188d4cea79d7d338b3) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:25:23.355421 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e37651-3634-4312-9618-9eb6b08e5698 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:23.356871 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e37651-3634-4312-9618-9eb6b08e5698 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:23.363222 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 598/1161] 10.222.0.118 () {56 vars in 1379 bytes} [Thu Jul 14 15:25:23 2022] GET /identity/v3/role_assignments?user.id=38ebbcad25c249188d4cea79d7d338b3&scope.project.id=7bb9e2d0f8a04232be8123c35ee9c93f&role.id=3b880cef7dcf4baf87b50f8610c0c56e => generated 610 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:25.410808 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f1746-bd5c-44eb-b860-346902e8026e None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:25.411340 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f1746-bd5c-44eb-b860-346902e8026e None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:25.411340 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f1746-bd5c-44eb-b860-346902e8026e None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:25.412726 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 564/1162] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:25:25 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:25:25.417786 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5960d13-a2d2-4a83-863c-dfb71818595b None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:25.418182 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5960d13-a2d2-4a83-863c-dfb71818595b None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:25.418363 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5960d13-a2d2-4a83-863c-dfb71818595b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:25.435379 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-b5960d13-a2d2-4a83-863c-dfb71818595b None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:25:25.436586 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-b5960d13-a2d2-4a83-863c-dfb71818595b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:25:25.481184 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:25.500827 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 599/1163] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:25:25 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:25:25.523178 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08f1746-bd5c-44eb-b860-346902e8026e None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:25.624133 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08f1746-bd5c-44eb-b860-346902e8026e None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:25.648943 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:25.658504 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e5c020-1fe0-47a0-974d-a4ff5c683bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:25.659147 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e5c020-1fe0-47a0-974d-a4ff5c683bb5 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:25.659427 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e5c020-1fe0-47a0-974d-a4ff5c683bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:25.659699 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e5c020-1fe0-47a0-974d-a4ff5c683bb5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:25.725393 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e5c020-1fe0-47a0-974d-a4ff5c683bb5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:25.726896 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e5c020-1fe0-47a0-974d-a4ff5c683bb5 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:25.821137 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 565/1164] 10.222.0.118 () {58 vars in 1287 bytes} [Thu Jul 14 15:25:25 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 15:25:25.828047 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5960d13-a2d2-4a83-863c-dfb71818595b None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:25.923858 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5960d13-a2d2-4a83-863c-dfb71818595b None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:25.957205 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab841be6-51f1-4a59-812d-d4654b8de4fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:25.958013 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab841be6-51f1-4a59-812d-d4654b8de4fa None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:25.958295 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab841be6-51f1-4a59-812d-d4654b8de4fa None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:25.958564 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab841be6-51f1-4a59-812d-d4654b8de4fa None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:25.965064 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab841be6-51f1-4a59-812d-d4654b8de4fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:25.966608 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab841be6-51f1-4a59-812d-d4654b8de4fa None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:25.980528 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-ab841be6-51f1-4a59-812d-d4654b8de4fa None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 14 15:25:25.980528 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:25:25.980528 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 14 15:25:25.980528 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 14 15:25:25.980528 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:25:25.980528 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:25:25.980528 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:25:25.980528 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:25:25.980528 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 14 15:25:25.980528 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:25:25.980528 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 15:25:25.980528 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:25:25.980528 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:25:25.980528 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:25:25.980528 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:25:25.980528 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:25:25.980528 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:25:25.981546 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:25:25.981546 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:25:25.981546 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:25:25.981546 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:25:25.981546 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:25:25.981546 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:25:25.981546 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:25:25.981546 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:25:25.981546 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:25:25.981546 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:25:25.981546 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:25:25.981546 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:25:25.981546 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:25:25.981546 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:25:25.981546 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:25:25.981546 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:25:25.982505 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:25:25.982505 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:25:25.982505 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:25:25.982505 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:25:25.982505 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:25:25.982505 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:25:25.982505 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:25:25.982505 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:25:25.982505 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:25:25.982505 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:25:25.982505 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 14 15:25:25.982505 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:25:25.982505 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 14 15:25:25.982505 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:25:25.982505 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 600/1165] 10.222.0.118 () {56 vars in 1122 bytes} [Thu Jul 14 15:25:25 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:25:25.988432 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e5c020-1fe0-47a0-974d-a4ff5c683bb5 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:26.015023 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:26.085153 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e5c020-1fe0-47a0-974d-a4ff5c683bb5 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:26.117930 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace30a2e-b6e0-4058-93e4-9ca702501672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:26.118607 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace30a2e-b6e0-4058-93e4-9ca702501672 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:26.118888 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace30a2e-b6e0-4058-93e4-9ca702501672 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:26.119159 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace30a2e-b6e0-4058-93e4-9ca702501672 None admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:26.119873 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace30a2e-b6e0-4058-93e4-9ca702501672 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:25:26.120175 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace30a2e-b6e0-4058-93e4-9ca702501672 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:26.121544 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace30a2e-b6e0-4058-93e4-9ca702501672 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:26.129423 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 566/1166] 10.222.0.118 () {56 vars in 1120 bytes} [Thu Jul 14 15:25:25 2022] GET /identity/v3/domains?name=swift_test => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:28.150073 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e804989-3b9f-48bb-b73d-9dd2b638fbed None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:28.150610 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e804989-3b9f-48bb-b73d-9dd2b638fbed None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:28.150610 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e804989-3b9f-48bb-b73d-9dd2b638fbed None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:28.152012 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 601/1167] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:25:28 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:25:28.157238 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e41a8e-393b-4fcd-b8f5-c407dcda0fdc None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:28.157640 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e41a8e-393b-4fcd-b8f5-c407dcda0fdc None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:28.157792 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e41a8e-393b-4fcd-b8f5-c407dcda0fdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:28.174875 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-56e41a8e-393b-4fcd-b8f5-c407dcda0fdc None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:25:28.176065 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-56e41a8e-393b-4fcd-b8f5-c407dcda0fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:25:28.245358 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 567/1168] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:25:28 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:25:28.268844 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e804989-3b9f-48bb-b73d-9dd2b638fbed None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:28.312624 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:28.369408 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e804989-3b9f-48bb-b73d-9dd2b638fbed None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:28.404195 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9fed8e-457a-4c67-bb31-34a3621c0cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:28.405378 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9fed8e-457a-4c67-bb31-34a3621c0cba None admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:28.405661 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9fed8e-457a-4c67-bb31-34a3621c0cba None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:28.405985 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9fed8e-457a-4c67-bb31-34a3621c0cba None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:28.407055 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9fed8e-457a-4c67-bb31-34a3621c0cba None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:28.408508 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9fed8e-457a-4c67-bb31-34a3621c0cba None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:28.423395 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 602/1169] 10.222.0.118 () {60 vars in 1143 bytes} [Thu Jul 14 15:25:28 2022] POST /identity/v3/domains => generated 268 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:25:30.497366 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29d3177-d62a-4b5a-ac1d-bb08d11617ec None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:30.497902 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29d3177-d62a-4b5a-ac1d-bb08d11617ec None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:30.497902 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29d3177-d62a-4b5a-ac1d-bb08d11617ec None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:30.499317 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 568/1170] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:25:30 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:25:30.505294 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be0c009-7b04-4346-bedd-4485839fd870 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:30.505745 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be0c009-7b04-4346-bedd-4485839fd870 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:30.505846 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be0c009-7b04-4346-bedd-4485839fd870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:30.523829 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-9be0c009-7b04-4346-bedd-4485839fd870 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:25:30.525021 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-9be0c009-7b04-4346-bedd-4485839fd870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:25:30.594506 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 603/1171] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:25:30 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:25:30.618244 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29d3177-d62a-4b5a-ac1d-bb08d11617ec None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:30.641055 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:30.718966 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29d3177-d62a-4b5a-ac1d-bb08d11617ec None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:30.752304 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a3e9a0-01b3-485f-91b8-cdf6e93c0a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:30.753081 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a3e9a0-01b3-485f-91b8-cdf6e93c0a63 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:30.753354 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a3e9a0-01b3-485f-91b8-cdf6e93c0a63 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:30.753622 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a3e9a0-01b3-485f-91b8-cdf6e93c0a63 None admin] PATH_INFO: `/v3/domains/cc374e0053a34ee4baa13f93a7d7f865` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:30.764526 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a3e9a0-01b3-485f-91b8-cdf6e93c0a63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=cc374e0053a34ee4baa13f93a7d7f865)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:30.765985 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a3e9a0-01b3-485f-91b8-cdf6e93c0a63 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:30.767599 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 569/1172] 10.222.0.118 () {56 vars in 1188 bytes} [Thu Jul 14 15:25:30 2022] GET /identity/v3/domains/cc374e0053a34ee4baa13f93a7d7f865 => generated 268 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:30.773683 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be0c009-7b04-4346-bedd-4485839fd870 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:30.802845 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:30.868439 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be0c009-7b04-4346-bedd-4485839fd870 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:30.901521 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daffdb1c-7587-426b-be55-8b96bd0843e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:30.902358 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daffdb1c-7587-426b-be55-8b96bd0843e2 None admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:30.902636 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daffdb1c-7587-426b-be55-8b96bd0843e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:30.902903 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daffdb1c-7587-426b-be55-8b96bd0843e2 None admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:30.903606 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daffdb1c-7587-426b-be55-8b96bd0843e2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:30.905118 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daffdb1c-7587-426b-be55-8b96bd0843e2 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:30.932737 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 604/1173] 10.222.0.118 () {60 vars in 1146 bytes} [Thu Jul 14 15:25:30 2022] POST /identity/v3/projects => generated 362 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:25:32.978906 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d058d5-a37c-48a6-a076-f68e4564a304 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:32.979412 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d058d5-a37c-48a6-a076-f68e4564a304 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:32.979412 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d058d5-a37c-48a6-a076-f68e4564a304 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:32.980728 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 570/1174] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:25:32 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:25:32.986482 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ada1536-c527-402d-8789-6fda796ebff7 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:32.986895 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ada1536-c527-402d-8789-6fda796ebff7 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:32.987029 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ada1536-c527-402d-8789-6fda796ebff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:33.005400 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-7ada1536-c527-402d-8789-6fda796ebff7 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:25:33.006624 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-7ada1536-c527-402d-8789-6fda796ebff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:25:33.071142 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 605/1175] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:25:32 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:25:33.096043 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d058d5-a37c-48a6-a076-f68e4564a304 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:33.175501 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:33.194749 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d058d5-a37c-48a6-a076-f68e4564a304 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:33.227208 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6139aa-02cb-4066-a5b8-1eeba0b8287d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:33.228059 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6139aa-02cb-4066-a5b8-1eeba0b8287d None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:33.228336 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6139aa-02cb-4066-a5b8-1eeba0b8287d None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:33.228607 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6139aa-02cb-4066-a5b8-1eeba0b8287d None admin] PATH_INFO: `/v3/domains/cc374e0053a34ee4baa13f93a7d7f865` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:33.229836 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6139aa-02cb-4066-a5b8-1eeba0b8287d None admin] RBAC: Authorizing `identity:get_domain(domain_id=cc374e0053a34ee4baa13f93a7d7f865)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:33.231252 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6139aa-02cb-4066-a5b8-1eeba0b8287d None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:33.233524 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 571/1176] 10.222.0.118 () {56 vars in 1188 bytes} [Thu Jul 14 15:25:33 2022] GET /identity/v3/domains/cc374e0053a34ee4baa13f93a7d7f865 => generated 268 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:33.239238 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ada1536-c527-402d-8789-6fda796ebff7 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:33.254143 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:33.336183 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ada1536-c527-402d-8789-6fda796ebff7 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:33.368712 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f75d26-d61c-4f2d-b5db-02dd04e08b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:33.369370 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f75d26-d61c-4f2d-b5db-02dd04e08b37 None admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:33.369647 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f75d26-d61c-4f2d-b5db-02dd04e08b37 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:33.369918 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f75d26-d61c-4f2d-b5db-02dd04e08b37 None admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:33.370647 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f75d26-d61c-4f2d-b5db-02dd04e08b37 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:33.372072 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f75d26-d61c-4f2d-b5db-02dd04e08b37 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:33.392447 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 606/1177] 10.222.0.118 () {60 vars in 1137 bytes} [Thu Jul 14 15:25:33 2022] POST /identity/v3/users => generated 312 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:25:35.470910 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b619de-4b04-40a9-b895-a3927dec4805 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:35.471474 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b619de-4b04-40a9-b895-a3927dec4805 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:35.471474 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b619de-4b04-40a9-b895-a3927dec4805 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:35.472818 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 572/1178] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:25:35 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:25:35.477862 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f587ce2-93b0-436e-a9d2-fedc895bf059 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:35.478342 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f587ce2-93b0-436e-a9d2-fedc895bf059 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:35.478443 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f587ce2-93b0-436e-a9d2-fedc895bf059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:35.495502 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-4f587ce2-93b0-436e-a9d2-fedc895bf059 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:25:35.496680 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-4f587ce2-93b0-436e-a9d2-fedc895bf059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:25:35.556606 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:35.561388 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 607/1179] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:25:35 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:25:35.584903 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b619de-4b04-40a9-b895-a3927dec4805 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:35.686256 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b619de-4b04-40a9-b895-a3927dec4805 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:35.720380 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e9d931-29f7-4317-92f3-30281c5b5132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:35.721225 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e9d931-29f7-4317-92f3-30281c5b5132 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:35.721455 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e9d931-29f7-4317-92f3-30281c5b5132 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:35.721726 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e9d931-29f7-4317-92f3-30281c5b5132 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:35.732228 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e9d931-29f7-4317-92f3-30281c5b5132 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:25:35.739748 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-c3e9d931-29f7-4317-92f3-30281c5b5132 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:25:35.739748 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:25:35.739748 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:25:35.739748 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:25:35.739748 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:25:35.739748 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:25:35.739748 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:25:35.739748 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:25:35.739748 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:25:35.739748 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:25:35.739748 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:25:35.739748 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:25:35.739748 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:25:35.739748 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:25:35.739748 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:25:35.739748 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:25:35.740909 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:25:35.740909 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:25:35.740909 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:25:35.740909 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:25:35.740909 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:25:35.740909 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:25:35.740909 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:25:35.740909 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:25:35.740909 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:25:35.740909 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:25:35.740909 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:25:35.740909 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:25:35.740909 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:25:35.740909 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:25:35.740909 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:25:35.740909 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:25:35.742060 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:25:35.742060 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:25:35.742060 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:25:35.742060 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:25:35.742060 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:25:35.742060 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:25:35.742060 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:25:35.742060 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:25:35.742060 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:25:35.742060 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:25:35.742060 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:25:35.742060 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:25:35.742060 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 573/1180] 10.222.0.118 () {56 vars in 1101 bytes} [Thu Jul 14 15:25:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:25:35.747020 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f587ce2-93b0-436e-a9d2-fedc895bf059 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:35.842399 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f587ce2-93b0-436e-a9d2-fedc895bf059 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:35.874835 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bde3c0f-1266-4d96-b680-ab5e215125f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:35.875486 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bde3c0f-1266-4d96-b680-ab5e215125f0 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:35.875761 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bde3c0f-1266-4d96-b680-ab5e215125f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:35.876032 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bde3c0f-1266-4d96-b680-ab5e215125f0 None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:35.876773 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bde3c0f-1266-4d96-b680-ab5e215125f0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:25:35.877078 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bde3c0f-1266-4d96-b680-ab5e215125f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:35.878488 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bde3c0f-1266-4d96-b680-ab5e215125f0 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:35.886532 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 608/1181] 10.222.0.118 () {56 vars in 1104 bytes} [Thu Jul 14 15:25:35 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:35.892854 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e9d931-29f7-4317-92f3-30281c5b5132 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:35.903365 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:35.988366 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e9d931-29f7-4317-92f3-30281c5b5132 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:36.021128 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef943ea2-c304-433b-9883-4e2f2f75882b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:36.021997 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef943ea2-c304-433b-9883-4e2f2f75882b None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:36.022277 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef943ea2-c304-433b-9883-4e2f2f75882b None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:36.022545 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef943ea2-c304-433b-9883-4e2f2f75882b None admin] PATH_INFO: `/v3/users/1f0528ad5fe141f6be05cf4c2914f456` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:36.034917 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef943ea2-c304-433b-9883-4e2f2f75882b None admin] RBAC: Authorizing `identity:get_user(user_id=1f0528ad5fe141f6be05cf4c2914f456)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:36.036348 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef943ea2-c304-433b-9883-4e2f2f75882b None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:36.037990 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 574/1182] 10.222.0.118 () {56 vars in 1182 bytes} [Thu Jul 14 15:25:35 2022] GET /identity/v3/users/1f0528ad5fe141f6be05cf4c2914f456 => generated 312 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:36.043688 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bde3c0f-1266-4d96-b680-ab5e215125f0 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:36.103886 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:36.143411 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bde3c0f-1266-4d96-b680-ab5e215125f0 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:36.175244 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5954ce-573f-4aa9-bd73-1f84060a72ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:36.175875 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5954ce-573f-4aa9-bd73-1f84060a72ec None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:36.176159 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5954ce-573f-4aa9-bd73-1f84060a72ec None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:36.176433 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5954ce-573f-4aa9-bd73-1f84060a72ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:36.241244 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5954ce-573f-4aa9-bd73-1f84060a72ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:36.242651 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5954ce-573f-4aa9-bd73-1f84060a72ec None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:36.300901 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:36.341223 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 609/1183] 10.222.0.118 () {58 vars in 1287 bytes} [Thu Jul 14 15:25:36 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 15:25:36.347685 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef943ea2-c304-433b-9883-4e2f2f75882b None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:36.411811 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:36.446506 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef943ea2-c304-433b-9883-4e2f2f75882b None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:36.490549 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8dc9f4-3b71-44e9-9a1b-ffc6361d3daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:36.492064 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8dc9f4-3b71-44e9-9a1b-ffc6361d3daf None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:36.492526 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8dc9f4-3b71-44e9-9a1b-ffc6361d3daf None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:36.493013 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8dc9f4-3b71-44e9-9a1b-ffc6361d3daf None admin] PATH_INFO: `/v3/projects/2c1696f111094a63b7c15ef05648f220` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:36.495106 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8dc9f4-3b71-44e9-9a1b-ffc6361d3daf None admin] RBAC: Authorizing `identity:get_project(project_id=2c1696f111094a63b7c15ef05648f220)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:36.498611 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8dc9f4-3b71-44e9-9a1b-ffc6361d3daf None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:36.501597 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 575/1184] 10.222.0.118 () {56 vars in 1191 bytes} [Thu Jul 14 15:25:36 2022] GET /identity/v3/projects/2c1696f111094a63b7c15ef05648f220 => generated 362 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:36.507957 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5954ce-573f-4aa9-bd73-1f84060a72ec None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:36.603930 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5954ce-573f-4aa9-bd73-1f84060a72ec None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:36.637776 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d3f22f-f0f6-4ec5-9c98-c6de86839b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:36.638478 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d3f22f-f0f6-4ec5-9c98-c6de86839b8e None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:36.638753 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d3f22f-f0f6-4ec5-9c98-c6de86839b8e None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:36.639022 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d3f22f-f0f6-4ec5-9c98-c6de86839b8e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:36.639850 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d3f22f-f0f6-4ec5-9c98-c6de86839b8e None admin] RBAC: Adding query filter params (role.id=3b880cef7dcf4baf87b50f8610c0c56e, scope.project.id=2c1696f111094a63b7c15ef05648f220, user.id=1f0528ad5fe141f6be05cf4c2914f456) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:25:36.640160 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d3f22f-f0f6-4ec5-9c98-c6de86839b8e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:36.641569 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d3f22f-f0f6-4ec5-9c98-c6de86839b8e None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:36.646913 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 610/1185] 10.222.0.118 () {56 vars in 1379 bytes} [Thu Jul 14 15:25:36 2022] GET /identity/v3/role_assignments?user.id=1f0528ad5fe141f6be05cf4c2914f456&scope.project.id=2c1696f111094a63b7c15ef05648f220&role.id=3b880cef7dcf4baf87b50f8610c0c56e => generated 260 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:38.662682 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c52bdf-09e0-4571-ad08-ec1198d54bee None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:38.663251 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c52bdf-09e0-4571-ad08-ec1198d54bee None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:38.663251 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c52bdf-09e0-4571-ad08-ec1198d54bee None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:38.664596 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 576/1186] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:25:38 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:25:38.670569 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd6c96f-0736-4c77-8d4f-a46c493afa7e None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:38.670985 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd6c96f-0736-4c77-8d4f-a46c493afa7e None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:38.671169 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd6c96f-0736-4c77-8d4f-a46c493afa7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:38.687968 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-6cd6c96f-0736-4c77-8d4f-a46c493afa7e None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:25:38.689139 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-6cd6c96f-0736-4c77-8d4f-a46c493afa7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:25:38.710643 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:38.762947 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 611/1187] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:25:38 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:25:38.787727 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c52bdf-09e0-4571-ad08-ec1198d54bee None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:38.886179 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c52bdf-09e0-4571-ad08-ec1198d54bee None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:38.918930 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113ee078-2a49-4cda-b6b7-8a18788f9420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:38.920226 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ee078-2a49-4cda-b6b7-8a18788f9420 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:38.920506 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ee078-2a49-4cda-b6b7-8a18788f9420 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:38.920778 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ee078-2a49-4cda-b6b7-8a18788f9420 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:38.922622 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:38.931491 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113ee078-2a49-4cda-b6b7-8a18788f9420 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:25:38.938958 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-113ee078-2a49-4cda-b6b7-8a18788f9420 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:25:38.938958 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:25:38.938958 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:25:38.938958 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:25:38.938958 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:25:38.938958 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:25:38.938958 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:25:38.938958 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:25:38.938958 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:25:38.938958 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:25:38.938958 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:25:38.938958 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:25:38.938958 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:25:38.938958 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:25:38.938958 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:25:38.938958 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:25:38.940035 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:25:38.940035 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:25:38.940035 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:25:38.940035 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:25:38.940035 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:25:38.940035 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:25:38.940035 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:25:38.940035 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:25:38.940035 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:25:38.940035 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:25:38.940035 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:25:38.940035 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:25:38.940035 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:25:38.940035 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:25:38.940035 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:25:38.940035 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:25:38.941044 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:25:38.941044 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:25:38.941044 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:25:38.941044 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:25:38.941044 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:25:38.941044 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:25:38.941044 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:25:38.941044 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:25:38.941044 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:25:38.941044 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:25:38.941044 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:25:38.941044 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:25:38.941044 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 577/1188] 10.222.0.118 () {56 vars in 1101 bytes} [Thu Jul 14 15:25:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:25:38.946313 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd6c96f-0736-4c77-8d4f-a46c493afa7e None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:39.042524 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd6c96f-0736-4c77-8d4f-a46c493afa7e None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:39.083580 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59a4596-8bc3-4ab0-bc6b-cb8d9d76644d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:39.084236 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59a4596-8bc3-4ab0-bc6b-cb8d9d76644d None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:39.084513 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59a4596-8bc3-4ab0-bc6b-cb8d9d76644d None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:39.084779 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59a4596-8bc3-4ab0-bc6b-cb8d9d76644d None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:39.085515 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59a4596-8bc3-4ab0-bc6b-cb8d9d76644d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:25:39.085814 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59a4596-8bc3-4ab0-bc6b-cb8d9d76644d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:39.087209 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59a4596-8bc3-4ab0-bc6b-cb8d9d76644d None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:39.095667 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 612/1189] 10.222.0.118 () {56 vars in 1104 bytes} [Thu Jul 14 15:25:38 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:39.101528 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113ee078-2a49-4cda-b6b7-8a18788f9420 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:39.199949 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113ee078-2a49-4cda-b6b7-8a18788f9420 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:39.231656 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7296d44-1e46-46e5-ae66-2caf6400e9c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:39.233106 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7296d44-1e46-46e5-ae66-2caf6400e9c4 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:39.233376 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7296d44-1e46-46e5-ae66-2caf6400e9c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:39.233640 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7296d44-1e46-46e5-ae66-2caf6400e9c4 None admin] PATH_INFO: `/v3/users/1f0528ad5fe141f6be05cf4c2914f456` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:39.234842 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7296d44-1e46-46e5-ae66-2caf6400e9c4 None admin] RBAC: Authorizing `identity:get_user(user_id=1f0528ad5fe141f6be05cf4c2914f456)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:39.236267 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7296d44-1e46-46e5-ae66-2caf6400e9c4 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:39.237878 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 578/1190] 10.222.0.118 () {56 vars in 1182 bytes} [Thu Jul 14 15:25:39 2022] GET /identity/v3/users/1f0528ad5fe141f6be05cf4c2914f456 => generated 312 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:39.243826 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59a4596-8bc3-4ab0-bc6b-cb8d9d76644d None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:39.262713 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:39.340267 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59a4596-8bc3-4ab0-bc6b-cb8d9d76644d None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:39.372559 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f4774a-e51a-40a8-85cd-6af688983324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:39.373438 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f4774a-e51a-40a8-85cd-6af688983324 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:39.373713 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f4774a-e51a-40a8-85cd-6af688983324 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:39.374002 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f4774a-e51a-40a8-85cd-6af688983324 None admin] PATH_INFO: `/v3/projects/2c1696f111094a63b7c15ef05648f220` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:39.375155 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f4774a-e51a-40a8-85cd-6af688983324 None admin] RBAC: Authorizing `identity:get_project(project_id=2c1696f111094a63b7c15ef05648f220)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:39.376573 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f4774a-e51a-40a8-85cd-6af688983324 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:39.378305 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 613/1191] 10.222.0.118 () {56 vars in 1191 bytes} [Thu Jul 14 15:25:39 2022] GET /identity/v3/projects/2c1696f111094a63b7c15ef05648f220 => generated 362 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:39.384622 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7296d44-1e46-46e5-ae66-2caf6400e9c4 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:39.451358 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:39.491091 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7296d44-1e46-46e5-ae66-2caf6400e9c4 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:39.524776 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5f743b-08fd-4956-a4a7-bcabb4459414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:39.525655 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5f743b-08fd-4956-a4a7-bcabb4459414 None admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:39.525931 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5f743b-08fd-4956-a4a7-bcabb4459414 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:39.526231 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5f743b-08fd-4956-a4a7-bcabb4459414 None admin] PATH_INFO: `/v3/projects/2c1696f111094a63b7c15ef05648f220/users/1f0528ad5fe141f6be05cf4c2914f456/roles/3b880cef7dcf4baf87b50f8610c0c56e` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:39.528156 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5f743b-08fd-4956-a4a7-bcabb4459414 None admin] RBAC: Authorizing `identity:create_grant(project_id=2c1696f111094a63b7c15ef05648f220, user_id=1f0528ad5fe141f6be05cf4c2914f456, role_id=3b880cef7dcf4baf87b50f8610c0c56e)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:39.529573 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5f743b-08fd-4956-a4a7-bcabb4459414 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:39.542082 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 579/1192] 10.222.0.118 () {58 vars in 1444 bytes} [Thu Jul 14 15:25:39 2022] PUT /identity/v3/projects/2c1696f111094a63b7c15ef05648f220/users/1f0528ad5fe141f6be05cf4c2914f456/roles/3b880cef7dcf4baf87b50f8610c0c56e => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:25:41.540832 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97da467b-571f-4a03-8b73-10b61caf5b40 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:41.541364 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97da467b-571f-4a03-8b73-10b61caf5b40 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:41.541364 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97da467b-571f-4a03-8b73-10b61caf5b40 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:41.542794 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 614/1193] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:25:41 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:25:41.548521 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c824b2a2-1d95-4f1f-8643-f52d649a851c None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:41.548975 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c824b2a2-1d95-4f1f-8643-f52d649a851c None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:41.549113 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c824b2a2-1d95-4f1f-8643-f52d649a851c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:41.567207 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-c824b2a2-1d95-4f1f-8643-f52d649a851c None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:25:41.568399 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-c824b2a2-1d95-4f1f-8643-f52d649a851c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:25:41.632345 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 580/1194] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:25:41 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:25:41.655386 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97da467b-571f-4a03-8b73-10b61caf5b40 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:41.740291 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:41.756483 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97da467b-571f-4a03-8b73-10b61caf5b40 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:41.789478 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc63df1-fffb-4d31-a4a6-54abfeb3f130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:41.790288 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc63df1-fffb-4d31-a4a6-54abfeb3f130 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:41.790561 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc63df1-fffb-4d31-a4a6-54abfeb3f130 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:41.790886 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc63df1-fffb-4d31-a4a6-54abfeb3f130 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:41.801084 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc63df1-fffb-4d31-a4a6-54abfeb3f130 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:25:41.808455 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-0fc63df1-fffb-4d31-a4a6-54abfeb3f130 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:25:41.808455 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:25:41.808455 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:25:41.808455 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:25:41.808455 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:25:41.808455 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:25:41.808455 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:25:41.808455 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:25:41.808455 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:25:41.808455 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:25:41.808455 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:25:41.808455 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:25:41.808455 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:25:41.808455 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:25:41.808455 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:25:41.808455 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:25:41.809664 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:25:41.809664 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:25:41.809664 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:25:41.809664 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:25:41.809664 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:25:41.809664 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:25:41.809664 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:25:41.809664 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:25:41.809664 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:25:41.809664 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:25:41.809664 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:25:41.809664 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:25:41.809664 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:25:41.809664 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:25:41.809664 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:25:41.809664 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:25:41.810977 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:25:41.810977 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:25:41.810977 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:25:41.810977 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:25:41.810977 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:25:41.810977 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:25:41.810977 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:25:41.810977 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:25:41.810977 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:25:41.810977 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:25:41.810977 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:25:41.810977 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:25:41.810977 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 615/1195] 10.222.0.118 () {56 vars in 1101 bytes} [Thu Jul 14 15:25:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:25:41.815873 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c824b2a2-1d95-4f1f-8643-f52d649a851c None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:41.868810 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:41.915461 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c824b2a2-1d95-4f1f-8643-f52d649a851c None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:41.948420 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc8cd39-837a-4262-9940-f4e30d32c10b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:41.949079 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc8cd39-837a-4262-9940-f4e30d32c10b None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:41.949360 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc8cd39-837a-4262-9940-f4e30d32c10b None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:41.949634 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc8cd39-837a-4262-9940-f4e30d32c10b None admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:41.950411 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc8cd39-837a-4262-9940-f4e30d32c10b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:25:41.951281 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc8cd39-837a-4262-9940-f4e30d32c10b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:41.952664 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc8cd39-837a-4262-9940-f4e30d32c10b None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:41.960500 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 581/1196] 10.222.0.118 () {56 vars in 1104 bytes} [Thu Jul 14 15:25:41 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:41.966456 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc63df1-fffb-4d31-a4a6-54abfeb3f130 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:42.066483 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc63df1-fffb-4d31-a4a6-54abfeb3f130 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:42.102765 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ac00a7-641d-44bd-9f6a-8630a2fa92cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:42.103621 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ac00a7-641d-44bd-9f6a-8630a2fa92cd None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:42.103902 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ac00a7-641d-44bd-9f6a-8630a2fa92cd None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:42.104171 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ac00a7-641d-44bd-9f6a-8630a2fa92cd None admin] PATH_INFO: `/v3/users/1f0528ad5fe141f6be05cf4c2914f456` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:42.105349 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ac00a7-641d-44bd-9f6a-8630a2fa92cd None admin] RBAC: Authorizing `identity:get_user(user_id=1f0528ad5fe141f6be05cf4c2914f456)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:42.106818 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ac00a7-641d-44bd-9f6a-8630a2fa92cd None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:42.108511 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 616/1197] 10.222.0.118 () {56 vars in 1182 bytes} [Thu Jul 14 15:25:41 2022] GET /identity/v3/users/1f0528ad5fe141f6be05cf4c2914f456 => generated 312 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:42.114288 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc8cd39-837a-4262-9940-f4e30d32c10b None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:42.212303 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc8cd39-837a-4262-9940-f4e30d32c10b None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:42.225133 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:42.244373 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8356a8e7-faa5-442a-8b2d-b5768c243388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:42.245078 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8356a8e7-faa5-442a-8b2d-b5768c243388 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:42.245292 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8356a8e7-faa5-442a-8b2d-b5768c243388 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:42.245564 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8356a8e7-faa5-442a-8b2d-b5768c243388 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:42.311471 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8356a8e7-faa5-442a-8b2d-b5768c243388 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:42.312919 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8356a8e7-faa5-442a-8b2d-b5768c243388 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:42.408834 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 582/1198] 10.222.0.118 () {58 vars in 1287 bytes} [Thu Jul 14 15:25:42 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 15:25:42.414752 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ac00a7-641d-44bd-9f6a-8630a2fa92cd None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:42.431223 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:42.513860 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ac00a7-641d-44bd-9f6a-8630a2fa92cd None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:42.547923 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437c21fb-4a74-4cfc-99e8-eb50b99e5cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:42.548773 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437c21fb-4a74-4cfc-99e8-eb50b99e5cb0 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:42.549054 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437c21fb-4a74-4cfc-99e8-eb50b99e5cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:42.549326 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437c21fb-4a74-4cfc-99e8-eb50b99e5cb0 None admin] PATH_INFO: `/v3/projects/2c1696f111094a63b7c15ef05648f220` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:42.550536 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437c21fb-4a74-4cfc-99e8-eb50b99e5cb0 None admin] RBAC: Authorizing `identity:get_project(project_id=2c1696f111094a63b7c15ef05648f220)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:42.551977 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437c21fb-4a74-4cfc-99e8-eb50b99e5cb0 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:42.553678 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 617/1199] 10.222.0.118 () {56 vars in 1191 bytes} [Thu Jul 14 15:25:42 2022] GET /identity/v3/projects/2c1696f111094a63b7c15ef05648f220 => generated 362 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:42.560820 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8356a8e7-faa5-442a-8b2d-b5768c243388 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:42.575529 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:42.659528 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8356a8e7-faa5-442a-8b2d-b5768c243388 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:42.693173 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059d08ed-20e8-4e3b-b55c-c5d13dd815ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:42.693817 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059d08ed-20e8-4e3b-b55c-c5d13dd815ca None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:42.694130 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059d08ed-20e8-4e3b-b55c-c5d13dd815ca None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:42.694406 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059d08ed-20e8-4e3b-b55c-c5d13dd815ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:42.695228 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059d08ed-20e8-4e3b-b55c-c5d13dd815ca None admin] RBAC: Adding query filter params (role.id=3b880cef7dcf4baf87b50f8610c0c56e, scope.project.id=2c1696f111094a63b7c15ef05648f220, user.id=1f0528ad5fe141f6be05cf4c2914f456) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:25:42.695536 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059d08ed-20e8-4e3b-b55c-c5d13dd815ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:42.696986 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059d08ed-20e8-4e3b-b55c-c5d13dd815ca None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:42.702948 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 583/1200] 10.222.0.118 () {56 vars in 1379 bytes} [Thu Jul 14 15:25:42 2022] GET /identity/v3/role_assignments?user.id=1f0528ad5fe141f6be05cf4c2914f456&scope.project.id=2c1696f111094a63b7c15ef05648f220&role.id=3b880cef7dcf4baf87b50f8610c0c56e => generated 610 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:52.542890 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=59 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:52.700098 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=61 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:38.216462 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35085b23-55d6-47f9-8a66-dd221bdb92b1 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:38.217106 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35085b23-55d6-47f9-8a66-dd221bdb92b1 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:38.217106 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35085b23-55d6-47f9-8a66-dd221bdb92b1 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:38.218545 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 618/1201] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:26:38 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:26:38.224645 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344ba099-972f-4f37-b097-5459b0d39317 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:38.225144 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344ba099-972f-4f37-b097-5459b0d39317 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:38.225234 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344ba099-972f-4f37-b097-5459b0d39317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:38.245163 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-344ba099-972f-4f37-b097-5459b0d39317 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:26:38.246566 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-344ba099-972f-4f37-b097-5459b0d39317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:26:38.350117 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 584/1202] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:26:38 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:26:38.377182 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35085b23-55d6-47f9-8a66-dd221bdb92b1 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:38.534629 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35085b23-55d6-47f9-8a66-dd221bdb92b1 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:38.579713 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15153ff0-8b6d-4bf7-b6f7-90924532b021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:38.580537 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15153ff0-8b6d-4bf7-b6f7-90924532b021 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:38.580819 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15153ff0-8b6d-4bf7-b6f7-90924532b021 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:38.581142 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15153ff0-8b6d-4bf7-b6f7-90924532b021 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:38.605943 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15153ff0-8b6d-4bf7-b6f7-90924532b021 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:38.607844 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15153ff0-8b6d-4bf7-b6f7-90924532b021 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:38.629197 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-15153ff0-8b6d-4bf7-b6f7-90924532b021 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:26:38.629197 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:26:38.629197 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:26:38.629197 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:26:38.629197 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:26:38.629197 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:26:38.629197 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:26:38.629197 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:26:38.629197 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:26:38.629197 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:26:38.629197 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:26:38.629197 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:26:38.629197 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:26:38.629197 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:26:38.629197 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:26:38.630413 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:26:38.630413 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:26:38.630413 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:26:38.630413 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:26:38.630413 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:26:38.630413 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:26:38.630413 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:26:38.630413 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:26:38.630413 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:26:38.630413 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:26:38.630413 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:26:38.630413 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:26:38.630413 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:26:38.630413 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:26:38.630413 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:26:38.630413 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:26:38.630413 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:26:38.635654 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:26:38.635654 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:26:38.635654 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:26:38.635654 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:26:38.635654 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 619/1203] 10.222.0.118 () {56 vars in 1113 bytes} [Thu Jul 14 15:26:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:26:38.637777 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344ba099-972f-4f37-b097-5459b0d39317 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:38.802227 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344ba099-972f-4f37-b097-5459b0d39317 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:38.840281 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:38.849980 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0e9311-5328-41a8-81fe-b3903950777e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:38.850673 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0e9311-5328-41a8-81fe-b3903950777e None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:38.851005 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0e9311-5328-41a8-81fe-b3903950777e None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:38.851346 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0e9311-5328-41a8-81fe-b3903950777e None admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:38.851986 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0e9311-5328-41a8-81fe-b3903950777e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:26:38.852293 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0e9311-5328-41a8-81fe-b3903950777e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:38.853779 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0e9311-5328-41a8-81fe-b3903950777e None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:38.868066 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 585/1204] 10.222.0.118 () {56 vars in 1114 bytes} [Thu Jul 14 15:26:38 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:26:38.875117 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15153ff0-8b6d-4bf7-b6f7-90924532b021 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:38.968672 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:39.036213 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15153ff0-8b6d-4bf7-b6f7-90924532b021 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:39.093539 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7371575b-8f20-4f4f-9e82-4975b4af0f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:39.094528 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7371575b-8f20-4f4f-9e82-4975b4af0f8c None admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:39.094978 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7371575b-8f20-4f4f-9e82-4975b4af0f8c None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:39.095399 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7371575b-8f20-4f4f-9e82-4975b4af0f8c None admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:39.096518 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7371575b-8f20-4f4f-9e82-4975b4af0f8c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:39.098142 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7371575b-8f20-4f4f-9e82-4975b4af0f8c None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:39.128331 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 620/1205] 10.222.0.118 () {60 vars in 1137 bytes} [Thu Jul 14 15:26:38 2022] POST /identity/v3/users => generated 252 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:26:41.599955 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d2b88d-18dc-4abd-a0aa-70da912d1bcc None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:41.600483 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d2b88d-18dc-4abd-a0aa-70da912d1bcc None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:41.600589 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d2b88d-18dc-4abd-a0aa-70da912d1bcc None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:41.601903 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 586/1206] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:26:41 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:26:41.608744 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c881e5-ed3c-47a9-b60b-77d1902c7a8f None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:41.609461 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c881e5-ed3c-47a9-b60b-77d1902c7a8f None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:41.609461 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c881e5-ed3c-47a9-b60b-77d1902c7a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:41.630353 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-e4c881e5-ed3c-47a9-b60b-77d1902c7a8f None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:26:41.634488 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-e4c881e5-ed3c-47a9-b60b-77d1902c7a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:26:41.719269 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 621/1207] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:26:41 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 15:26:41.747373 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d2b88d-18dc-4abd-a0aa-70da912d1bcc None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:41.882083 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d2b88d-18dc-4abd-a0aa-70da912d1bcc None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:41.926646 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae429f2a-b017-4c6a-b1c9-ae36e94acf30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:41.927670 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae429f2a-b017-4c6a-b1c9-ae36e94acf30 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:41.928050 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae429f2a-b017-4c6a-b1c9-ae36e94acf30 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:41.928377 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae429f2a-b017-4c6a-b1c9-ae36e94acf30 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:41.943126 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae429f2a-b017-4c6a-b1c9-ae36e94acf30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:26:41.953340 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-ae429f2a-b017-4c6a-b1c9-ae36e94acf30 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:26:41.953340 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:26:41.953340 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:26:41.953340 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:26:41.953340 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:26:41.953340 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:26:41.953340 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:26:41.953340 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:26:41.953340 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:26:41.953340 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:26:41.953340 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:26:41.953340 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:26:41.953340 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:26:41.953340 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:26:41.953340 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:26:41.953340 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:26:41.954780 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:26:41.954780 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:26:41.954780 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:26:41.954780 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:26:41.954780 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:26:41.954780 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:26:41.954780 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:26:41.954780 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:26:41.954780 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:26:41.954780 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:26:41.954780 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:26:41.954780 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:26:41.954780 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:26:41.954780 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:26:41.954780 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:26:41.954780 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:26:41.955863 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:26:41.955863 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:26:41.955863 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:26:41.955863 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:26:41.955863 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:26:41.955863 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:26:41.955863 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:26:41.955863 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:26:41.955863 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:26:41.955863 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:26:41.955863 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:26:41.955863 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:26:41.955863 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 587/1208] 10.222.0.118 () {56 vars in 1107 bytes} [Thu Jul 14 15:26:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:26:41.961942 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c881e5-ed3c-47a9-b60b-77d1902c7a8f None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:42.012539 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:42.102355 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c881e5-ed3c-47a9-b60b-77d1902c7a8f None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:42.149514 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9745edcf-92a3-4848-898f-2c445fff9689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:42.150505 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9745edcf-92a3-4848-898f-2c445fff9689 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:42.151006 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9745edcf-92a3-4848-898f-2c445fff9689 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:42.151635 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9745edcf-92a3-4848-898f-2c445fff9689 None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:42.152932 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9745edcf-92a3-4848-898f-2c445fff9689 None admin] RBAC: Adding query filter params (name=service) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:26:42.153469 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9745edcf-92a3-4848-898f-2c445fff9689 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:42.155703 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9745edcf-92a3-4848-898f-2c445fff9689 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:42.169410 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 622/1209] 10.222.0.118 () {56 vars in 1108 bytes} [Thu Jul 14 15:26:41 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:26:42.174266 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae429f2a-b017-4c6a-b1c9-ae36e94acf30 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:42.233342 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:42.310215 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae429f2a-b017-4c6a-b1c9-ae36e94acf30 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:42.351478 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28347d43-6c1e-40b1-9def-fc458187ed30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:42.352715 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28347d43-6c1e-40b1-9def-fc458187ed30 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:42.353120 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28347d43-6c1e-40b1-9def-fc458187ed30 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:42.354167 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28347d43-6c1e-40b1-9def-fc458187ed30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:42.368695 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28347d43-6c1e-40b1-9def-fc458187ed30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:42.372051 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28347d43-6c1e-40b1-9def-fc458187ed30 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:42.398657 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-28347d43-6c1e-40b1-9def-fc458187ed30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:26:42.398657 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:26:42.398657 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:26:42.398657 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:26:42.398657 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:26:42.398657 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:26:42.398657 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:26:42.398657 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:26:42.398657 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:26:42.398657 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:26:42.398657 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:26:42.398657 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:26:42.398657 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:26:42.398657 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:26:42.398657 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:26:42.399710 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:26:42.399710 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:26:42.399710 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:26:42.399710 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:26:42.399710 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:26:42.399710 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:26:42.399710 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:26:42.399710 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:26:42.399710 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:26:42.399710 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:26:42.399710 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:26:42.399710 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:26:42.399710 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:26:42.399710 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:26:42.399710 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:26:42.399710 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:26:42.399710 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:26:42.401362 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:26:42.401362 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:26:42.401362 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:26:42.401362 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:26:42.401362 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 588/1210] 10.222.0.118 () {56 vars in 1113 bytes} [Thu Jul 14 15:26:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:26:42.405795 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9745edcf-92a3-4848-898f-2c445fff9689 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:42.523450 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:42.526492 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9745edcf-92a3-4848-898f-2c445fff9689 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:42.567110 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0942173-4975-4781-9320-43b018b9b939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:42.567783 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0942173-4975-4781-9320-43b018b9b939 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:42.568058 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0942173-4975-4781-9320-43b018b9b939 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:42.568380 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0942173-4975-4781-9320-43b018b9b939 None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:42.569061 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0942173-4975-4781-9320-43b018b9b939 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:26:42.569366 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0942173-4975-4781-9320-43b018b9b939 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:42.570793 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0942173-4975-4781-9320-43b018b9b939 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:42.584650 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 623/1211] 10.222.0.118 () {56 vars in 1114 bytes} [Thu Jul 14 15:26:42 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:26:42.590869 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28347d43-6c1e-40b1-9def-fc458187ed30 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:42.723965 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28347d43-6c1e-40b1-9def-fc458187ed30 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:42.727105 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:42.767590 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cef2124-5d58-484a-9648-dc8ffd78e24e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:42.768411 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cef2124-5d58-484a-9648-dc8ffd78e24e None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:42.768695 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cef2124-5d58-484a-9648-dc8ffd78e24e None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:42.769026 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cef2124-5d58-484a-9648-dc8ffd78e24e None admin] PATH_INFO: `/v3/users/placement` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:42.779791 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cef2124-5d58-484a-9648-dc8ffd78e24e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:42.781840 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cef2124-5d58-484a-9648-dc8ffd78e24e None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:42.808437 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-6cef2124-5d58-484a-9648-dc8ffd78e24e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 14 15:26:42.808437 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:26:42.808437 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:26:42.808437 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:26:42.808437 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:26:42.808437 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:26:42.808437 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:26:42.808437 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:26:42.808437 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:26:42.808437 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:26:42.808437 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:26:42.808437 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:26:42.808437 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 15:26:42.808437 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 15:26:42.808437 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 15:26:42.808437 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 15:26:42.809653 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:26:42.809653 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:26:42.809653 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 15:26:42.809653 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:26:42.809653 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 15:26:42.809653 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:26:42.809653 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:26:42.809653 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:26:42.809653 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:26:42.809653 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:26:42.809653 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:26:42.809653 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:26:42.809653 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:26:42.809653 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:26:42.809653 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:26:42.809653 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:26:42.809653 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:26:42.809653 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:26:42.810618 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:26:42.810618 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:26:42.810618 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 15:26:42.810618 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 15:26:42.810618 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 15:26:42.810618 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 15:26:42.810618 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 15:26:42.810618 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 15:26:42.810618 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 14 15:26:42.810618 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:26:42.812115 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 589/1212] 10.222.0.118 () {56 vars in 1113 bytes} [Thu Jul 14 15:26:42 2022] GET /identity/v3/users/placement => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:26:42.818328 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0942173-4975-4781-9320-43b018b9b939 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:42.938864 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0942173-4975-4781-9320-43b018b9b939 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:42.982840 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc5a25f-d859-40b2-b716-df5c6f5c425e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:42.983895 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc5a25f-d859-40b2-b716-df5c6f5c425e None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:42.984344 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc5a25f-d859-40b2-b716-df5c6f5c425e None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:42.984731 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc5a25f-d859-40b2-b716-df5c6f5c425e None admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:42.985587 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc5a25f-d859-40b2-b716-df5c6f5c425e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:26:42.986019 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc5a25f-d859-40b2-b716-df5c6f5c425e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:42.987561 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc5a25f-d859-40b2-b716-df5c6f5c425e None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:43.008605 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 624/1213] 10.222.0.118 () {56 vars in 1148 bytes} [Thu Jul 14 15:26:42 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:26:43.015606 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cef2124-5d58-484a-9648-dc8ffd78e24e None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:43.145510 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cef2124-5d58-484a-9648-dc8ffd78e24e None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:43.186049 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb479cb-e6bf-43b4-84d1-a7b7765a6946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:43.186635 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb479cb-e6bf-43b4-84d1-a7b7765a6946 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:43.186950 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb479cb-e6bf-43b4-84d1-a7b7765a6946 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:43.187187 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb479cb-e6bf-43b4-84d1-a7b7765a6946 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:43.220116 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:43.268116 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb479cb-e6bf-43b4-84d1-a7b7765a6946 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:43.269447 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb479cb-e6bf-43b4-84d1-a7b7765a6946 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:43.393693 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 590/1214] 10.222.0.118 () {58 vars in 1287 bytes} [Thu Jul 14 15:26:43 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 15:26:43.399986 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc5a25f-d859-40b2-b716-df5c6f5c425e None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:43.422449 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:43.516732 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc5a25f-d859-40b2-b716-df5c6f5c425e None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:43.555530 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48d1563-5dbb-4ad7-95dd-7724a38287cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:43.556307 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48d1563-5dbb-4ad7-95dd-7724a38287cd None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:43.556620 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48d1563-5dbb-4ad7-95dd-7724a38287cd None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:43.556884 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48d1563-5dbb-4ad7-95dd-7724a38287cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:43.569250 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48d1563-5dbb-4ad7-95dd-7724a38287cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:43.570730 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48d1563-5dbb-4ad7-95dd-7724a38287cd None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:43.589473 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-e48d1563-5dbb-4ad7-95dd-7724a38287cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:26:43.589473 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:26:43.589473 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:26:43.589473 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:26:43.589473 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:26:43.589473 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:26:43.589473 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:26:43.589473 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:26:43.589473 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:26:43.589473 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:26:43.589473 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:26:43.589473 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:26:43.589473 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:26:43.589473 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:26:43.589473 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:26:43.590677 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:26:43.590677 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:26:43.590677 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:26:43.590677 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:26:43.590677 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:26:43.590677 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:26:43.590677 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:26:43.590677 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:26:43.590677 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:26:43.590677 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:26:43.590677 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:26:43.590677 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:26:43.590677 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:26:43.590677 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:26:43.590677 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:26:43.590677 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:26:43.590677 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:26:43.599694 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:26:43.599694 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:26:43.599694 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:26:43.599694 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:26:43.599694 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 625/1215] 10.222.0.118 () {56 vars in 1113 bytes} [Thu Jul 14 15:26:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:26:43.600043 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb479cb-e6bf-43b4-84d1-a7b7765a6946 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:43.664862 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:43.708675 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb479cb-e6bf-43b4-84d1-a7b7765a6946 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:43.757892 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3c4936-5ed6-407f-a7f6-6a3297e8b953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:43.758759 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3c4936-5ed6-407f-a7f6-6a3297e8b953 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:43.759016 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3c4936-5ed6-407f-a7f6-6a3297e8b953 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:43.759299 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3c4936-5ed6-407f-a7f6-6a3297e8b953 None admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:43.760940 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3c4936-5ed6-407f-a7f6-6a3297e8b953 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:26:43.762582 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3c4936-5ed6-407f-a7f6-6a3297e8b953 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:43.762975 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3c4936-5ed6-407f-a7f6-6a3297e8b953 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:43.778546 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 591/1216] 10.222.0.118 () {56 vars in 1114 bytes} [Thu Jul 14 15:26:43 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:26:43.784364 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48d1563-5dbb-4ad7-95dd-7724a38287cd None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:43.867579 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:43.912722 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48d1563-5dbb-4ad7-95dd-7724a38287cd None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:43.954223 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39ee812-0693-4dbf-83c9-577755ebf9b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:43.955389 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39ee812-0693-4dbf-83c9-577755ebf9b4 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:43.955906 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39ee812-0693-4dbf-83c9-577755ebf9b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:43.956274 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39ee812-0693-4dbf-83c9-577755ebf9b4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:43.964466 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39ee812-0693-4dbf-83c9-577755ebf9b4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:43.966075 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39ee812-0693-4dbf-83c9-577755ebf9b4 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:43.981116 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-e39ee812-0693-4dbf-83c9-577755ebf9b4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:26:43.981116 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:26:43.981116 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:26:43.981116 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:26:43.981116 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:26:43.981116 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:26:43.981116 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:26:43.981116 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:26:43.981116 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:26:43.981116 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:26:43.981116 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:26:43.981116 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:26:43.981116 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 15:26:43.981116 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 15:26:43.981116 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 15:26:43.982417 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 15:26:43.982417 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:26:43.982417 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:26:43.982417 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:26:43.982417 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:26:43.982417 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:26:43.982417 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:26:43.982417 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:26:43.982417 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:26:43.982417 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:26:43.982417 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:26:43.982417 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:26:43.982417 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:26:43.982417 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:26:43.982417 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:26:43.982417 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:26:43.982417 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:26:43.983522 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 15:26:43.983522 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 15:26:43.983522 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:26:43.983522 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:26:43.983522 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:26:43.983522 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:26:43.983522 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:26:43.983522 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:26:43.989890 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 626/1217] 10.222.0.118 () {56 vars in 1116 bytes} [Thu Jul 14 15:26:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:26:43.991429 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3c4936-5ed6-407f-a7f6-6a3297e8b953 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:44.113590 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3c4936-5ed6-407f-a7f6-6a3297e8b953 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:44.144100 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:44.159821 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908e416a-8414-45a7-bd4d-01fc42d4dfab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:44.160496 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e416a-8414-45a7-bd4d-01fc42d4dfab None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:44.160811 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e416a-8414-45a7-bd4d-01fc42d4dfab None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:44.161166 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e416a-8414-45a7-bd4d-01fc42d4dfab None admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:44.162076 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908e416a-8414-45a7-bd4d-01fc42d4dfab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:26:44.162399 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908e416a-8414-45a7-bd4d-01fc42d4dfab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:44.163841 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908e416a-8414-45a7-bd4d-01fc42d4dfab None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:44.178708 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 592/1218] 10.222.0.118 () {56 vars in 1153 bytes} [Thu Jul 14 15:26:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:26:44.185717 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39ee812-0693-4dbf-83c9-577755ebf9b4 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:44.307952 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39ee812-0693-4dbf-83c9-577755ebf9b4 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:44.338857 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:44.346485 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c93f77-bdb2-4ae7-a7d6-5ccfbd25705d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:44.347149 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c93f77-bdb2-4ae7-a7d6-5ccfbd25705d None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:44.347424 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c93f77-bdb2-4ae7-a7d6-5ccfbd25705d None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:44.347730 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c93f77-bdb2-4ae7-a7d6-5ccfbd25705d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:44.348617 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c93f77-bdb2-4ae7-a7d6-5ccfbd25705d None admin] RBAC: Adding query filter params (role.id=3185f450429e4bb3b5f289b615f3269b, scope.project.id=939bf9541f4a4afe86550f749d337680, user.id=e70b0f8be7e04adca6e3f218fbe3a295) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:26:44.349012 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c93f77-bdb2-4ae7-a7d6-5ccfbd25705d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:44.350567 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c93f77-bdb2-4ae7-a7d6-5ccfbd25705d None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:44.357750 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 627/1219] 10.222.0.118 () {56 vars in 1379 bytes} [Thu Jul 14 15:26:44 2022] GET /identity/v3/role_assignments?user.id=e70b0f8be7e04adca6e3f218fbe3a295&scope.project.id=939bf9541f4a4afe86550f749d337680&role.id=3185f450429e4bb3b5f289b615f3269b => generated 260 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:26:46.458962 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e929609b-b083-436e-b5d1-6767c5c4c2ae None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:46.459496 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e929609b-b083-436e-b5d1-6767c5c4c2ae None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:46.459496 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e929609b-b083-436e-b5d1-6767c5c4c2ae None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:46.460898 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 593/1220] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:26:46 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:26:46.466392 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b53901-d0de-446b-83f0-ba869f16b8bf None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:46.466851 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b53901-d0de-446b-83f0-ba869f16b8bf None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:46.466950 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b53901-d0de-446b-83f0-ba869f16b8bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:46.483964 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-52b53901-d0de-446b-83f0-ba869f16b8bf None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:26:46.485324 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-52b53901-d0de-446b-83f0-ba869f16b8bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:26:46.559995 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 628/1221] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:26:46 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:26:46.588683 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e929609b-b083-436e-b5d1-6767c5c4c2ae None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:46.699961 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e929609b-b083-436e-b5d1-6767c5c4c2ae None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:46.740896 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9916a0a2-89e9-4bdc-9308-148a63033949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:46.742028 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9916a0a2-89e9-4bdc-9308-148a63033949 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:46.742396 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9916a0a2-89e9-4bdc-9308-148a63033949 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:46.742670 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9916a0a2-89e9-4bdc-9308-148a63033949 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:46.756417 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9916a0a2-89e9-4bdc-9308-148a63033949 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:26:46.766883 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-9916a0a2-89e9-4bdc-9308-148a63033949 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:26:46.766883 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:26:46.766883 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:26:46.766883 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:26:46.766883 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:26:46.766883 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:26:46.766883 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:26:46.766883 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:26:46.766883 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:26:46.766883 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:26:46.766883 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:26:46.766883 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:26:46.766883 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:26:46.766883 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:26:46.766883 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:26:46.766883 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:26:46.768008 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:26:46.768008 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:26:46.768008 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:26:46.768008 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:26:46.768008 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:26:46.768008 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:26:46.768008 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:26:46.768008 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:26:46.768008 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:26:46.768008 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:26:46.768008 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:26:46.768008 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:26:46.768008 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:26:46.768008 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:26:46.768008 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:26:46.768008 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:26:46.768953 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:26:46.768953 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:26:46.768953 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:26:46.768953 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:26:46.768953 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:26:46.768953 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:26:46.768953 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:26:46.768953 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:26:46.768953 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:26:46.768953 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:26:46.768953 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:26:46.768953 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:26:46.768953 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 594/1222] 10.222.0.118 () {56 vars in 1107 bytes} [Thu Jul 14 15:26:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:26:46.774967 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b53901-d0de-446b-83f0-ba869f16b8bf None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:46.884410 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b53901-d0de-446b-83f0-ba869f16b8bf None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:46.907889 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:46.920779 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1037e2c2-2d7e-45fb-9246-4c0e824b9956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:46.921519 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1037e2c2-2d7e-45fb-9246-4c0e824b9956 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:46.921797 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1037e2c2-2d7e-45fb-9246-4c0e824b9956 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:46.922109 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1037e2c2-2d7e-45fb-9246-4c0e824b9956 None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:46.922893 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1037e2c2-2d7e-45fb-9246-4c0e824b9956 None admin] RBAC: Adding query filter params (name=service) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:26:46.923213 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1037e2c2-2d7e-45fb-9246-4c0e824b9956 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:46.924803 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1037e2c2-2d7e-45fb-9246-4c0e824b9956 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:46.939771 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 629/1223] 10.222.0.118 () {56 vars in 1108 bytes} [Thu Jul 14 15:26:46 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:26:46.941433 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9916a0a2-89e9-4bdc-9308-148a63033949 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:46.988714 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:47.063638 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9916a0a2-89e9-4bdc-9308-148a63033949 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:47.101304 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39296cf2-5afe-4b4f-84f6-4d5f32debfcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:47.102146 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39296cf2-5afe-4b4f-84f6-4d5f32debfcb None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:47.102429 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39296cf2-5afe-4b4f-84f6-4d5f32debfcb None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:47.102701 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39296cf2-5afe-4b4f-84f6-4d5f32debfcb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:47.116223 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39296cf2-5afe-4b4f-84f6-4d5f32debfcb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:47.117779 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39296cf2-5afe-4b4f-84f6-4d5f32debfcb None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:47.138438 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-39296cf2-5afe-4b4f-84f6-4d5f32debfcb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:26:47.138438 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:26:47.138438 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:26:47.138438 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:26:47.138438 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:26:47.138438 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:26:47.138438 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:26:47.138438 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:26:47.138438 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:26:47.138438 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:26:47.138438 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:26:47.138438 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:26:47.138438 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:26:47.138438 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:26:47.138438 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:26:47.139547 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:26:47.139547 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:26:47.139547 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:26:47.139547 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:26:47.139547 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:26:47.139547 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:26:47.139547 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:26:47.139547 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:26:47.139547 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:26:47.139547 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:26:47.139547 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:26:47.139547 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:26:47.139547 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:26:47.139547 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:26:47.139547 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:26:47.139547 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:26:47.139547 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:26:47.140644 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:26:47.140644 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:26:47.140644 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:26:47.140644 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:26:47.140644 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 595/1224] 10.222.0.118 () {56 vars in 1113 bytes} [Thu Jul 14 15:26:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:26:47.146186 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1037e2c2-2d7e-45fb-9246-4c0e824b9956 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:47.258097 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1037e2c2-2d7e-45fb-9246-4c0e824b9956 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:47.294560 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20b0268-9d7b-45f7-9fdc-1bb022ad6288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:47.295216 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20b0268-9d7b-45f7-9fdc-1bb022ad6288 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:47.295494 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20b0268-9d7b-45f7-9fdc-1bb022ad6288 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:47.295762 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20b0268-9d7b-45f7-9fdc-1bb022ad6288 None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:47.296472 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20b0268-9d7b-45f7-9fdc-1bb022ad6288 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:26:47.296772 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20b0268-9d7b-45f7-9fdc-1bb022ad6288 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:47.298158 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20b0268-9d7b-45f7-9fdc-1bb022ad6288 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:47.309683 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 630/1225] 10.222.0.118 () {56 vars in 1114 bytes} [Thu Jul 14 15:26:47 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:26:47.317038 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39296cf2-5afe-4b4f-84f6-4d5f32debfcb None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:47.442753 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:47.453405 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39296cf2-5afe-4b4f-84f6-4d5f32debfcb None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:47.494331 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e04c46-5d93-4166-81dd-fe511cd068ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:47.495146 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e04c46-5d93-4166-81dd-fe511cd068ae None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:47.495424 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e04c46-5d93-4166-81dd-fe511cd068ae None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:47.495698 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e04c46-5d93-4166-81dd-fe511cd068ae None admin] PATH_INFO: `/v3/users/placement` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:47.504855 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e04c46-5d93-4166-81dd-fe511cd068ae None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:47.506444 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e04c46-5d93-4166-81dd-fe511cd068ae None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:47.522135 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-83e04c46-5d93-4166-81dd-fe511cd068ae None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 14 15:26:47.522135 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:26:47.522135 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:26:47.522135 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:26:47.522135 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:26:47.522135 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:26:47.522135 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:26:47.522135 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:26:47.522135 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:26:47.522135 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:26:47.522135 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:26:47.522135 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:26:47.522135 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 15:26:47.522135 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 15:26:47.522135 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 15:26:47.522135 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 15:26:47.523294 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:26:47.523294 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:26:47.523294 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 15:26:47.523294 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:26:47.523294 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 15:26:47.523294 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:26:47.523294 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:26:47.523294 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:26:47.523294 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:26:47.523294 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:26:47.523294 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:26:47.523294 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:26:47.523294 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:26:47.523294 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:26:47.523294 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:26:47.523294 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:26:47.523294 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:26:47.523294 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:26:47.524909 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:26:47.524909 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:26:47.524909 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 15:26:47.524909 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 15:26:47.524909 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 15:26:47.524909 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 15:26:47.524909 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 15:26:47.524909 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 15:26:47.524909 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 14 15:26:47.524909 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:26:47.524909 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 596/1226] 10.222.0.118 () {56 vars in 1113 bytes} [Thu Jul 14 15:26:47 2022] GET /identity/v3/users/placement => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:26:47.530837 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20b0268-9d7b-45f7-9fdc-1bb022ad6288 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:47.583231 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:47.645835 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20b0268-9d7b-45f7-9fdc-1bb022ad6288 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:47.685412 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deef7c0d-bcdb-4b24-b6b9-f73dcd509f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:47.686133 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deef7c0d-bcdb-4b24-b6b9-f73dcd509f0b None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:47.686481 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deef7c0d-bcdb-4b24-b6b9-f73dcd509f0b None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:47.686744 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deef7c0d-bcdb-4b24-b6b9-f73dcd509f0b None admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:47.687684 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deef7c0d-bcdb-4b24-b6b9-f73dcd509f0b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:26:47.688021 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deef7c0d-bcdb-4b24-b6b9-f73dcd509f0b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:47.689552 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deef7c0d-bcdb-4b24-b6b9-f73dcd509f0b None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:47.710196 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 631/1227] 10.222.0.118 () {56 vars in 1148 bytes} [Thu Jul 14 15:26:47 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:26:47.716429 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e04c46-5d93-4166-81dd-fe511cd068ae None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:47.824601 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e04c46-5d93-4166-81dd-fe511cd068ae None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:47.859753 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b46dbd-f965-43b3-baae-67f9b6745ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:47.860572 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b46dbd-f965-43b3-baae-67f9b6745ba1 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:47.860852 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b46dbd-f965-43b3-baae-67f9b6745ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:47.861181 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b46dbd-f965-43b3-baae-67f9b6745ba1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:47.872410 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b46dbd-f965-43b3-baae-67f9b6745ba1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:47.873890 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b46dbd-f965-43b3-baae-67f9b6745ba1 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:47.892991 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-17b46dbd-f965-43b3-baae-67f9b6745ba1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:26:47.892991 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:26:47.892991 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:26:47.892991 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:26:47.892991 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:26:47.892991 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:26:47.892991 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:26:47.892991 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:26:47.892991 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:26:47.892991 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:26:47.892991 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:26:47.892991 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:26:47.892991 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:26:47.892991 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:26:47.892991 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:26:47.894028 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:26:47.894028 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:26:47.894028 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:26:47.894028 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:26:47.894028 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:26:47.894028 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:26:47.894028 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:26:47.894028 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:26:47.894028 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:26:47.894028 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:26:47.894028 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:26:47.894028 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:26:47.894028 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:26:47.894028 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:26:47.894028 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:26:47.894028 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:26:47.894028 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:26:47.894930 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:26:47.894930 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:26:47.894930 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:26:47.894930 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:26:47.894930 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 597/1228] 10.222.0.118 () {56 vars in 1113 bytes} [Thu Jul 14 15:26:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:26:47.900161 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deef7c0d-bcdb-4b24-b6b9-f73dcd509f0b None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:48.017690 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deef7c0d-bcdb-4b24-b6b9-f73dcd509f0b None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:48.021120 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:48.064181 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cd1fb7-766e-4b2f-a72f-0387ea5279bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:48.064845 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cd1fb7-766e-4b2f-a72f-0387ea5279bd None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:48.065129 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cd1fb7-766e-4b2f-a72f-0387ea5279bd None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:48.065428 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cd1fb7-766e-4b2f-a72f-0387ea5279bd None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:48.066263 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cd1fb7-766e-4b2f-a72f-0387ea5279bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:26:48.066830 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cd1fb7-766e-4b2f-a72f-0387ea5279bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:48.069202 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cd1fb7-766e-4b2f-a72f-0387ea5279bd None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:48.082417 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 632/1229] 10.222.0.118 () {56 vars in 1114 bytes} [Thu Jul 14 15:26:47 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:26:48.088487 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b46dbd-f965-43b3-baae-67f9b6745ba1 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:48.098256 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:48.203385 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b46dbd-f965-43b3-baae-67f9b6745ba1 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:48.238623 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a45a234-d490-44c4-af90-5e9b040eb404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:48.239581 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a45a234-d490-44c4-af90-5e9b040eb404 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:48.239938 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a45a234-d490-44c4-af90-5e9b040eb404 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:48.240300 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a45a234-d490-44c4-af90-5e9b040eb404 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:48.248954 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a45a234-d490-44c4-af90-5e9b040eb404 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:48.250680 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a45a234-d490-44c4-af90-5e9b040eb404 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:48.266050 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-9a45a234-d490-44c4-af90-5e9b040eb404 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:26:48.266050 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:26:48.266050 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:26:48.266050 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:26:48.266050 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:26:48.266050 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:26:48.266050 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:26:48.266050 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:26:48.266050 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:26:48.266050 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:26:48.266050 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:26:48.266050 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:26:48.266050 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 15:26:48.266050 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 15:26:48.266050 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 15:26:48.267185 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 15:26:48.267185 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:26:48.267185 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:26:48.267185 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:26:48.267185 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:26:48.267185 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:26:48.267185 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:26:48.267185 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:26:48.267185 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:26:48.267185 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:26:48.267185 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:26:48.267185 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:26:48.267185 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:26:48.267185 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:26:48.267185 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:26:48.267185 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:26:48.267185 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:26:48.268274 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 15:26:48.268274 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 15:26:48.268274 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:26:48.268274 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:26:48.268274 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:26:48.268274 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:26:48.268274 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:26:48.268274 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:26:48.268274 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 598/1230] 10.222.0.118 () {56 vars in 1116 bytes} [Thu Jul 14 15:26:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:26:48.274376 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cd1fb7-766e-4b2f-a72f-0387ea5279bd None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:48.387709 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cd1fb7-766e-4b2f-a72f-0387ea5279bd None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:48.430171 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67953e0-b358-43e1-91d3-6c22202a0de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:48.431249 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67953e0-b358-43e1-91d3-6c22202a0de6 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:48.432180 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67953e0-b358-43e1-91d3-6c22202a0de6 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:48.432570 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67953e0-b358-43e1-91d3-6c22202a0de6 None admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:48.433728 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67953e0-b358-43e1-91d3-6c22202a0de6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:26:48.434302 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67953e0-b358-43e1-91d3-6c22202a0de6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:48.436340 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67953e0-b358-43e1-91d3-6c22202a0de6 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:48.455234 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 633/1231] 10.222.0.118 () {56 vars in 1153 bytes} [Thu Jul 14 15:26:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:26:48.463103 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a45a234-d490-44c4-af90-5e9b040eb404 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:48.538678 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:48.577754 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a45a234-d490-44c4-af90-5e9b040eb404 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:48.615779 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcc7f35-a6b0-4b0d-8615-0e318bec2255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:48.616755 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcc7f35-a6b0-4b0d-8615-0e318bec2255 None admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:48.617038 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcc7f35-a6b0-4b0d-8615-0e318bec2255 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:48.617315 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcc7f35-a6b0-4b0d-8615-0e318bec2255 None admin] PATH_INFO: `/v3/projects/939bf9541f4a4afe86550f749d337680/users/e70b0f8be7e04adca6e3f218fbe3a295/roles/3185f450429e4bb3b5f289b615f3269b` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:48.633043 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcc7f35-a6b0-4b0d-8615-0e318bec2255 None admin] RBAC: Authorizing `identity:create_grant(project_id=939bf9541f4a4afe86550f749d337680, user_id=e70b0f8be7e04adca6e3f218fbe3a295, role_id=3185f450429e4bb3b5f289b615f3269b)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:48.634575 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcc7f35-a6b0-4b0d-8615-0e318bec2255 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:48.648839 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 599/1232] 10.222.0.118 () {58 vars in 1444 bytes} [Thu Jul 14 15:26:48 2022] PUT /identity/v3/projects/939bf9541f4a4afe86550f749d337680/users/e70b0f8be7e04adca6e3f218fbe3a295/roles/3185f450429e4bb3b5f289b615f3269b => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:26:50.924426 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb898efd-fe51-471a-8153-2c006dd4c696 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:50.925048 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb898efd-fe51-471a-8153-2c006dd4c696 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:50.925048 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb898efd-fe51-471a-8153-2c006dd4c696 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:50.926850 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 634/1233] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:26:50 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:26:50.932978 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3824c6e1-6ebc-4c9d-a072-ca51b6496af3 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:50.933503 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3824c6e1-6ebc-4c9d-a072-ca51b6496af3 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:50.933626 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3824c6e1-6ebc-4c9d-a072-ca51b6496af3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:50.951461 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-3824c6e1-6ebc-4c9d-a072-ca51b6496af3 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:26:50.952687 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-3824c6e1-6ebc-4c9d-a072-ca51b6496af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:26:51.030417 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 600/1234] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:26:50 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:26:51.057729 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb898efd-fe51-471a-8153-2c006dd4c696 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:51.088816 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:51.179318 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb898efd-fe51-471a-8153-2c006dd4c696 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:51.215156 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea6d32d-3ed3-471c-8144-3e5ceabad060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:51.216002 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea6d32d-3ed3-471c-8144-3e5ceabad060 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:51.216281 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea6d32d-3ed3-471c-8144-3e5ceabad060 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:51.216549 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea6d32d-3ed3-471c-8144-3e5ceabad060 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:51.227420 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea6d32d-3ed3-471c-8144-3e5ceabad060 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:26:51.237151 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-2ea6d32d-3ed3-471c-8144-3e5ceabad060 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:26:51.237151 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:26:51.237151 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:26:51.237151 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:26:51.237151 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:26:51.237151 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:26:51.237151 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:26:51.237151 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:26:51.237151 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:26:51.237151 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:26:51.237151 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:26:51.237151 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:26:51.237151 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:26:51.237151 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:26:51.237151 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:26:51.237151 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:26:51.238273 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:26:51.238273 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:26:51.238273 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:26:51.238273 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:26:51.238273 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:26:51.238273 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:26:51.238273 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:26:51.238273 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:26:51.238273 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:26:51.238273 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:26:51.238273 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:26:51.238273 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:26:51.238273 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:26:51.238273 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:26:51.238273 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:26:51.238273 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:26:51.239253 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:26:51.239253 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:26:51.239253 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:26:51.239253 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:26:51.239253 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:26:51.239253 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:26:51.239253 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:26:51.239253 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:26:51.239253 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:26:51.239253 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:26:51.239253 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:26:51.239253 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:26:51.239253 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 635/1235] 10.222.0.118 () {56 vars in 1107 bytes} [Thu Jul 14 15:26:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:26:51.244776 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3824c6e1-6ebc-4c9d-a072-ca51b6496af3 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:51.296758 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:51.353026 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3824c6e1-6ebc-4c9d-a072-ca51b6496af3 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:51.389366 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e434d6-a3cb-461b-8ded-28c9dca153b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:51.390056 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e434d6-a3cb-461b-8ded-28c9dca153b1 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:51.390335 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e434d6-a3cb-461b-8ded-28c9dca153b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:51.390603 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e434d6-a3cb-461b-8ded-28c9dca153b1 None admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:51.391458 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e434d6-a3cb-461b-8ded-28c9dca153b1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:26:51.391758 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e434d6-a3cb-461b-8ded-28c9dca153b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:51.393124 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e434d6-a3cb-461b-8ded-28c9dca153b1 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:51.402904 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 601/1236] 10.222.0.118 () {56 vars in 1108 bytes} [Thu Jul 14 15:26:51 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:26:51.409598 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea6d32d-3ed3-471c-8144-3e5ceabad060 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:51.522429 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:51.540507 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea6d32d-3ed3-471c-8144-3e5ceabad060 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:51.576450 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeaa16b-480a-4745-909a-a1d52714d8cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:51.577230 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeaa16b-480a-4745-909a-a1d52714d8cc None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:51.577551 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeaa16b-480a-4745-909a-a1d52714d8cc None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:51.577940 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeaa16b-480a-4745-909a-a1d52714d8cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:51.591182 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daeaa16b-480a-4745-909a-a1d52714d8cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:51.592657 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daeaa16b-480a-4745-909a-a1d52714d8cc None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:51.612123 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-daeaa16b-480a-4745-909a-a1d52714d8cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:26:51.612123 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:26:51.612123 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:26:51.612123 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:26:51.612123 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:26:51.612123 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:26:51.612123 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:26:51.612123 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:26:51.612123 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:26:51.612123 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:26:51.612123 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:26:51.612123 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:26:51.612123 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:26:51.612123 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:26:51.612123 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:26:51.613289 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:26:51.613289 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:26:51.613289 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:26:51.613289 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:26:51.613289 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:26:51.613289 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:26:51.613289 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:26:51.613289 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:26:51.613289 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:26:51.613289 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:26:51.613289 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:26:51.613289 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:26:51.613289 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:26:51.613289 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:26:51.613289 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:26:51.613289 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:26:51.613289 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:26:51.614275 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:26:51.614275 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:26:51.614275 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:26:51.614275 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:26:51.614275 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 636/1237] 10.222.0.118 () {56 vars in 1113 bytes} [Thu Jul 14 15:26:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:26:51.620120 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e434d6-a3cb-461b-8ded-28c9dca153b1 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:51.736869 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e434d6-a3cb-461b-8ded-28c9dca153b1 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:51.748293 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:51.777039 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7ac7ef-8ea8-4dd1-9970-3ae19a25d124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:51.777725 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ac7ef-8ea8-4dd1-9970-3ae19a25d124 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:51.778007 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ac7ef-8ea8-4dd1-9970-3ae19a25d124 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:51.778289 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ac7ef-8ea8-4dd1-9970-3ae19a25d124 None admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:51.779009 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7ac7ef-8ea8-4dd1-9970-3ae19a25d124 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:26:51.779313 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7ac7ef-8ea8-4dd1-9970-3ae19a25d124 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:51.780684 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7ac7ef-8ea8-4dd1-9970-3ae19a25d124 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:51.792611 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 602/1238] 10.222.0.118 () {56 vars in 1114 bytes} [Thu Jul 14 15:26:51 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:26:51.798489 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeaa16b-480a-4745-909a-a1d52714d8cc None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:51.915376 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeaa16b-480a-4745-909a-a1d52714d8cc None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:51.953119 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c968cd46-b533-48e1-baec-6a1133ffc879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:51.953949 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c968cd46-b533-48e1-baec-6a1133ffc879 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:51.954219 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c968cd46-b533-48e1-baec-6a1133ffc879 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:51.954489 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c968cd46-b533-48e1-baec-6a1133ffc879 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:51.957335 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:51.964033 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c968cd46-b533-48e1-baec-6a1133ffc879 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:51.965514 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c968cd46-b533-48e1-baec-6a1133ffc879 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:51.981130 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-c968cd46-b533-48e1-baec-6a1133ffc879 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 14 15:26:51.981130 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:26:51.981130 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:26:51.981130 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:26:51.981130 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:26:51.981130 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:26:51.981130 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:26:51.981130 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:26:51.981130 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:26:51.981130 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:26:51.981130 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:26:51.981130 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:26:51.981130 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 15:26:51.981130 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 15:26:51.981130 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 15:26:51.981130 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 15:26:51.982328 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:26:51.982328 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:26:51.982328 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 15:26:51.982328 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:26:51.982328 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 15:26:51.982328 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:26:51.982328 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:26:51.982328 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:26:51.982328 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:26:51.982328 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:26:51.982328 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:26:51.982328 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:26:51.982328 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:26:51.982328 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:26:51.982328 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:26:51.982328 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:26:51.982328 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:26:51.982328 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:26:51.983353 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:26:51.983353 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:26:51.983353 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 15:26:51.983353 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 15:26:51.983353 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 15:26:51.983353 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 15:26:51.983353 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 15:26:51.983353 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 15:26:51.983353 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 14 15:26:51.983353 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:26:51.983353 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 637/1239] 10.222.0.118 () {56 vars in 1113 bytes} [Thu Jul 14 15:26:51 2022] GET /identity/v3/users/placement => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:26:51.989133 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7ac7ef-8ea8-4dd1-9970-3ae19a25d124 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:52.102577 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7ac7ef-8ea8-4dd1-9970-3ae19a25d124 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:52.142212 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32e8e88-3ddc-4f38-b8e6-7bfce98a58fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:52.142889 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32e8e88-3ddc-4f38-b8e6-7bfce98a58fe None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:52.143169 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32e8e88-3ddc-4f38-b8e6-7bfce98a58fe None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:52.143436 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32e8e88-3ddc-4f38-b8e6-7bfce98a58fe None admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:52.144278 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32e8e88-3ddc-4f38-b8e6-7bfce98a58fe None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:26:52.144587 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32e8e88-3ddc-4f38-b8e6-7bfce98a58fe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:52.146036 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32e8e88-3ddc-4f38-b8e6-7bfce98a58fe None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:52.167212 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 603/1240] 10.222.0.118 () {56 vars in 1148 bytes} [Thu Jul 14 15:26:51 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:26:52.173473 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c968cd46-b533-48e1-baec-6a1133ffc879 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:52.283129 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c968cd46-b533-48e1-baec-6a1133ffc879 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:52.321271 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366b0da5-4fa8-4183-81cc-93d402921456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:52.322115 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b0da5-4fa8-4183-81cc-93d402921456 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:52.322391 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b0da5-4fa8-4183-81cc-93d402921456 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:52.322661 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b0da5-4fa8-4183-81cc-93d402921456 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:52.394292 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:52.403206 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366b0da5-4fa8-4183-81cc-93d402921456 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:52.405590 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366b0da5-4fa8-4183-81cc-93d402921456 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:52.531326 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 638/1241] 10.222.0.118 () {58 vars in 1287 bytes} [Thu Jul 14 15:26:52 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 15:26:52.537472 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32e8e88-3ddc-4f38-b8e6-7bfce98a58fe None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:52.567293 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:52.643223 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32e8e88-3ddc-4f38-b8e6-7bfce98a58fe None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:52.682211 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea0bf15-f224-45ca-9ef5-9a75c0997b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:52.683140 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea0bf15-f224-45ca-9ef5-9a75c0997b9e None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:52.683523 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea0bf15-f224-45ca-9ef5-9a75c0997b9e None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:52.683871 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea0bf15-f224-45ca-9ef5-9a75c0997b9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:52.696450 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea0bf15-f224-45ca-9ef5-9a75c0997b9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:52.698228 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea0bf15-f224-45ca-9ef5-9a75c0997b9e None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:52.719001 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-dea0bf15-f224-45ca-9ef5-9a75c0997b9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:26:52.719001 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:26:52.719001 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:26:52.719001 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:26:52.719001 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:26:52.719001 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:26:52.719001 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:26:52.719001 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:26:52.719001 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:26:52.719001 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:26:52.719001 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:26:52.719001 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:26:52.719001 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:26:52.719001 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:26:52.719001 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:26:52.720289 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:26:52.720289 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:26:52.720289 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:26:52.720289 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:26:52.720289 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:26:52.720289 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:26:52.720289 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:26:52.720289 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:26:52.720289 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:26:52.720289 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:26:52.720289 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:26:52.720289 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:26:52.720289 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:26:52.720289 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:26:52.720289 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:26:52.720289 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:26:52.720289 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:26:52.721582 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:26:52.721582 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:26:52.721582 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:26:52.721582 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:26:52.725996 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 604/1242] 10.222.0.118 () {56 vars in 1113 bytes} [Thu Jul 14 15:26:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:26:52.726470 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366b0da5-4fa8-4183-81cc-93d402921456 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:52.828741 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:52.836194 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366b0da5-4fa8-4183-81cc-93d402921456 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:52.878757 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7284f8c-5c33-44f9-9fea-7b75d80cfeb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:52.879503 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7284f8c-5c33-44f9-9fea-7b75d80cfeb8 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:52.879802 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7284f8c-5c33-44f9-9fea-7b75d80cfeb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:52.880050 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7284f8c-5c33-44f9-9fea-7b75d80cfeb8 None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:52.880837 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7284f8c-5c33-44f9-9fea-7b75d80cfeb8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:26:52.881139 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7284f8c-5c33-44f9-9fea-7b75d80cfeb8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:52.882629 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7284f8c-5c33-44f9-9fea-7b75d80cfeb8 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:52.902457 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 639/1243] 10.222.0.118 () {56 vars in 1114 bytes} [Thu Jul 14 15:26:52 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:26:52.903830 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea0bf15-f224-45ca-9ef5-9a75c0997b9e None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:52.991711 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:53.018386 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea0bf15-f224-45ca-9ef5-9a75c0997b9e None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:53.068209 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a351bfb-ef72-4b63-8b89-4ec4318727f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:53.069205 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a351bfb-ef72-4b63-8b89-4ec4318727f3 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:53.069489 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a351bfb-ef72-4b63-8b89-4ec4318727f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:53.069762 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a351bfb-ef72-4b63-8b89-4ec4318727f3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:53.078424 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a351bfb-ef72-4b63-8b89-4ec4318727f3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:53.080267 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a351bfb-ef72-4b63-8b89-4ec4318727f3 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:53.097327 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-1a351bfb-ef72-4b63-8b89-4ec4318727f3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:26:53.097327 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:26:53.097327 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:26:53.097327 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:26:53.097327 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:26:53.097327 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:26:53.097327 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:26:53.097327 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:26:53.097327 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:26:53.097327 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:26:53.097327 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:26:53.097327 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:26:53.097327 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 15:26:53.097327 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 15:26:53.097327 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 15:26:53.098427 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 15:26:53.098427 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:26:53.098427 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:26:53.098427 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:26:53.098427 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:26:53.098427 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:26:53.098427 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:26:53.098427 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:26:53.098427 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:26:53.098427 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:26:53.098427 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:26:53.098427 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:26:53.098427 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:26:53.098427 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:26:53.098427 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:26:53.098427 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:26:53.098427 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:26:53.099576 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 15:26:53.099576 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 15:26:53.099576 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:26:53.099576 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:26:53.099576 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:26:53.099576 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:26:53.099576 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:26:53.099576 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:26:53.099576 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 605/1244] 10.222.0.118 () {56 vars in 1116 bytes} [Thu Jul 14 15:26:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:26:53.107445 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7284f8c-5c33-44f9-9fea-7b75d80cfeb8 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:53.240727 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7284f8c-5c33-44f9-9fea-7b75d80cfeb8 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:53.286874 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a96fe20-ee81-487b-8750-2f29b041e4bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:53.287580 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a96fe20-ee81-487b-8750-2f29b041e4bc None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:53.287856 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a96fe20-ee81-487b-8750-2f29b041e4bc None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:53.288216 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a96fe20-ee81-487b-8750-2f29b041e4bc None admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:53.289017 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a96fe20-ee81-487b-8750-2f29b041e4bc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:26:53.289324 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a96fe20-ee81-487b-8750-2f29b041e4bc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:53.291055 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a96fe20-ee81-487b-8750-2f29b041e4bc None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:53.307671 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 640/1245] 10.222.0.118 () {56 vars in 1153 bytes} [Thu Jul 14 15:26:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:26:53.314169 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a351bfb-ef72-4b63-8b89-4ec4318727f3 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:53.454511 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a351bfb-ef72-4b63-8b89-4ec4318727f3 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:53.512880 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd23950c-5a05-4ada-ad8f-8d356d4470df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:53.513791 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd23950c-5a05-4ada-ad8f-8d356d4470df None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:53.514147 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd23950c-5a05-4ada-ad8f-8d356d4470df None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:53.514392 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd23950c-5a05-4ada-ad8f-8d356d4470df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:53.516294 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd23950c-5a05-4ada-ad8f-8d356d4470df None admin] RBAC: Adding query filter params (role.id=3185f450429e4bb3b5f289b615f3269b, scope.project.id=939bf9541f4a4afe86550f749d337680, user.id=e70b0f8be7e04adca6e3f218fbe3a295) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:26:53.516648 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd23950c-5a05-4ada-ad8f-8d356d4470df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:53.518170 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd23950c-5a05-4ada-ad8f-8d356d4470df None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:53.524762 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 606/1246] 10.222.0.118 () {56 vars in 1379 bytes} [Thu Jul 14 15:26:53 2022] GET /identity/v3/role_assignments?user.id=e70b0f8be7e04adca6e3f218fbe3a295&scope.project.id=939bf9541f4a4afe86550f749d337680&role.id=3185f450429e4bb3b5f289b615f3269b => generated 610 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:26:55.974194 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c421c757-1484-4005-87bc-9b3f6c2c9dee None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:55.974753 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c421c757-1484-4005-87bc-9b3f6c2c9dee None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:55.974753 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c421c757-1484-4005-87bc-9b3f6c2c9dee None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:55.976041 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 641/1247] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:26:55 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:26:55.982591 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a93a89-a0bf-4e04-8110-82a1f5fe231f None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:55.983082 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a93a89-a0bf-4e04-8110-82a1f5fe231f None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:55.983195 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a93a89-a0bf-4e04-8110-82a1f5fe231f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:55.988790 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:56.004320 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-10a93a89-a0bf-4e04-8110-82a1f5fe231f None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:26:56.005560 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-10a93a89-a0bf-4e04-8110-82a1f5fe231f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:26:56.084425 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 607/1248] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:26:55 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:26:56.109324 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c421c757-1484-4005-87bc-9b3f6c2c9dee None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:56.131818 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:56.242783 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c421c757-1484-4005-87bc-9b3f6c2c9dee None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:56.288312 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793cbf74-c49e-47de-9bfe-0d62a1a5f705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:56.289223 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793cbf74-c49e-47de-9bfe-0d62a1a5f705 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:56.289534 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793cbf74-c49e-47de-9bfe-0d62a1a5f705 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:56.289878 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793cbf74-c49e-47de-9bfe-0d62a1a5f705 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:56.300898 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793cbf74-c49e-47de-9bfe-0d62a1a5f705 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:26:56.309844 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-793cbf74-c49e-47de-9bfe-0d62a1a5f705 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:26:56.309844 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:26:56.309844 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:26:56.309844 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:26:56.309844 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:26:56.309844 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:26:56.309844 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:26:56.309844 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:26:56.309844 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:26:56.309844 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:26:56.309844 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:26:56.309844 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:26:56.309844 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:26:56.309844 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:26:56.309844 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:26:56.309844 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:26:56.311159 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:26:56.311159 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:26:56.311159 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:26:56.311159 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:26:56.311159 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:26:56.311159 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:26:56.311159 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:26:56.311159 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:26:56.311159 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:26:56.311159 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:26:56.311159 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:26:56.311159 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:26:56.311159 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:26:56.311159 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:26:56.311159 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:26:56.311159 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:26:56.311994 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:26:56.311994 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:26:56.311994 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:26:56.311994 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:26:56.311994 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:26:56.311994 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:26:56.311994 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:26:56.311994 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:26:56.311994 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:26:56.311994 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:26:56.311994 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:26:56.311994 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:26:56.311994 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 642/1249] 10.222.0.118 () {56 vars in 1101 bytes} [Thu Jul 14 15:26:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:26:56.318224 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a93a89-a0bf-4e04-8110-82a1f5fe231f None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:56.443724 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a93a89-a0bf-4e04-8110-82a1f5fe231f None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:56.489669 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:56.497271 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9686329-4139-46a5-832c-23d785fffe2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:56.498186 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9686329-4139-46a5-832c-23d785fffe2d None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:56.498465 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9686329-4139-46a5-832c-23d785fffe2d None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:56.498764 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9686329-4139-46a5-832c-23d785fffe2d None admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:56.499594 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9686329-4139-46a5-832c-23d785fffe2d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:26:56.499932 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9686329-4139-46a5-832c-23d785fffe2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:56.501559 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9686329-4139-46a5-832c-23d785fffe2d None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:56.512274 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 608/1250] 10.222.0.118 () {56 vars in 1104 bytes} [Thu Jul 14 15:26:56 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:26:56.518405 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793cbf74-c49e-47de-9bfe-0d62a1a5f705 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:56.604523 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:56.633345 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793cbf74-c49e-47de-9bfe-0d62a1a5f705 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:56.673292 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa4e7c4-24bb-4a3d-8895-10cda5fcb4bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:56.674223 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa4e7c4-24bb-4a3d-8895-10cda5fcb4bc None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:56.674540 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa4e7c4-24bb-4a3d-8895-10cda5fcb4bc None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:56.674845 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa4e7c4-24bb-4a3d-8895-10cda5fcb4bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:56.688050 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa4e7c4-24bb-4a3d-8895-10cda5fcb4bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:56.689635 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa4e7c4-24bb-4a3d-8895-10cda5fcb4bc None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:56.707440 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-1aa4e7c4-24bb-4a3d-8895-10cda5fcb4bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:26:56.707440 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:26:56.707440 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:26:56.707440 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:26:56.707440 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:26:56.707440 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:26:56.707440 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:26:56.707440 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:26:56.707440 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:26:56.707440 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:26:56.707440 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:26:56.707440 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:26:56.707440 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:26:56.707440 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:26:56.707440 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:26:56.708372 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:26:56.708372 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:26:56.708372 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:26:56.708372 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:26:56.708372 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:26:56.708372 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:26:56.708372 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:26:56.708372 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:26:56.708372 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:26:56.708372 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:26:56.708372 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:26:56.708372 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:26:56.708372 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:26:56.708372 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:26:56.708372 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:26:56.708372 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:26:56.708372 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:26:56.709251 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:26:56.709251 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:26:56.709251 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:26:56.709251 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:26:56.709251 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 643/1251] 10.222.0.118 () {56 vars in 1113 bytes} [Thu Jul 14 15:26:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:26:56.714661 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9686329-4139-46a5-832c-23d785fffe2d None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:56.832255 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9686329-4139-46a5-832c-23d785fffe2d None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:56.877410 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32bb5e8-39a4-425d-9e71-f3f1061cacce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:56.878101 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32bb5e8-39a4-425d-9e71-f3f1061cacce None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:56.878380 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32bb5e8-39a4-425d-9e71-f3f1061cacce None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:56.878656 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32bb5e8-39a4-425d-9e71-f3f1061cacce None admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:56.879383 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32bb5e8-39a4-425d-9e71-f3f1061cacce None admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:26:56.879688 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32bb5e8-39a4-425d-9e71-f3f1061cacce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:56.881066 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32bb5e8-39a4-425d-9e71-f3f1061cacce None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:56.892966 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 609/1252] 10.222.0.118 () {56 vars in 1114 bytes} [Thu Jul 14 15:26:56 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:26:56.898694 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa4e7c4-24bb-4a3d-8895-10cda5fcb4bc None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:57.016055 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa4e7c4-24bb-4a3d-8895-10cda5fcb4bc None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:57.044524 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:57.052854 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e61cd06-8c4d-4833-be52-bde670775c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:57.053665 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e61cd06-8c4d-4833-be52-bde670775c42 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:57.053995 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e61cd06-8c4d-4833-be52-bde670775c42 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:57.054242 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e61cd06-8c4d-4833-be52-bde670775c42 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:57.062626 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e61cd06-8c4d-4833-be52-bde670775c42 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:57.064092 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e61cd06-8c4d-4833-be52-bde670775c42 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:57.086245 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-4e61cd06-8c4d-4833-be52-bde670775c42 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 14 15:26:57.086245 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:26:57.086245 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:26:57.086245 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:26:57.086245 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:26:57.086245 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:26:57.086245 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:26:57.086245 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:26:57.086245 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:26:57.086245 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:26:57.086245 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:26:57.086245 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:26:57.086245 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 15:26:57.086245 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 15:26:57.086245 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 15:26:57.086245 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 15:26:57.088321 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:26:57.088321 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:26:57.088321 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 15:26:57.088321 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:26:57.088321 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 15:26:57.088321 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:26:57.088321 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:26:57.088321 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:26:57.088321 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:26:57.088321 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:26:57.088321 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:26:57.088321 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:26:57.088321 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:26:57.088321 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:26:57.088321 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:26:57.088321 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:26:57.088321 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:26:57.088321 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:26:57.090394 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:26:57.090394 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:26:57.090394 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 15:26:57.090394 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 15:26:57.090394 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 15:26:57.090394 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 15:26:57.090394 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 15:26:57.090394 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 15:26:57.090394 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 14 15:26:57.090394 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:26:57.090394 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 644/1253] 10.222.0.118 () {56 vars in 1113 bytes} [Thu Jul 14 15:26:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:26:57.097120 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32bb5e8-39a4-425d-9e71-f3f1061cacce None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:57.156182 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:57.206103 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32bb5e8-39a4-425d-9e71-f3f1061cacce None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:57.242582 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac4db7d-8d1a-4374-95e3-b2fb3666faaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:57.243261 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac4db7d-8d1a-4374-95e3-b2fb3666faaf None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:57.243564 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac4db7d-8d1a-4374-95e3-b2fb3666faaf None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:57.243842 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac4db7d-8d1a-4374-95e3-b2fb3666faaf None admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:57.244809 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac4db7d-8d1a-4374-95e3-b2fb3666faaf None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:26:57.245121 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac4db7d-8d1a-4374-95e3-b2fb3666faaf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:57.246597 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac4db7d-8d1a-4374-95e3-b2fb3666faaf None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:57.265436 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 610/1254] 10.222.0.118 () {56 vars in 1148 bytes} [Thu Jul 14 15:26:57 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:26:57.271183 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e61cd06-8c4d-4833-be52-bde670775c42 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:57.382245 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e61cd06-8c4d-4833-be52-bde670775c42 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:57.421380 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d153d4b-e885-4615-b436-368599dd69a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:57.422196 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d153d4b-e885-4615-b436-368599dd69a9 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:57.422475 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d153d4b-e885-4615-b436-368599dd69a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:57.422728 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d153d4b-e885-4615-b436-368599dd69a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:57.492972 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:57.507519 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d153d4b-e885-4615-b436-368599dd69a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:57.509596 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d153d4b-e885-4615-b436-368599dd69a9 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:57.622073 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 645/1255] 10.222.0.118 () {58 vars in 1287 bytes} [Thu Jul 14 15:26:57 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 15:26:57.628729 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac4db7d-8d1a-4374-95e3-b2fb3666faaf None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:57.735684 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac4db7d-8d1a-4374-95e3-b2fb3666faaf None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:57.750703 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:57.775391 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18567156-232a-4186-8bec-29e5673537f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:57.776191 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18567156-232a-4186-8bec-29e5673537f7 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:57.776466 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18567156-232a-4186-8bec-29e5673537f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:57.776733 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18567156-232a-4186-8bec-29e5673537f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:57.787434 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18567156-232a-4186-8bec-29e5673537f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:57.788879 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18567156-232a-4186-8bec-29e5673537f7 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:57.809191 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-18567156-232a-4186-8bec-29e5673537f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:26:57.809191 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:26:57.809191 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:26:57.809191 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:26:57.809191 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:26:57.809191 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:26:57.809191 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:26:57.809191 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:26:57.809191 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:26:57.809191 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:26:57.809191 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:26:57.809191 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:26:57.809191 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:26:57.809191 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:26:57.809191 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:26:57.810346 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:26:57.810346 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:26:57.810346 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:26:57.810346 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:26:57.810346 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:26:57.810346 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:26:57.810346 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:26:57.810346 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:26:57.810346 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:26:57.810346 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:26:57.810346 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:26:57.810346 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:26:57.810346 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:26:57.810346 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:26:57.810346 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:26:57.810346 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:26:57.810346 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:26:57.811503 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:26:57.811503 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:26:57.811503 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:26:57.811503 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:26:57.811503 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 611/1256] 10.222.0.118 () {56 vars in 1113 bytes} [Thu Jul 14 15:26:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:26:57.816947 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d153d4b-e885-4615-b436-368599dd69a9 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:57.914876 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:57.930353 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d153d4b-e885-4615-b436-368599dd69a9 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:57.974316 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f20f09a-53a6-4cfe-875a-a8ee93c2434b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:57.975017 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f20f09a-53a6-4cfe-875a-a8ee93c2434b None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:57.975439 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f20f09a-53a6-4cfe-875a-a8ee93c2434b None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:57.975757 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f20f09a-53a6-4cfe-875a-a8ee93c2434b None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:57.976614 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f20f09a-53a6-4cfe-875a-a8ee93c2434b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:26:57.976918 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f20f09a-53a6-4cfe-875a-a8ee93c2434b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:57.978646 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f20f09a-53a6-4cfe-875a-a8ee93c2434b None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:57.992583 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 646/1257] 10.222.0.118 () {56 vars in 1114 bytes} [Thu Jul 14 15:26:57 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:26:57.998955 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18567156-232a-4186-8bec-29e5673537f7 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:58.116893 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18567156-232a-4186-8bec-29e5673537f7 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:58.154962 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35709af-9f0f-4284-abdd-ef59b6909f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:58.155822 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35709af-9f0f-4284-abdd-ef59b6909f35 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:58.156140 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35709af-9f0f-4284-abdd-ef59b6909f35 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:58.156428 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35709af-9f0f-4284-abdd-ef59b6909f35 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:58.163986 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35709af-9f0f-4284-abdd-ef59b6909f35 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:58.165943 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35709af-9f0f-4284-abdd-ef59b6909f35 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:58.181264 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-b35709af-9f0f-4284-abdd-ef59b6909f35 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:26:58.181264 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:26:58.181264 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:26:58.181264 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:26:58.181264 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:26:58.181264 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:26:58.181264 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:26:58.181264 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:26:58.181264 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:26:58.181264 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:26:58.181264 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:26:58.181264 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:26:58.181264 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 15:26:58.181264 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 15:26:58.181264 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 15:26:58.183154 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 15:26:58.183154 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:26:58.183154 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:26:58.183154 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:26:58.183154 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:26:58.183154 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:26:58.183154 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:26:58.183154 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:26:58.183154 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:26:58.183154 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:26:58.183154 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:26:58.183154 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:26:58.183154 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:26:58.183154 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:26:58.183154 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:26:58.183154 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:26:58.183154 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:26:58.184227 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 15:26:58.184227 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 15:26:58.184227 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:26:58.184227 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:26:58.184227 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:26:58.184227 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:26:58.184227 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:26:58.184227 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:26:58.184227 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 612/1258] 10.222.0.118 () {56 vars in 1116 bytes} [Thu Jul 14 15:26:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:26:58.189821 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f20f09a-53a6-4cfe-875a-a8ee93c2434b None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:58.298009 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f20f09a-53a6-4cfe-875a-a8ee93c2434b None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:58.332346 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1037c3-02bb-4aa5-909a-39106c168c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:58.333023 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1037c3-02bb-4aa5-909a-39106c168c7b None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:58.333300 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1037c3-02bb-4aa5-909a-39106c168c7b None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:58.333572 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1037c3-02bb-4aa5-909a-39106c168c7b None admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:58.334415 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1037c3-02bb-4aa5-909a-39106c168c7b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:26:58.334723 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1037c3-02bb-4aa5-909a-39106c168c7b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:58.336216 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1037c3-02bb-4aa5-909a-39106c168c7b None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:58.350206 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 647/1259] 10.222.0.118 () {56 vars in 1153 bytes} [Thu Jul 14 15:26:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:26:58.357050 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35709af-9f0f-4284-abdd-ef59b6909f35 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:58.384824 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:58.473251 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35709af-9f0f-4284-abdd-ef59b6909f35 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:58.509916 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce33720-06de-462f-ae10-144680b3cd72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:58.510610 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce33720-06de-462f-ae10-144680b3cd72 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:58.510888 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce33720-06de-462f-ae10-144680b3cd72 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:58.511161 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce33720-06de-462f-ae10-144680b3cd72 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:58.512006 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce33720-06de-462f-ae10-144680b3cd72 None admin] RBAC: Adding query filter params (role.id=3b880cef7dcf4baf87b50f8610c0c56e, scope.project.id=939bf9541f4a4afe86550f749d337680, user.id=e70b0f8be7e04adca6e3f218fbe3a295) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:26:58.512317 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce33720-06de-462f-ae10-144680b3cd72 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:58.513769 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce33720-06de-462f-ae10-144680b3cd72 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:58.520045 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 613/1260] 10.222.0.118 () {56 vars in 1379 bytes} [Thu Jul 14 15:26:58 2022] GET /identity/v3/role_assignments?user.id=e70b0f8be7e04adca6e3f218fbe3a295&scope.project.id=939bf9541f4a4afe86550f749d337680&role.id=3b880cef7dcf4baf87b50f8610c0c56e => generated 260 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:27:00.548753 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c32beb-4199-4ad4-9b10-33d644987652 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:00.549315 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c32beb-4199-4ad4-9b10-33d644987652 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:00.549315 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c32beb-4199-4ad4-9b10-33d644987652 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:00.550699 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 648/1261] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:27:00 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:27:00.556657 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338b69df-13ec-414b-9afe-53a321ba4ea8 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:00.557061 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338b69df-13ec-414b-9afe-53a321ba4ea8 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:00.557200 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338b69df-13ec-414b-9afe-53a321ba4ea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:00.573586 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-338b69df-13ec-414b-9afe-53a321ba4ea8 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:27:00.574816 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-338b69df-13ec-414b-9afe-53a321ba4ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:27:00.639511 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 614/1262] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:27:00 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:27:00.662752 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c32beb-4199-4ad4-9b10-33d644987652 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:00.674077 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:00.764429 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c32beb-4199-4ad4-9b10-33d644987652 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:00.796326 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d29b99-41ae-4ea7-b763-0d9566d8b2e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:00.797094 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d29b99-41ae-4ea7-b763-0d9566d8b2e1 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:00.797366 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d29b99-41ae-4ea7-b763-0d9566d8b2e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:00.797631 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d29b99-41ae-4ea7-b763-0d9566d8b2e1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:00.807805 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d29b99-41ae-4ea7-b763-0d9566d8b2e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:27:00.815168 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-95d29b99-41ae-4ea7-b763-0d9566d8b2e1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:27:00.815168 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:27:00.815168 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:27:00.815168 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:27:00.815168 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:27:00.815168 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:27:00.815168 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:27:00.815168 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:27:00.815168 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:27:00.815168 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:27:00.815168 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:27:00.815168 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:27:00.815168 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:27:00.815168 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:27:00.815168 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:27:00.815168 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:27:00.816093 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:27:00.816093 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:27:00.816093 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:27:00.816093 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:27:00.816093 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:27:00.816093 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:27:00.816093 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:27:00.816093 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:27:00.816093 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:27:00.816093 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:27:00.816093 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:27:00.816093 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:27:00.816093 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:27:00.816093 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:27:00.816093 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:27:00.816093 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:27:00.816929 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:27:00.816929 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:27:00.816929 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:27:00.816929 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:27:00.816929 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:27:00.816929 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:27:00.816929 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:27:00.816929 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:27:00.816929 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:27:00.816929 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:27:00.816929 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:27:00.816929 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:27:00.816929 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 649/1263] 10.222.0.118 () {56 vars in 1101 bytes} [Thu Jul 14 15:27:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:27:00.823078 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338b69df-13ec-414b-9afe-53a321ba4ea8 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:00.840694 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:00.918300 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338b69df-13ec-414b-9afe-53a321ba4ea8 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:00.952361 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845d12e5-e15b-447c-bcff-3e181980492b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:00.953013 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845d12e5-e15b-447c-bcff-3e181980492b None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:00.953294 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845d12e5-e15b-447c-bcff-3e181980492b None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:00.953566 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845d12e5-e15b-447c-bcff-3e181980492b None admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:00.954340 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845d12e5-e15b-447c-bcff-3e181980492b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:27:00.954649 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845d12e5-e15b-447c-bcff-3e181980492b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:00.956014 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845d12e5-e15b-447c-bcff-3e181980492b None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:00.964042 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 615/1264] 10.222.0.118 () {56 vars in 1104 bytes} [Thu Jul 14 15:27:00 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:27:00.969687 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d29b99-41ae-4ea7-b763-0d9566d8b2e1 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:01.033988 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:01.067123 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d29b99-41ae-4ea7-b763-0d9566d8b2e1 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:01.099394 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb27172-f2d1-4103-b296-587a3bffdd3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:01.100170 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb27172-f2d1-4103-b296-587a3bffdd3c None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:01.100443 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb27172-f2d1-4103-b296-587a3bffdd3c None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:01.100711 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb27172-f2d1-4103-b296-587a3bffdd3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:01.111728 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb27172-f2d1-4103-b296-587a3bffdd3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:01.113149 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb27172-f2d1-4103-b296-587a3bffdd3c None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:01.130420 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-0cb27172-f2d1-4103-b296-587a3bffdd3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:27:01.130420 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:27:01.130420 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:27:01.130420 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:27:01.130420 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:27:01.130420 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:27:01.130420 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:27:01.130420 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:27:01.130420 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:27:01.130420 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:27:01.130420 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:27:01.130420 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:27:01.130420 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:27:01.130420 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:27:01.130420 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:27:01.131478 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:27:01.131478 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:27:01.131478 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:27:01.131478 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:27:01.131478 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:27:01.131478 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:27:01.131478 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:27:01.131478 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:27:01.131478 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:27:01.131478 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:27:01.131478 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:27:01.131478 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:27:01.131478 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:27:01.131478 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:27:01.131478 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:27:01.131478 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:27:01.131478 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:27:01.132566 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:27:01.132566 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:27:01.132566 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:27:01.132566 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:27:01.132566 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 650/1265] 10.222.0.118 () {56 vars in 1113 bytes} [Thu Jul 14 15:27:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:27:01.137431 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845d12e5-e15b-447c-bcff-3e181980492b None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:01.215684 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:01.234533 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845d12e5-e15b-447c-bcff-3e181980492b None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:01.266898 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae37a546-4c2f-4932-afe4-d86183757873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:01.267551 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae37a546-4c2f-4932-afe4-d86183757873 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:01.267826 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae37a546-4c2f-4932-afe4-d86183757873 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:01.268093 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae37a546-4c2f-4932-afe4-d86183757873 None admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:01.268801 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae37a546-4c2f-4932-afe4-d86183757873 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:27:01.269103 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae37a546-4c2f-4932-afe4-d86183757873 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:01.270511 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae37a546-4c2f-4932-afe4-d86183757873 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:01.281813 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 616/1266] 10.222.0.118 () {56 vars in 1114 bytes} [Thu Jul 14 15:27:01 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:27:01.287577 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb27172-f2d1-4103-b296-587a3bffdd3c None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:01.385033 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb27172-f2d1-4103-b296-587a3bffdd3c None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:01.404024 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:01.419415 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4562ace9-0afb-4c77-9530-6ff59f3e23bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:01.420333 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4562ace9-0afb-4c77-9530-6ff59f3e23bd None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:01.420702 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4562ace9-0afb-4c77-9530-6ff59f3e23bd None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:01.421036 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4562ace9-0afb-4c77-9530-6ff59f3e23bd None admin] PATH_INFO: `/v3/users/placement` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:01.431306 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4562ace9-0afb-4c77-9530-6ff59f3e23bd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:01.432966 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4562ace9-0afb-4c77-9530-6ff59f3e23bd None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:01.449937 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-4562ace9-0afb-4c77-9530-6ff59f3e23bd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 14 15:27:01.449937 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:27:01.449937 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:27:01.449937 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:27:01.449937 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:27:01.449937 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:27:01.449937 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:27:01.449937 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:27:01.449937 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:27:01.449937 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:27:01.449937 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:27:01.449937 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:27:01.449937 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 15:27:01.449937 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 15:27:01.449937 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 15:27:01.449937 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 15:27:01.451257 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:27:01.451257 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:27:01.451257 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 15:27:01.451257 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:27:01.451257 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 15:27:01.451257 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:27:01.451257 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:27:01.451257 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:27:01.451257 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:27:01.451257 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:27:01.451257 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:27:01.451257 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:27:01.451257 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:27:01.451257 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:27:01.451257 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:27:01.451257 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:27:01.451257 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:27:01.451257 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:27:01.452728 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:27:01.452728 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:27:01.452728 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 15:27:01.452728 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 15:27:01.452728 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 15:27:01.452728 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 15:27:01.452728 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 15:27:01.452728 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 15:27:01.452728 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 14 15:27:01.452728 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:27:01.452728 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 651/1267] 10.222.0.118 () {56 vars in 1113 bytes} [Thu Jul 14 15:27:01 2022] GET /identity/v3/users/placement => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:27:01.457334 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae37a546-4c2f-4932-afe4-d86183757873 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:01.565414 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae37a546-4c2f-4932-afe4-d86183757873 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:01.598677 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af6477c-8e26-4d22-a72c-acd35233dcae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:01.599339 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af6477c-8e26-4d22-a72c-acd35233dcae None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:01.599619 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af6477c-8e26-4d22-a72c-acd35233dcae None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:01.599890 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af6477c-8e26-4d22-a72c-acd35233dcae None admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:01.600719 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af6477c-8e26-4d22-a72c-acd35233dcae None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:27:01.601028 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af6477c-8e26-4d22-a72c-acd35233dcae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:01.603136 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af6477c-8e26-4d22-a72c-acd35233dcae None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:01.611585 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:01.620134 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 617/1268] 10.222.0.118 () {56 vars in 1148 bytes} [Thu Jul 14 15:27:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:27:01.625783 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4562ace9-0afb-4c77-9530-6ff59f3e23bd None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:01.722849 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4562ace9-0afb-4c77-9530-6ff59f3e23bd None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:01.755285 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f669699-9a0a-4959-9a08-d7bce71502e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:01.756059 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f669699-9a0a-4959-9a08-d7bce71502e9 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:01.756332 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f669699-9a0a-4959-9a08-d7bce71502e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:01.756598 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f669699-9a0a-4959-9a08-d7bce71502e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:01.767307 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f669699-9a0a-4959-9a08-d7bce71502e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:01.768737 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f669699-9a0a-4959-9a08-d7bce71502e9 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:01.785748 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-6f669699-9a0a-4959-9a08-d7bce71502e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:27:01.785748 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:27:01.785748 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:27:01.785748 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:27:01.785748 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:27:01.785748 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:27:01.785748 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:27:01.785748 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:27:01.785748 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:27:01.785748 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:27:01.785748 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:27:01.785748 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:27:01.785748 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:27:01.785748 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:27:01.785748 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:27:01.786826 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:27:01.786826 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:27:01.786826 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:27:01.786826 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:27:01.786826 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:27:01.786826 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:27:01.786826 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:27:01.786826 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:27:01.786826 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:27:01.786826 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:27:01.786826 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:27:01.786826 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:27:01.786826 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:27:01.786826 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:27:01.786826 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:27:01.786826 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:27:01.786826 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:27:01.788091 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:27:01.788091 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:27:01.788091 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:27:01.788091 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:27:01.788091 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 652/1269] 10.222.0.118 () {56 vars in 1113 bytes} [Thu Jul 14 15:27:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:27:01.792664 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af6477c-8e26-4d22-a72c-acd35233dcae None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:01.889638 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af6477c-8e26-4d22-a72c-acd35233dcae None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:01.923113 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c18a9a-29ab-458f-a9c1-ca09e984278a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:01.923768 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c18a9a-29ab-458f-a9c1-ca09e984278a None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:01.924046 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c18a9a-29ab-458f-a9c1-ca09e984278a None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:01.924318 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c18a9a-29ab-458f-a9c1-ca09e984278a None admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:01.925031 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c18a9a-29ab-458f-a9c1-ca09e984278a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:27:01.925333 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c18a9a-29ab-458f-a9c1-ca09e984278a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:01.926723 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c18a9a-29ab-458f-a9c1-ca09e984278a None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:01.937820 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 618/1270] 10.222.0.118 () {56 vars in 1114 bytes} [Thu Jul 14 15:27:01 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:27:01.943379 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f669699-9a0a-4959-9a08-d7bce71502e9 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:01.974582 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:02.040546 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f669699-9a0a-4959-9a08-d7bce71502e9 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:02.072360 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7a32fe-1db2-451f-8080-873dbc4afb7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:02.073127 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7a32fe-1db2-451f-8080-873dbc4afb7c None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:02.073402 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7a32fe-1db2-451f-8080-873dbc4afb7c None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:02.073669 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7a32fe-1db2-451f-8080-873dbc4afb7c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:02.080086 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7a32fe-1db2-451f-8080-873dbc4afb7c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:02.081510 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7a32fe-1db2-451f-8080-873dbc4afb7c None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:02.095736 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-7c7a32fe-1db2-451f-8080-873dbc4afb7c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:27:02.095736 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:27:02.095736 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:27:02.095736 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:27:02.095736 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:27:02.095736 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:27:02.095736 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:27:02.095736 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:27:02.095736 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:27:02.095736 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:27:02.095736 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:27:02.095736 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:27:02.095736 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 15:27:02.095736 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 15:27:02.095736 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 15:27:02.096744 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 15:27:02.096744 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:27:02.096744 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:27:02.096744 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:27:02.096744 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:27:02.096744 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:27:02.096744 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:27:02.096744 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:27:02.096744 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:27:02.096744 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:27:02.096744 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:27:02.096744 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:27:02.096744 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:27:02.096744 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:27:02.096744 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:27:02.096744 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:27:02.096744 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:27:02.097657 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 15:27:02.097657 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 15:27:02.097657 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:27:02.097657 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:27:02.097657 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:27:02.097657 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:27:02.097657 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:27:02.097657 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:27:02.097657 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 653/1271] 10.222.0.118 () {56 vars in 1116 bytes} [Thu Jul 14 15:27:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:27:02.102800 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c18a9a-29ab-458f-a9c1-ca09e984278a None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:02.160065 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:02.202346 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c18a9a-29ab-458f-a9c1-ca09e984278a None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:02.234454 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b240b415-dfd2-4821-b81d-3eb1153f4106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:02.235049 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b240b415-dfd2-4821-b81d-3eb1153f4106 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:02.235330 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b240b415-dfd2-4821-b81d-3eb1153f4106 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:02.235603 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b240b415-dfd2-4821-b81d-3eb1153f4106 None admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:02.236383 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b240b415-dfd2-4821-b81d-3eb1153f4106 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:27:02.236693 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b240b415-dfd2-4821-b81d-3eb1153f4106 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:02.238148 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b240b415-dfd2-4821-b81d-3eb1153f4106 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:02.250308 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 619/1272] 10.222.0.118 () {56 vars in 1153 bytes} [Thu Jul 14 15:27:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:27:02.256575 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7a32fe-1db2-451f-8080-873dbc4afb7c None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:02.345056 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:02.354331 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7a32fe-1db2-451f-8080-873dbc4afb7c None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:02.388823 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a147fe-1bba-4ad2-8ba2-18528489b6d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:02.389697 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a147fe-1bba-4ad2-8ba2-18528489b6d9 None admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:02.389987 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a147fe-1bba-4ad2-8ba2-18528489b6d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:02.390265 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a147fe-1bba-4ad2-8ba2-18528489b6d9 None admin] PATH_INFO: `/v3/projects/939bf9541f4a4afe86550f749d337680/users/e70b0f8be7e04adca6e3f218fbe3a295/roles/3b880cef7dcf4baf87b50f8610c0c56e` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:02.392215 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a147fe-1bba-4ad2-8ba2-18528489b6d9 None admin] RBAC: Authorizing `identity:create_grant(project_id=939bf9541f4a4afe86550f749d337680, user_id=e70b0f8be7e04adca6e3f218fbe3a295, role_id=3b880cef7dcf4baf87b50f8610c0c56e)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:02.393639 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a147fe-1bba-4ad2-8ba2-18528489b6d9 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:02.406605 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 654/1273] 10.222.0.118 () {58 vars in 1444 bytes} [Thu Jul 14 15:27:02 2022] PUT /identity/v3/projects/939bf9541f4a4afe86550f749d337680/users/e70b0f8be7e04adca6e3f218fbe3a295/roles/3b880cef7dcf4baf87b50f8610c0c56e => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:27:04.459546 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa61114d-2e57-4b4c-b09e-68b168c997e0 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:04.460081 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa61114d-2e57-4b4c-b09e-68b168c997e0 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:04.460081 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa61114d-2e57-4b4c-b09e-68b168c997e0 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:04.461447 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 620/1274] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:27:04 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:27:04.467188 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261959b1-4965-4a3e-835c-5e8c79154fdf None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:04.467569 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261959b1-4965-4a3e-835c-5e8c79154fdf None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:04.467742 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261959b1-4965-4a3e-835c-5e8c79154fdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:04.484989 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-261959b1-4965-4a3e-835c-5e8c79154fdf None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:27:04.486211 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-261959b1-4965-4a3e-835c-5e8c79154fdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:27:04.551339 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 655/1275] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:27:04 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:27:04.574613 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa61114d-2e57-4b4c-b09e-68b168c997e0 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:04.674022 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa61114d-2e57-4b4c-b09e-68b168c997e0 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:04.690612 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:04.707313 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daf869f-3f63-44df-b351-9ae08113e27d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:04.708098 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daf869f-3f63-44df-b351-9ae08113e27d None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:04.708379 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daf869f-3f63-44df-b351-9ae08113e27d None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:04.708648 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daf869f-3f63-44df-b351-9ae08113e27d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:04.719264 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daf869f-3f63-44df-b351-9ae08113e27d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:27:04.726580 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-3daf869f-3f63-44df-b351-9ae08113e27d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:27:04.726580 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:27:04.726580 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:27:04.726580 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:27:04.726580 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:27:04.726580 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:27:04.726580 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:27:04.726580 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:27:04.726580 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:27:04.726580 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:27:04.726580 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:27:04.726580 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:27:04.726580 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:27:04.726580 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:27:04.726580 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:27:04.726580 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:27:04.728351 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:27:04.728351 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:27:04.728351 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:27:04.728351 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:27:04.728351 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:27:04.728351 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:27:04.728351 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:27:04.728351 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:27:04.728351 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:27:04.728351 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:27:04.728351 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:27:04.728351 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:27:04.728351 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:27:04.728351 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:27:04.728351 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:27:04.728351 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:27:04.729364 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:27:04.729364 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:27:04.729364 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:27:04.729364 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:27:04.729364 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:27:04.729364 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:27:04.729364 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:27:04.729364 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:27:04.729364 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:27:04.729364 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:27:04.729364 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:27:04.729364 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:27:04.729364 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 621/1276] 10.222.0.118 () {56 vars in 1101 bytes} [Thu Jul 14 15:27:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:27:04.734506 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261959b1-4965-4a3e-835c-5e8c79154fdf None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:04.811915 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:04.830379 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261959b1-4965-4a3e-835c-5e8c79154fdf None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:04.863628 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80c98ae-5a63-4dd3-b00b-df8bb4be8c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:04.864272 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80c98ae-5a63-4dd3-b00b-df8bb4be8c29 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:04.864551 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80c98ae-5a63-4dd3-b00b-df8bb4be8c29 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:04.864822 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80c98ae-5a63-4dd3-b00b-df8bb4be8c29 None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:04.865558 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80c98ae-5a63-4dd3-b00b-df8bb4be8c29 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:27:04.865862 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80c98ae-5a63-4dd3-b00b-df8bb4be8c29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:04.867241 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80c98ae-5a63-4dd3-b00b-df8bb4be8c29 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:04.875135 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 656/1277] 10.222.0.118 () {56 vars in 1104 bytes} [Thu Jul 14 15:27:04 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:27:04.881267 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daf869f-3f63-44df-b351-9ae08113e27d None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:04.986310 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daf869f-3f63-44df-b351-9ae08113e27d None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:05.018952 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb478f6-c12e-40cb-b2a0-7c0e5bd3d268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:05.019743 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb478f6-c12e-40cb-b2a0-7c0e5bd3d268 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:05.020022 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb478f6-c12e-40cb-b2a0-7c0e5bd3d268 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:05.020300 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb478f6-c12e-40cb-b2a0-7c0e5bd3d268 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:05.031111 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb478f6-c12e-40cb-b2a0-7c0e5bd3d268 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:05.032554 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb478f6-c12e-40cb-b2a0-7c0e5bd3d268 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:05.048915 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-3bb478f6-c12e-40cb-b2a0-7c0e5bd3d268 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:27:05.048915 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:27:05.048915 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:27:05.048915 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:27:05.048915 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:27:05.048915 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:27:05.048915 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:27:05.048915 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:27:05.048915 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:27:05.048915 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:27:05.048915 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:27:05.048915 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:27:05.048915 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:27:05.048915 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:27:05.048915 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:27:05.049940 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:27:05.049940 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:27:05.049940 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:27:05.049940 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:27:05.049940 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:27:05.049940 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:27:05.049940 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:27:05.049940 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:27:05.049940 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:27:05.049940 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:27:05.049940 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:27:05.049940 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:27:05.049940 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:27:05.049940 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:27:05.049940 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:27:05.049940 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:27:05.049940 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:27:05.050972 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:27:05.050972 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:27:05.050972 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:27:05.050972 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:27:05.050972 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 622/1278] 10.222.0.118 () {56 vars in 1113 bytes} [Thu Jul 14 15:27:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:27:05.055866 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80c98ae-5a63-4dd3-b00b-df8bb4be8c29 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:05.154857 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80c98ae-5a63-4dd3-b00b-df8bb4be8c29 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:05.187354 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be849b5b-b059-4754-9093-0f4102af1b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:05.188007 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be849b5b-b059-4754-9093-0f4102af1b54 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:05.188288 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be849b5b-b059-4754-9093-0f4102af1b54 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:05.188563 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be849b5b-b059-4754-9093-0f4102af1b54 None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:05.189280 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be849b5b-b059-4754-9093-0f4102af1b54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:27:05.189583 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be849b5b-b059-4754-9093-0f4102af1b54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:05.190978 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be849b5b-b059-4754-9093-0f4102af1b54 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:05.203252 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 657/1279] 10.222.0.118 () {56 vars in 1114 bytes} [Thu Jul 14 15:27:05 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:27:05.208899 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb478f6-c12e-40cb-b2a0-7c0e5bd3d268 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:05.238802 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:05.309615 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb478f6-c12e-40cb-b2a0-7c0e5bd3d268 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:05.342074 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d04b12-1139-4d8c-b565-236df49d8ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:05.342867 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d04b12-1139-4d8c-b565-236df49d8ff9 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:05.343145 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d04b12-1139-4d8c-b565-236df49d8ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:05.343419 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d04b12-1139-4d8c-b565-236df49d8ff9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:05.350721 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d04b12-1139-4d8c-b565-236df49d8ff9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:05.352152 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d04b12-1139-4d8c-b565-236df49d8ff9 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:05.366061 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-02d04b12-1139-4d8c-b565-236df49d8ff9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 14 15:27:05.366061 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:27:05.366061 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:27:05.366061 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:27:05.366061 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:27:05.366061 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:27:05.366061 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:27:05.366061 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:27:05.366061 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:27:05.366061 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:27:05.366061 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:27:05.366061 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:27:05.366061 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 15:27:05.366061 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 15:27:05.366061 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 15:27:05.366061 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 15:27:05.367160 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:27:05.367160 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:27:05.367160 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 15:27:05.367160 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:27:05.367160 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 15:27:05.367160 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:27:05.367160 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:27:05.367160 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:27:05.367160 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:27:05.367160 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:27:05.367160 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:27:05.367160 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:27:05.367160 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:27:05.367160 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:27:05.367160 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:27:05.367160 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:27:05.367160 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:27:05.367160 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:27:05.368810 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:27:05.368810 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:27:05.368810 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 15:27:05.368810 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 15:27:05.368810 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 15:27:05.368810 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 15:27:05.368810 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 15:27:05.368810 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 15:27:05.368810 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 14 15:27:05.368810 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:27:05.368810 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 623/1280] 10.222.0.118 () {56 vars in 1113 bytes} [Thu Jul 14 15:27:05 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:27:05.373563 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be849b5b-b059-4754-9093-0f4102af1b54 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:05.377612 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:05.481558 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be849b5b-b059-4754-9093-0f4102af1b54 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:05.520901 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ec0ecb-1fa5-45ba-a783-2a6dd2f5710d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:05.521488 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec0ecb-1fa5-45ba-a783-2a6dd2f5710d None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:05.521765 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec0ecb-1fa5-45ba-a783-2a6dd2f5710d None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:05.522062 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec0ecb-1fa5-45ba-a783-2a6dd2f5710d None admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:05.522903 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ec0ecb-1fa5-45ba-a783-2a6dd2f5710d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:27:05.523208 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ec0ecb-1fa5-45ba-a783-2a6dd2f5710d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:05.524690 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ec0ecb-1fa5-45ba-a783-2a6dd2f5710d None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:05.543101 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 658/1281] 10.222.0.118 () {56 vars in 1148 bytes} [Thu Jul 14 15:27:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:27:05.549100 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d04b12-1139-4d8c-b565-236df49d8ff9 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:05.642647 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:05.651991 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d04b12-1139-4d8c-b565-236df49d8ff9 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:05.686376 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea4a4e7-ae5a-4b59-b202-b95db5a3ded2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:05.687015 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea4a4e7-ae5a-4b59-b202-b95db5a3ded2 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:05.687299 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea4a4e7-ae5a-4b59-b202-b95db5a3ded2 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:05.687575 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea4a4e7-ae5a-4b59-b202-b95db5a3ded2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:05.755941 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea4a4e7-ae5a-4b59-b202-b95db5a3ded2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:05.757398 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea4a4e7-ae5a-4b59-b202-b95db5a3ded2 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:05.844342 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:05.855528 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 624/1282] 10.222.0.118 () {58 vars in 1287 bytes} [Thu Jul 14 15:27:05 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 15:27:05.861462 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ec0ecb-1fa5-45ba-a783-2a6dd2f5710d None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:05.921897 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:05.959449 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ec0ecb-1fa5-45ba-a783-2a6dd2f5710d None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:05.992537 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c2d407-f85b-4a39-b1bc-f3767053764d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:05.993339 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c2d407-f85b-4a39-b1bc-f3767053764d None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:05.993616 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c2d407-f85b-4a39-b1bc-f3767053764d None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:05.993887 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c2d407-f85b-4a39-b1bc-f3767053764d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:06.003910 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c2d407-f85b-4a39-b1bc-f3767053764d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:06.005342 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c2d407-f85b-4a39-b1bc-f3767053764d None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:06.022289 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-03c2d407-f85b-4a39-b1bc-f3767053764d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:27:06.022289 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:27:06.022289 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:27:06.022289 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:27:06.022289 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:27:06.022289 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:27:06.022289 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:27:06.022289 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:27:06.022289 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:27:06.022289 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:27:06.022289 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:27:06.022289 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:27:06.022289 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:27:06.022289 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:27:06.022289 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:27:06.023419 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:27:06.023419 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:27:06.023419 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:27:06.023419 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:27:06.023419 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:27:06.023419 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:27:06.023419 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:27:06.023419 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:27:06.023419 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:27:06.023419 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:27:06.023419 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:27:06.023419 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:27:06.023419 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:27:06.023419 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:27:06.023419 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:27:06.023419 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:27:06.023419 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:27:06.025117 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:27:06.025117 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:27:06.025117 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:27:06.025117 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:27:06.025117 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 659/1283] 10.222.0.118 () {56 vars in 1113 bytes} [Thu Jul 14 15:27:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:27:06.029869 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea4a4e7-ae5a-4b59-b202-b95db5a3ded2 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:06.129445 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea4a4e7-ae5a-4b59-b202-b95db5a3ded2 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:06.163245 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d4760b-a3a1-4415-9b26-067c52e5b1a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:06.164174 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d4760b-a3a1-4415-9b26-067c52e5b1a2 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:06.164455 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d4760b-a3a1-4415-9b26-067c52e5b1a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:06.164827 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d4760b-a3a1-4415-9b26-067c52e5b1a2 None admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:06.166207 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d4760b-a3a1-4415-9b26-067c52e5b1a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:27:06.166525 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d4760b-a3a1-4415-9b26-067c52e5b1a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:06.167902 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d4760b-a3a1-4415-9b26-067c52e5b1a2 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:06.178749 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 625/1284] 10.222.0.118 () {56 vars in 1114 bytes} [Thu Jul 14 15:27:06 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:27:06.184536 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c2d407-f85b-4a39-b1bc-f3767053764d None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:06.282057 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c2d407-f85b-4a39-b1bc-f3767053764d None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:06.295406 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:06.315015 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3906150-3f27-4d47-a685-d7b3978769c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:06.315794 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3906150-3f27-4d47-a685-d7b3978769c9 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:06.316071 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3906150-3f27-4d47-a685-d7b3978769c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:06.316345 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3906150-3f27-4d47-a685-d7b3978769c9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:06.323376 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3906150-3f27-4d47-a685-d7b3978769c9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:06.324811 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3906150-3f27-4d47-a685-d7b3978769c9 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:06.338696 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-f3906150-3f27-4d47-a685-d7b3978769c9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:27:06.338696 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:27:06.338696 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:27:06.338696 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:27:06.338696 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:27:06.338696 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:27:06.338696 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:27:06.338696 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:27:06.338696 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:27:06.338696 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:27:06.338696 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:27:06.338696 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:27:06.338696 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 15:27:06.338696 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 15:27:06.338696 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 15:27:06.339751 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 15:27:06.339751 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:27:06.339751 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:27:06.339751 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:27:06.339751 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:27:06.339751 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:27:06.339751 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:27:06.339751 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:27:06.339751 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( Jul 14 15:27:06.339751 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:27:06.339751 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:27:06.339751 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:27:06.339751 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:27:06.339751 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:27:06.339751 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:27:06.339751 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:27:06.339751 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:27:06.341049 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 15:27:06.341049 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 15:27:06.341049 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:27:06.341049 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:27:06.341049 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:27:06.341049 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:27:06.341049 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:27:06.341049 dv-cinder-826510-8-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Jul 14 15:27:06.341049 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 660/1285] 10.222.0.118 () {56 vars in 1116 bytes} [Thu Jul 14 15:27:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:27:06.345677 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d4760b-a3a1-4415-9b26-067c52e5b1a2 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:06.393949 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:06.444616 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d4760b-a3a1-4415-9b26-067c52e5b1a2 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:06.477329 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d621580-90e6-4a92-ad93-b01cbc351c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:06.477989 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d621580-90e6-4a92-ad93-b01cbc351c56 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:06.478277 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d621580-90e6-4a92-ad93-b01cbc351c56 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:06.478546 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d621580-90e6-4a92-ad93-b01cbc351c56 None admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:06.479317 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d621580-90e6-4a92-ad93-b01cbc351c56 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:27:06.479620 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d621580-90e6-4a92-ad93-b01cbc351c56 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:06.481032 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d621580-90e6-4a92-ad93-b01cbc351c56 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:06.492410 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 626/1286] 10.222.0.118 () {56 vars in 1153 bytes} [Thu Jul 14 15:27:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:27:06.498539 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3906150-3f27-4d47-a685-d7b3978769c9 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:06.596551 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3906150-3f27-4d47-a685-d7b3978769c9 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:06.630423 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b689185a-5521-4d11-8a45-a1370363160f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:06.631057 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b689185a-5521-4d11-8a45-a1370363160f None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:06.631332 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b689185a-5521-4d11-8a45-a1370363160f None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:06.631600 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b689185a-5521-4d11-8a45-a1370363160f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:06.632422 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b689185a-5521-4d11-8a45-a1370363160f None admin] RBAC: Adding query filter params (role.id=3b880cef7dcf4baf87b50f8610c0c56e, scope.project.id=939bf9541f4a4afe86550f749d337680, user.id=e70b0f8be7e04adca6e3f218fbe3a295) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:27:06.632731 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b689185a-5521-4d11-8a45-a1370363160f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:06.634202 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b689185a-5521-4d11-8a45-a1370363160f None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:06.639858 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 661/1287] 10.222.0.118 () {56 vars in 1379 bytes} [Thu Jul 14 15:27:06 2022] GET /identity/v3/role_assignments?user.id=e70b0f8be7e04adca6e3f218fbe3a295&scope.project.id=939bf9541f4a4afe86550f749d337680&role.id=3b880cef7dcf4baf87b50f8610c0c56e => generated 610 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:27:08.694077 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6f467c-980c-4248-8614-efe25a64ae75 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:08.694665 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6f467c-980c-4248-8614-efe25a64ae75 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:08.694665 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6f467c-980c-4248-8614-efe25a64ae75 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:08.696039 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 627/1288] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:27:08 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:27:08.701328 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4474af36-a3a3-4f24-bdd6-03e9a40fef55 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:08.701749 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4474af36-a3a3-4f24-bdd6-03e9a40fef55 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:08.701857 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4474af36-a3a3-4f24-bdd6-03e9a40fef55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:08.718482 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-4474af36-a3a3-4f24-bdd6-03e9a40fef55 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:27:08.719670 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-4474af36-a3a3-4f24-bdd6-03e9a40fef55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:27:08.749243 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:08.784820 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 662/1289] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:27:08 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:27:08.808069 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6f467c-980c-4248-8614-efe25a64ae75 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:08.907305 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6f467c-980c-4248-8614-efe25a64ae75 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:08.917573 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:08.940686 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d339e61d-c388-4016-8f8b-eff0fd18c129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:08.941473 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d339e61d-c388-4016-8f8b-eff0fd18c129 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:08.941752 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d339e61d-c388-4016-8f8b-eff0fd18c129 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:08.942057 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d339e61d-c388-4016-8f8b-eff0fd18c129 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:08.942705 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d339e61d-c388-4016-8f8b-eff0fd18c129 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:08.944066 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d339e61d-c388-4016-8f8b-eff0fd18c129 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:08.956691 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-d339e61d-c388-4016-8f8b-eff0fd18c129 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 15:27:08.956691 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:27:08.956691 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 15:27:08.956691 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 15:27:08.956691 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 15:27:08.956691 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 15:27:08.956691 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 15:27:08.956691 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:27:08.956691 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 15:27:08.956691 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:27:08.956691 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 15:27:08.956691 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:27:08.956691 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:27:08.956691 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:27:08.956691 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:27:08.956691 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:27:08.956691 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:27:08.957911 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:27:08.957911 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:27:08.957911 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:27:08.957911 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:27:08.957911 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:27:08.957911 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:27:08.957911 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 15:27:08.957911 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 15:27:08.957911 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 15:27:08.957911 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 15:27:08.957911 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:27:08.957911 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:27:08.957911 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:27:08.957911 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:27:08.957911 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:27:08.957911 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:27:08.958849 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:27:08.958849 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:27:08.958849 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:27:08.958849 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:27:08.958849 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:27:08.958849 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:27:08.958849 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:27:08.958849 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:27:08.958849 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:27:08.958849 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:27:08.958849 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 15:27:08.958849 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:27:08.958849 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 15:27:08.958849 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:27:08.958849 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 628/1290] 10.222.0.118 () {56 vars in 1122 bytes} [Thu Jul 14 15:27:08 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:27:08.963965 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4474af36-a3a3-4f24-bdd6-03e9a40fef55 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:09.060678 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4474af36-a3a3-4f24-bdd6-03e9a40fef55 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:09.093243 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb628bc-e55b-4ea1-9d52-9e42d4cce64d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:09.093894 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb628bc-e55b-4ea1-9d52-9e42d4cce64d None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:09.094205 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb628bc-e55b-4ea1-9d52-9e42d4cce64d None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:09.094477 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb628bc-e55b-4ea1-9d52-9e42d4cce64d None admin] PATH_INFO: `/v3/services` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:09.095186 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb628bc-e55b-4ea1-9d52-9e42d4cce64d None admin] RBAC: Adding query filter params (name=placement) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:27:09.095489 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb628bc-e55b-4ea1-9d52-9e42d4cce64d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:09.096843 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb628bc-e55b-4ea1-9d52-9e42d4cce64d None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:09.101849 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 663/1291] 10.222.0.118 () {56 vars in 1121 bytes} [Thu Jul 14 15:27:08 2022] GET /identity/v3/services?name=placement => generated 127 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:27:09.107676 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d339e61d-c388-4016-8f8b-eff0fd18c129 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:09.204501 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d339e61d-c388-4016-8f8b-eff0fd18c129 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:09.236175 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61483814-dea5-4aa6-bd97-c637bc6738f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:09.236763 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61483814-dea5-4aa6-bd97-c637bc6738f6 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:09.237043 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61483814-dea5-4aa6-bd97-c637bc6738f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:09.237319 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61483814-dea5-4aa6-bd97-c637bc6738f6 None admin] PATH_INFO: `/v3/services` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:09.238042 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61483814-dea5-4aa6-bd97-c637bc6738f6 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:27:09.238352 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61483814-dea5-4aa6-bd97-c637bc6738f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:09.239715 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61483814-dea5-4aa6-bd97-c637bc6738f6 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:09.244840 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 629/1292] 10.222.0.118 () {56 vars in 1121 bytes} [Thu Jul 14 15:27:09 2022] GET /identity/v3/services?type=placement => generated 127 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:27:11.241808 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971375d5-27dd-4222-a559-7ac030f0b048 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:11.242407 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971375d5-27dd-4222-a559-7ac030f0b048 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:11.242407 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971375d5-27dd-4222-a559-7ac030f0b048 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:11.244275 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 664/1293] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:27:11 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:27:11.249327 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2507a748-6b80-4dde-abc6-b51a748cdadb None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:11.249724 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2507a748-6b80-4dde-abc6-b51a748cdadb None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:11.249873 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2507a748-6b80-4dde-abc6-b51a748cdadb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:11.267948 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-2507a748-6b80-4dde-abc6-b51a748cdadb None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:27:11.269168 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-2507a748-6b80-4dde-abc6-b51a748cdadb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:27:11.297330 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:11.335217 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 630/1294] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:27:11 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:27:11.357437 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971375d5-27dd-4222-a559-7ac030f0b048 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:11.390409 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:11.472268 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971375d5-27dd-4222-a559-7ac030f0b048 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:11.513475 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364f6156-034e-4493-bef6-0658ba7cb6c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:11.514095 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f6156-034e-4493-bef6-0658ba7cb6c1 None admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:11.514377 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f6156-034e-4493-bef6-0658ba7cb6c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:11.514651 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f6156-034e-4493-bef6-0658ba7cb6c1 None admin] PATH_INFO: `/v3/services` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:11.515380 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364f6156-034e-4493-bef6-0658ba7cb6c1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:11.516732 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364f6156-034e-4493-bef6-0658ba7cb6c1 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:11.529260 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 665/1295] 10.222.0.118 () {60 vars in 1146 bytes} [Thu Jul 14 15:27:11 2022] POST /identity/v3/services => generated 247 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:27:13.570154 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770ff5bc-c577-45dd-97e4-b4348c46a444 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:13.571271 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770ff5bc-c577-45dd-97e4-b4348c46a444 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:13.571271 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770ff5bc-c577-45dd-97e4-b4348c46a444 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:13.572655 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 631/1296] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:27:13 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:27:13.577883 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f3c51-efd2-4448-9e77-633155208b8a None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:13.578325 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f3c51-efd2-4448-9e77-633155208b8a None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:13.578601 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f3c51-efd2-4448-9e77-633155208b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:13.595115 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-a57f3c51-efd2-4448-9e77-633155208b8a None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:27:13.596301 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-a57f3c51-efd2-4448-9e77-633155208b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:27:13.669502 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 666/1297] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:27:13 2022] POST /identity/v3/auth/tokens => generated 2216 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:27:13.693033 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770ff5bc-c577-45dd-97e4-b4348c46a444 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:13.794448 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770ff5bc-c577-45dd-97e4-b4348c46a444 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:13.829219 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812a0115-a67b-4201-8806-03a474bb91f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:13.829938 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812a0115-a67b-4201-8806-03a474bb91f7 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:13.830249 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812a0115-a67b-4201-8806-03a474bb91f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:13.830525 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812a0115-a67b-4201-8806-03a474bb91f7 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:13.831175 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812a0115-a67b-4201-8806-03a474bb91f7 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:13.832549 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812a0115-a67b-4201-8806-03a474bb91f7 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:13.844160 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-812a0115-a67b-4201-8806-03a474bb91f7 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 15:27:13.844160 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:27:13.844160 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 15:27:13.844160 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 15:27:13.844160 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 15:27:13.844160 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 15:27:13.844160 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 15:27:13.844160 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:27:13.844160 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 15:27:13.844160 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:27:13.844160 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 15:27:13.844160 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:27:13.844160 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:27:13.844160 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:27:13.844160 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:27:13.844160 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:27:13.844160 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:27:13.845388 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:27:13.845388 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:27:13.845388 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:27:13.845388 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:27:13.845388 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:27:13.845388 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:27:13.845388 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 15:27:13.845388 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 15:27:13.845388 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 15:27:13.845388 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 15:27:13.845388 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:27:13.845388 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:27:13.845388 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:27:13.845388 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:27:13.845388 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:27:13.845388 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:27:13.846659 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:27:13.846659 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:27:13.846659 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:27:13.846659 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:27:13.846659 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:27:13.846659 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:27:13.846659 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:27:13.846659 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:27:13.846659 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:27:13.846659 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:27:13.846659 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 15:27:13.846659 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:27:13.846659 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 15:27:13.846659 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:27:13.846659 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 632/1298] 10.222.0.118 () {56 vars in 1122 bytes} [Thu Jul 14 15:27:13 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:27:13.851635 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57f3c51-efd2-4448-9e77-633155208b8a None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:13.870618 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:13.949566 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57f3c51-efd2-4448-9e77-633155208b8a None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:13.982397 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407fc7e4-e7ea-4601-884f-f092b9c35554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:13.983057 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407fc7e4-e7ea-4601-884f-f092b9c35554 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:13.983330 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407fc7e4-e7ea-4601-884f-f092b9c35554 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:13.983598 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407fc7e4-e7ea-4601-884f-f092b9c35554 None admin] PATH_INFO: `/v3/services` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:13.984298 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407fc7e4-e7ea-4601-884f-f092b9c35554 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:27:13.984599 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407fc7e4-e7ea-4601-884f-f092b9c35554 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:13.985997 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407fc7e4-e7ea-4601-884f-f092b9c35554 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:13.991245 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 667/1299] 10.222.0.118 () {56 vars in 1121 bytes} [Thu Jul 14 15:27:13 2022] GET /identity/v3/services?name=placement => generated 360 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:27:13.998283 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812a0115-a67b-4201-8806-03a474bb91f7 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:14.030095 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:14.096846 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812a0115-a67b-4201-8806-03a474bb91f7 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:14.129507 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78c64d3-e6e6-4fb4-a84c-b1e8003561db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:14.130175 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78c64d3-e6e6-4fb4-a84c-b1e8003561db None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:14.130453 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78c64d3-e6e6-4fb4-a84c-b1e8003561db None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:14.130723 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78c64d3-e6e6-4fb4-a84c-b1e8003561db None admin] PATH_INFO: `/v3/endpoints` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:14.131498 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78c64d3-e6e6-4fb4-a84c-b1e8003561db None admin] RBAC: Adding query filter params (interface=public, service_id=3701f621bfb5456794fd539f9d12df59, region_id=RegionOne) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:27:14.131805 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78c64d3-e6e6-4fb4-a84c-b1e8003561db None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:14.133190 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78c64d3-e6e6-4fb4-a84c-b1e8003561db None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:14.138038 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 633/1300] 10.222.0.118 () {56 vars in 1256 bytes} [Thu Jul 14 15:27:13 2022] GET /identity/v3/endpoints?service_id=3701f621bfb5456794fd539f9d12df59&interface=public®ion_id=RegionOne => generated 195 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:27:14.143631 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407fc7e4-e7ea-4601-884f-f092b9c35554 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:14.223452 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:14.241830 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407fc7e4-e7ea-4601-884f-f092b9c35554 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:14.275222 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e000347-d51a-4237-98b9-8bc87469a42d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:14.275871 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e000347-d51a-4237-98b9-8bc87469a42d None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:14.276150 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e000347-d51a-4237-98b9-8bc87469a42d None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:14.276422 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e000347-d51a-4237-98b9-8bc87469a42d None admin] PATH_INFO: `/v3/services` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:14.277098 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e000347-d51a-4237-98b9-8bc87469a42d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:14.278499 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e000347-d51a-4237-98b9-8bc87469a42d None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:14.285522 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 668/1301] 10.222.0.118 () {56 vars in 1092 bytes} [Thu Jul 14 15:27:14 2022] GET /identity/v3/services => generated 2201 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:27:16.338051 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7a2ea1-0257-4329-ad9b-6aaa6d511eeb None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:16.338613 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7a2ea1-0257-4329-ad9b-6aaa6d511eeb None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:16.338613 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7a2ea1-0257-4329-ad9b-6aaa6d511eeb None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:16.339974 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 634/1302] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:27:16 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:27:16.345201 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7cb54a-09dc-4126-8be4-680049c33518 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:16.345622 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7cb54a-09dc-4126-8be4-680049c33518 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:16.345741 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7cb54a-09dc-4126-8be4-680049c33518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:16.361982 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-fa7cb54a-09dc-4126-8be4-680049c33518 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:27:16.363184 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-fa7cb54a-09dc-4126-8be4-680049c33518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:27:16.427752 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 669/1303] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:27:16 2022] POST /identity/v3/auth/tokens => generated 2216 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:27:16.452188 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7a2ea1-0257-4329-ad9b-6aaa6d511eeb None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:16.545670 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:16.552681 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7a2ea1-0257-4329-ad9b-6aaa6d511eeb None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:16.585808 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a10b9a-bd5f-4d4b-80c8-ff5306a66342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:16.586657 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a10b9a-bd5f-4d4b-80c8-ff5306a66342 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:16.586934 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a10b9a-bd5f-4d4b-80c8-ff5306a66342 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:16.587204 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a10b9a-bd5f-4d4b-80c8-ff5306a66342 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:16.587844 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a10b9a-bd5f-4d4b-80c8-ff5306a66342 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:16.589256 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a10b9a-bd5f-4d4b-80c8-ff5306a66342 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:16.600863 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-10a10b9a-bd5f-4d4b-80c8-ff5306a66342 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 15:27:16.600863 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:27:16.600863 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 15:27:16.600863 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 15:27:16.600863 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 15:27:16.600863 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 15:27:16.600863 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 15:27:16.600863 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:27:16.600863 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 15:27:16.600863 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:27:16.600863 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 15:27:16.600863 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:27:16.600863 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:27:16.600863 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:27:16.600863 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:27:16.600863 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:27:16.600863 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:27:16.602040 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:27:16.602040 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:27:16.602040 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:27:16.602040 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:27:16.602040 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:27:16.602040 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:27:16.602040 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 15:27:16.602040 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 15:27:16.602040 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 15:27:16.602040 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 15:27:16.602040 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:27:16.602040 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:27:16.602040 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:27:16.602040 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:27:16.602040 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:27:16.602040 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:27:16.602884 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:27:16.602884 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( Jul 14 15:27:16.602884 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:27:16.602884 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:27:16.602884 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:27:16.602884 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:27:16.602884 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:27:16.602884 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:27:16.602884 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:27:16.602884 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:27:16.602884 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 15:27:16.602884 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:27:16.602884 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 15:27:16.602884 dv-cinder-826510-8-smb devstack@keystone.service[80345]: ERROR keystone.server.flask.application Jul 14 15:27:16.602884 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 635/1304] 10.222.0.118 () {56 vars in 1122 bytes} [Thu Jul 14 15:27:16 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:27:16.608232 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7cb54a-09dc-4126-8be4-680049c33518 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:16.683242 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:16.706520 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7cb54a-09dc-4126-8be4-680049c33518 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:16.739176 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef4e9a1-d1ff-43cd-9839-e6888e4a507f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:16.739846 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef4e9a1-d1ff-43cd-9839-e6888e4a507f None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:16.740123 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef4e9a1-d1ff-43cd-9839-e6888e4a507f None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:16.740393 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef4e9a1-d1ff-43cd-9839-e6888e4a507f None admin] PATH_INFO: `/v3/services` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:16.741097 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef4e9a1-d1ff-43cd-9839-e6888e4a507f None admin] RBAC: Adding query filter params (name=placement) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:27:16.741402 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef4e9a1-d1ff-43cd-9839-e6888e4a507f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:16.743312 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef4e9a1-d1ff-43cd-9839-e6888e4a507f None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:16.748405 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 670/1305] 10.222.0.118 () {56 vars in 1121 bytes} [Thu Jul 14 15:27:16 2022] GET /identity/v3/services?name=placement => generated 360 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:27:16.754365 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a10b9a-bd5f-4d4b-80c8-ff5306a66342 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:16.851141 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a10b9a-bd5f-4d4b-80c8-ff5306a66342 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:16.884186 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218d3090-ac0d-4baa-9d15-2c0c1b232580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:16.884820 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218d3090-ac0d-4baa-9d15-2c0c1b232580 None admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:16.885099 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218d3090-ac0d-4baa-9d15-2c0c1b232580 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:16.885373 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218d3090-ac0d-4baa-9d15-2c0c1b232580 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:16.886169 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218d3090-ac0d-4baa-9d15-2c0c1b232580 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:16.887526 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218d3090-ac0d-4baa-9d15-2c0c1b232580 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:16.905573 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 636/1306] 10.222.0.118 () {60 vars in 1149 bytes} [Thu Jul 14 15:27:16 2022] POST /identity/v3/endpoints => generated 333 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:27:26.745513 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=30 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:26.901607 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:28:20.453339 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299ecd7e-41df-45a4-8d17-f150ea3794c7 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:28:20.454425 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299ecd7e-41df-45a4-8d17-f150ea3794c7 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:28:20.454922 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299ecd7e-41df-45a4-8d17-f150ea3794c7 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:28:20.462474 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59fccf0-c5cd-4fd9-9203-a48393468e5e None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:28:20.463432 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59fccf0-c5cd-4fd9-9203-a48393468e5e None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:28:20.463938 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59fccf0-c5cd-4fd9-9203-a48393468e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:28:20.466252 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 671/1307] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:28:20 2022] GET /identity => generated 271 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:28:20.546757 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-c59fccf0-c5cd-4fd9-9203-a48393468e5e None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:28:20.548097 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-c59fccf0-c5cd-4fd9-9203-a48393468e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:28:20.702052 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 637/1308] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:28:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:28:20.748324 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84df243-447d-4b5c-b7df-f5d643d8b98b None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:28:20.748611 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84df243-447d-4b5c-b7df-f5d643d8b98b None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:28:20.748884 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84df243-447d-4b5c-b7df-f5d643d8b98b None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:28:20.750921 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 672/1309] 10.222.0.118 () {54 vars in 969 bytes} [Thu Jul 14 15:28:20 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:28:20.759705 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68c86e4-2bb0-423d-8969-5ab2300f51d3 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:28:20.759996 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68c86e4-2bb0-423d-8969-5ab2300f51d3 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:28:20.760270 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68c86e4-2bb0-423d-8969-5ab2300f51d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:28:20.842168 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-c68c86e4-2bb0-423d-8969-5ab2300f51d3 None None] MFA Rules not processed for user `b650be8114b64df0ac88441f1c50b2cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:28:20.843387 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-c68c86e4-2bb0-423d-8969-5ab2300f51d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:28:20.866964 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:28:20.944369 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 638/1310] 10.222.0.118 () {58 vars in 1066 bytes} [Thu Jul 14 15:28:20 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:28:20.953295 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84df243-447d-4b5c-b7df-f5d643d8b98b None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:28:20.955110 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-c84df243-447d-4b5c-b7df-f5d643d8b98b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:28:21.075393 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84df243-447d-4b5c-b7df-f5d643d8b98b None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:28:21.151617 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0965e10a-c422-4a6e-80ca-90394c0740d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b650be8114b64df0ac88441f1c50b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:28:21.152268 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0965e10a-c422-4a6e-80ca-90394c0740d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:28:21.152545 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0965e10a-c422-4a6e-80ca-90394c0740d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:28:21.152817 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0965e10a-c422-4a6e-80ca-90394c0740d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:28:21.154473 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-0965e10a-c422-4a6e-80ca-90394c0740d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:28:21.212604 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:28:21.271529 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0965e10a-c422-4a6e-80ca-90394c0740d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:28:21.272968 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0965e10a-c422-4a6e-80ca-90394c0740d7 service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:28:21.292655 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 673/1311] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:28:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:28:23.679450 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c7c159-a424-416b-8837-1df5cc68c4f0 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:28:23.680002 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c7c159-a424-416b-8837-1df5cc68c4f0 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:28:23.680002 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c7c159-a424-416b-8837-1df5cc68c4f0 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:28:23.681771 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 639/1312] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:28:23 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:28:23.686652 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c88dc9-44e6-4af7-b6cf-7f631988aa28 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:28:23.687048 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c88dc9-44e6-4af7-b6cf-7f631988aa28 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:28:23.687250 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c88dc9-44e6-4af7-b6cf-7f631988aa28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:28:23.776543 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-77c88dc9-44e6-4af7-b6cf-7f631988aa28 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:28:23.777759 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-77c88dc9-44e6-4af7-b6cf-7f631988aa28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:28:23.891324 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 674/1313] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:28:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:28:23.931246 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c7c159-a424-416b-8837-1df5cc68c4f0 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:28:23.932794 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-67c7c159-a424-416b-8837-1df5cc68c4f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:28:24.042081 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c7c159-a424-416b-8837-1df5cc68c4f0 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:28:24.113084 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:28:24.116198 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c20599-5f6a-416f-adf2-8845880ac7ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b650be8114b64df0ac88441f1c50b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:28:24.117040 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c20599-5f6a-416f-adf2-8845880ac7ea service neutron] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:28:24.117482 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c20599-5f6a-416f-adf2-8845880ac7ea service neutron] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:28:24.117981 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c20599-5f6a-416f-adf2-8845880ac7ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:28:24.119718 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-f6c20599-5f6a-416f-adf2-8845880ac7ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:28:24.233461 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c20599-5f6a-416f-adf2-8845880ac7ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:28:24.234886 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c20599-5f6a-416f-adf2-8845880ac7ea service neutron] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:28:24.255487 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 640/1314] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:28:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:28:26.617149 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f8ac29-8edb-4e5d-838f-01950a8103b8 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:28:26.617656 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f8ac29-8edb-4e5d-838f-01950a8103b8 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:28:26.617656 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f8ac29-8edb-4e5d-838f-01950a8103b8 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:28:26.619046 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 675/1315] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:28:26 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:28:26.624623 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16ebd75-2144-4a85-9e47-5be18ed7f872 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:28:26.625054 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16ebd75-2144-4a85-9e47-5be18ed7f872 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:28:26.625158 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16ebd75-2144-4a85-9e47-5be18ed7f872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:28:26.688653 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-c16ebd75-2144-4a85-9e47-5be18ed7f872 None None] MFA Rules not processed for user `59bb0f609774438d83c9741c52519818`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:28:26.689938 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-c16ebd75-2144-4a85-9e47-5be18ed7f872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:28:26.743150 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:28:26.787729 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 641/1316] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:28:26 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:28:26.843423 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3431e1-2e8e-433e-bcbe-fcf0cda1d9b8 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:28:26.843706 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3431e1-2e8e-433e-bcbe-fcf0cda1d9b8 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:28:26.843976 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3431e1-2e8e-433e-bcbe-fcf0cda1d9b8 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:28:26.845353 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 676/1317] 10.222.0.118 () {54 vars in 969 bytes} [Thu Jul 14 15:28:26 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:28:26.851219 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea76402a-baaa-4815-a5df-f89c18aacba2 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:28:26.851502 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea76402a-baaa-4815-a5df-f89c18aacba2 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:28:26.851776 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea76402a-baaa-4815-a5df-f89c18aacba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:28:26.923776 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-ea76402a-baaa-4815-a5df-f89c18aacba2 None None] MFA Rules not processed for user `b650be8114b64df0ac88441f1c50b2cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:28:26.924970 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-ea76402a-baaa-4815-a5df-f89c18aacba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:28:26.998348 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 642/1318] 10.222.0.118 () {58 vars in 1066 bytes} [Thu Jul 14 15:28:26 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:28:27.008239 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3431e1-2e8e-433e-bcbe-fcf0cda1d9b8 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:28:27.009798 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-1d3431e1-2e8e-433e-bcbe-fcf0cda1d9b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:28:27.019623 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:28:27.111498 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3431e1-2e8e-433e-bcbe-fcf0cda1d9b8 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:28:27.183043 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e28a60-a83a-4c1d-a3a7-d7b97b1d347c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b650be8114b64df0ac88441f1c50b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:28:27.183611 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e28a60-a83a-4c1d-a3a7-d7b97b1d347c service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:28:27.183887 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e28a60-a83a-4c1d-a3a7-d7b97b1d347c service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:28:27.184154 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e28a60-a83a-4c1d-a3a7-d7b97b1d347c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:28:27.185785 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-20e28a60-a83a-4c1d-a3a7-d7b97b1d347c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:28:27.250202 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:28:27.296645 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e28a60-a83a-4c1d-a3a7-d7b97b1d347c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:28:27.298105 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e28a60-a83a-4c1d-a3a7-d7b97b1d347c service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:28:27.316154 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 677/1319] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:28:27 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:28:30.251132 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24113509-42fc-4a78-a757-c0fe714342f5 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:28:30.251536 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24113509-42fc-4a78-a757-c0fe714342f5 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:28:30.251684 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24113509-42fc-4a78-a757-c0fe714342f5 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:28:30.253085 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 643/1320] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:28:30 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:28:30.258910 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a54974-69e9-4491-8741-a71b46278384 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:28:30.259344 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a54974-69e9-4491-8741-a71b46278384 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:28:30.259467 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a54974-69e9-4491-8741-a71b46278384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:28:30.324397 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-15a54974-69e9-4491-8741-a71b46278384 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:28:30.325608 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-15a54974-69e9-4491-8741-a71b46278384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:28:30.421793 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 678/1321] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:28:30 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:28:30.465448 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24113509-42fc-4a78-a757-c0fe714342f5 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:28:30.467068 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-24113509-42fc-4a78-a757-c0fe714342f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:28:30.517890 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:28:30.573483 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24113509-42fc-4a78-a757-c0fe714342f5 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:28:30.645414 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eb9cb1-9318-45ac-b5dc-bfbfe8ed9de9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b650be8114b64df0ac88441f1c50b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:28:30.646097 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eb9cb1-9318-45ac-b5dc-bfbfe8ed9de9 service neutron] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:28:30.646370 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eb9cb1-9318-45ac-b5dc-bfbfe8ed9de9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:28:30.646637 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eb9cb1-9318-45ac-b5dc-bfbfe8ed9de9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:28:30.648272 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-b0eb9cb1-9318-45ac-b5dc-bfbfe8ed9de9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:28:30.742918 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:28:30.756564 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0eb9cb1-9318-45ac-b5dc-bfbfe8ed9de9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:28:30.758030 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0eb9cb1-9318-45ac-b5dc-bfbfe8ed9de9 service neutron] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:28:30.776628 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 644/1322] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:28:30 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:28:33.663300 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c30584a-55ed-475a-918d-ec7a081e1f86 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:28:33.663868 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c30584a-55ed-475a-918d-ec7a081e1f86 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:28:33.663868 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c30584a-55ed-475a-918d-ec7a081e1f86 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:28:33.665226 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 679/1323] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:28:33 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:28:33.670371 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a125c1-3500-4ada-94fa-908874c22f87 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:28:33.670831 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a125c1-3500-4ada-94fa-908874c22f87 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:28:33.671072 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a125c1-3500-4ada-94fa-908874c22f87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:28:33.748651 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-a3a125c1-3500-4ada-94fa-908874c22f87 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:28:33.750180 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-a3a125c1-3500-4ada-94fa-908874c22f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:28:33.853821 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 645/1324] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:28:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:28:33.892169 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c30584a-55ed-475a-918d-ec7a081e1f86 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:28:33.893829 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-0c30584a-55ed-475a-918d-ec7a081e1f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:28:33.913719 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:28:33.998249 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c30584a-55ed-475a-918d-ec7a081e1f86 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:28:34.071582 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee017fa-aadc-4ea4-a5e8-e14483aa0009 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b650be8114b64df0ac88441f1c50b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:28:34.072220 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee017fa-aadc-4ea4-a5e8-e14483aa0009 service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:28:34.072494 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee017fa-aadc-4ea4-a5e8-e14483aa0009 service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:28:34.072761 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee017fa-aadc-4ea4-a5e8-e14483aa0009 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:28:34.074414 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-6ee017fa-aadc-4ea4-a5e8-e14483aa0009 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:28:34.143818 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:28:34.181587 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee017fa-aadc-4ea4-a5e8-e14483aa0009 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:28:34.182972 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee017fa-aadc-4ea4-a5e8-e14483aa0009 service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:28:34.202025 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 680/1325] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:28:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:28:36.312259 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c9cf20-5f55-4a44-b185-2592df7274a0 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:28:36.312809 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c9cf20-5f55-4a44-b185-2592df7274a0 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:28:36.312809 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c9cf20-5f55-4a44-b185-2592df7274a0 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:28:36.314385 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 646/1326] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:28:36 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:28:36.320014 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6031c8db-84d7-4959-8390-0252a086c529 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:28:36.320427 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6031c8db-84d7-4959-8390-0252a086c529 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:28:36.320704 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6031c8db-84d7-4959-8390-0252a086c529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:28:36.386575 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-6031c8db-84d7-4959-8390-0252a086c529 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:28:36.387800 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-6031c8db-84d7-4959-8390-0252a086c529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:28:36.484764 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 681/1327] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:28:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:28:36.521136 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c9cf20-5f55-4a44-b185-2592df7274a0 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:28:36.522750 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-30c9cf20-5f55-4a44-b185-2592df7274a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:28:36.584559 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:28:36.630623 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c9cf20-5f55-4a44-b185-2592df7274a0 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:28:36.711590 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9716886-00ad-46a7-a3d1-fd4661b0743c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b650be8114b64df0ac88441f1c50b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:28:36.712245 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9716886-00ad-46a7-a3d1-fd4661b0743c service neutron] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:28:36.712528 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9716886-00ad-46a7-a3d1-fd4661b0743c service neutron] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:28:36.712801 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9716886-00ad-46a7-a3d1-fd4661b0743c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:28:36.714575 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-c9716886-00ad-46a7-a3d1-fd4661b0743c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:28:36.828699 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:28:36.832177 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9716886-00ad-46a7-a3d1-fd4661b0743c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:28:36.834258 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9716886-00ad-46a7-a3d1-fd4661b0743c service neutron] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:28:36.853574 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 647/1328] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:28:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:28:38.986059 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c20fc8-5f55-46fb-ba83-4baac92f5f89 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:28:38.986549 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c20fc8-5f55-46fb-ba83-4baac92f5f89 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:28:38.986673 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c20fc8-5f55-46fb-ba83-4baac92f5f89 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:28:38.988540 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 682/1329] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:28:38 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:28:38.993852 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407e43f1-bf26-4022-b7dd-98b015f52638 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:28:38.994312 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407e43f1-bf26-4022-b7dd-98b015f52638 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:28:38.994438 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407e43f1-bf26-4022-b7dd-98b015f52638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:28:39.066247 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-407e43f1-bf26-4022-b7dd-98b015f52638 None None] MFA Rules not processed for user `59bb0f609774438d83c9741c52519818`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:28:39.067993 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-407e43f1-bf26-4022-b7dd-98b015f52638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:28:39.166709 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 648/1330] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:28:38 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:28:39.205090 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c20fc8-5f55-46fb-ba83-4baac92f5f89 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:28:39.206780 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-69c20fc8-5f55-46fb-ba83-4baac92f5f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:28:39.238642 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:28:39.313941 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c20fc8-5f55-46fb-ba83-4baac92f5f89 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:28:39.387541 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63893f32-0c67-4154-ae86-c8ab580d4f55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b650be8114b64df0ac88441f1c50b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:28:39.388181 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63893f32-0c67-4154-ae86-c8ab580d4f55 service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:28:39.388454 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63893f32-0c67-4154-ae86-c8ab580d4f55 service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:28:39.388719 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63893f32-0c67-4154-ae86-c8ab580d4f55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:28:39.390361 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-63893f32-0c67-4154-ae86-c8ab580d4f55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:28:39.487623 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:28:39.523002 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63893f32-0c67-4154-ae86-c8ab580d4f55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:28:39.524462 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63893f32-0c67-4154-ae86-c8ab580d4f55 service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:28:39.544104 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 683/1331] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:28:39 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:28:41.833332 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c35e01-182c-4d17-a5a2-558c5a319775 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:28:41.833860 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c35e01-182c-4d17-a5a2-558c5a319775 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:28:41.834003 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c35e01-182c-4d17-a5a2-558c5a319775 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:28:41.835332 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 649/1332] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:28:41 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:28:41.840417 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0ac05-1471-42ad-ad81-c14dc7fef23f None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:28:41.840838 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0ac05-1471-42ad-ad81-c14dc7fef23f None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:28:41.840967 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0ac05-1471-42ad-ad81-c14dc7fef23f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:28:41.906239 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-98f0ac05-1471-42ad-ad81-c14dc7fef23f None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:28:41.907435 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-98f0ac05-1471-42ad-ad81-c14dc7fef23f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:28:42.001359 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 684/1333] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:28:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:28:42.037975 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c35e01-182c-4d17-a5a2-558c5a319775 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:28:42.039516 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-b4c35e01-182c-4d17-a5a2-558c5a319775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:28:42.107526 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:28:42.141642 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c35e01-182c-4d17-a5a2-558c5a319775 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:28:42.213251 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2056bb22-311a-4235-9056-898c553cfb97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b650be8114b64df0ac88441f1c50b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:28:42.213888 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2056bb22-311a-4235-9056-898c553cfb97 service neutron] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:28:42.214191 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2056bb22-311a-4235-9056-898c553cfb97 service neutron] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:28:42.214461 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2056bb22-311a-4235-9056-898c553cfb97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:28:42.216086 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-2056bb22-311a-4235-9056-898c553cfb97 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:28:42.331849 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2056bb22-311a-4235-9056-898c553cfb97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:28:42.333312 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2056bb22-311a-4235-9056-898c553cfb97 service neutron] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:28:42.344407 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:28:42.354037 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 650/1334] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:28:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:28:44.457084 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158cbcea-5f30-44fb-a4d2-ed0c7802395d None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:28:44.457997 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158cbcea-5f30-44fb-a4d2-ed0c7802395d None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:28:44.458290 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158cbcea-5f30-44fb-a4d2-ed0c7802395d None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:28:44.459700 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 685/1335] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:28:44 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:28:44.465023 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83709f3e-3a95-488b-b901-b76cb62a2207 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:28:44.465556 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83709f3e-3a95-488b-b901-b76cb62a2207 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:28:44.465556 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83709f3e-3a95-488b-b901-b76cb62a2207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:28:44.536587 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-83709f3e-3a95-488b-b901-b76cb62a2207 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:28:44.537785 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-83709f3e-3a95-488b-b901-b76cb62a2207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:28:44.632608 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 651/1336] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:28:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:28:44.672664 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158cbcea-5f30-44fb-a4d2-ed0c7802395d None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:28:44.674205 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-158cbcea-5f30-44fb-a4d2-ed0c7802395d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:28:44.713611 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:28:44.778050 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158cbcea-5f30-44fb-a4d2-ed0c7802395d None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:28:44.850820 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ccbbef-dbc8-4bc9-8363-a22b180349c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b650be8114b64df0ac88441f1c50b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:28:44.851396 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ccbbef-dbc8-4bc9-8363-a22b180349c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:28:44.851674 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ccbbef-dbc8-4bc9-8363-a22b180349c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:28:44.851945 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ccbbef-dbc8-4bc9-8363-a22b180349c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:28:44.853574 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-74ccbbef-dbc8-4bc9-8363-a22b180349c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:28:44.936373 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:28:44.962332 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ccbbef-dbc8-4bc9-8363-a22b180349c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:28:44.964270 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ccbbef-dbc8-4bc9-8363-a22b180349c5 service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:28:44.994809 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 686/1337] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:28:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:28:47.484011 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121fe957-680e-4690-9bec-e4c173844379 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:28:47.484546 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121fe957-680e-4690-9bec-e4c173844379 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:28:47.484653 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121fe957-680e-4690-9bec-e4c173844379 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:28:47.486045 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 652/1338] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:28:47 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:28:47.491927 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52e7118-4652-45c0-ae69-7e38acf8041b None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:28:47.492365 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52e7118-4652-45c0-ae69-7e38acf8041b None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:28:47.492626 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52e7118-4652-45c0-ae69-7e38acf8041b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:28:47.562466 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-b52e7118-4652-45c0-ae69-7e38acf8041b None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:28:47.563863 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-b52e7118-4652-45c0-ae69-7e38acf8041b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:28:47.661386 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 687/1339] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:28:47 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:28:47.697452 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121fe957-680e-4690-9bec-e4c173844379 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:28:47.699022 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-121fe957-680e-4690-9bec-e4c173844379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:28:47.775889 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:28:47.804535 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121fe957-680e-4690-9bec-e4c173844379 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:28:47.879352 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff043d3-dc47-464f-a678-c21b43cb906b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b650be8114b64df0ac88441f1c50b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:28:47.880004 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff043d3-dc47-464f-a678-c21b43cb906b service neutron] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:28:47.880285 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff043d3-dc47-464f-a678-c21b43cb906b service neutron] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:28:47.880560 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff043d3-dc47-464f-a678-c21b43cb906b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:28:47.882257 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-5ff043d3-dc47-464f-a678-c21b43cb906b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:28:47.996307 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff043d3-dc47-464f-a678-c21b43cb906b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:28:47.997669 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff043d3-dc47-464f-a678-c21b43cb906b service neutron] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:28:48.015999 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 653/1340] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:28:47 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:28:52.074263 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b648c-363e-4d04-a93d-a9c56948ca72 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:28:52.074781 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b648c-363e-4d04-a93d-a9c56948ca72 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:28:52.074781 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b648c-363e-4d04-a93d-a9c56948ca72 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:28:52.076115 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 688/1341] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:28:52 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:28:52.081916 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8f8edd-5745-437c-a2f7-90f6165fa7dd None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:28:52.082372 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8f8edd-5745-437c-a2f7-90f6165fa7dd None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:28:52.082502 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8f8edd-5745-437c-a2f7-90f6165fa7dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:28:52.086732 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:28:52.148686 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-ca8f8edd-5745-437c-a2f7-90f6165fa7dd None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:28:52.149912 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-ca8f8edd-5745-437c-a2f7-90f6165fa7dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:28:52.253467 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 654/1342] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:28:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:28:52.292925 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4b648c-363e-4d04-a93d-a9c56948ca72 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:28:52.294476 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-ab4b648c-363e-4d04-a93d-a9c56948ca72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:28:52.344012 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:28:52.400470 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4b648c-363e-4d04-a93d-a9c56948ca72 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:28:52.475506 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19d7053-2a76-413a-b527-b31140931763 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b650be8114b64df0ac88441f1c50b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:28:52.476155 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19d7053-2a76-413a-b527-b31140931763 service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:28:52.476429 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19d7053-2a76-413a-b527-b31140931763 service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:28:52.476700 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19d7053-2a76-413a-b527-b31140931763 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:28:52.478360 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-d19d7053-2a76-413a-b527-b31140931763 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:28:52.577036 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:28:52.595996 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19d7053-2a76-413a-b527-b31140931763 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:28:52.597939 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19d7053-2a76-413a-b527-b31140931763 service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:28:52.616854 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 689/1343] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:28:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:28:55.266096 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7979f6f-6e3b-4f32-b3fd-4ef81c39b88c None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:28:55.266697 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7979f6f-6e3b-4f32-b3fd-4ef81c39b88c None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:28:55.266697 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7979f6f-6e3b-4f32-b3fd-4ef81c39b88c None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:28:55.268066 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 655/1344] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:28:55 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:28:55.273896 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803653a8-1ac0-4035-9e69-9ae00b092697 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:28:55.274468 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803653a8-1ac0-4035-9e69-9ae00b092697 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:28:55.274623 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803653a8-1ac0-4035-9e69-9ae00b092697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:28:55.345056 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-803653a8-1ac0-4035-9e69-9ae00b092697 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:28:55.346827 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-803653a8-1ac0-4035-9e69-9ae00b092697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:28:55.449685 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 690/1345] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:28:55 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:28:55.487798 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7979f6f-6e3b-4f32-b3fd-4ef81c39b88c None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:28:55.489259 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-b7979f6f-6e3b-4f32-b3fd-4ef81c39b88c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:28:55.577176 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:28:55.595805 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7979f6f-6e3b-4f32-b3fd-4ef81c39b88c None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:28:55.672010 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ae8de3-30d3-485e-931c-afc05af6776a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b650be8114b64df0ac88441f1c50b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:28:55.672671 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae8de3-30d3-485e-931c-afc05af6776a service neutron] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:28:55.672947 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae8de3-30d3-485e-931c-afc05af6776a service neutron] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:28:55.673222 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae8de3-30d3-485e-931c-afc05af6776a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:28:55.675469 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-d6ae8de3-30d3-485e-931c-afc05af6776a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:28:55.789367 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ae8de3-30d3-485e-931c-afc05af6776a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:28:55.791574 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ae8de3-30d3-485e-931c-afc05af6776a service neutron] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:28:55.809737 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 656/1346] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:28:55 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:29:00.135509 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540e1f22-b23e-4fd9-9d04-dac62c9d3416 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:29:00.136336 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540e1f22-b23e-4fd9-9d04-dac62c9d3416 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:29:00.136611 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540e1f22-b23e-4fd9-9d04-dac62c9d3416 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:29:00.138244 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 691/1347] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:29:00 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:29:00.143664 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e809b2d4-6163-4319-b71a-c1395703f9ab None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:29:00.144106 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e809b2d4-6163-4319-b71a-c1395703f9ab None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:29:00.144224 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e809b2d4-6163-4319-b71a-c1395703f9ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:29:00.158316 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:29:00.232029 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-e809b2d4-6163-4319-b71a-c1395703f9ab None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:29:00.233375 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-e809b2d4-6163-4319-b71a-c1395703f9ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:29:00.347424 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 657/1348] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:29:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:29:00.386601 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540e1f22-b23e-4fd9-9d04-dac62c9d3416 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:29:00.388237 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-540e1f22-b23e-4fd9-9d04-dac62c9d3416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:29:00.455449 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:29:00.512242 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540e1f22-b23e-4fd9-9d04-dac62c9d3416 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:29:00.598200 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2ea1cf-1662-47e7-ba1f-c57a5299ed1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b650be8114b64df0ac88441f1c50b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:29:00.598864 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2ea1cf-1662-47e7-ba1f-c57a5299ed1c service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:29:00.599146 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2ea1cf-1662-47e7-ba1f-c57a5299ed1c service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:29:00.599417 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2ea1cf-1662-47e7-ba1f-c57a5299ed1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:29:00.601276 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-ae2ea1cf-1662-47e7-ba1f-c57a5299ed1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:29:00.716561 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:29:00.721881 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2ea1cf-1662-47e7-ba1f-c57a5299ed1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:29:00.723564 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2ea1cf-1662-47e7-ba1f-c57a5299ed1c service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:29:00.741949 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 692/1349] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:29:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:29:05.675168 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b19826-cbc2-4327-b018-a82a0890af8c None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:29:05.675668 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b19826-cbc2-4327-b018-a82a0890af8c None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:29:05.675749 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b19826-cbc2-4327-b018-a82a0890af8c None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:29:05.677423 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 658/1350] 10.222.0.118 () {54 vars in 926 bytes} [Thu Jul 14 15:29:05 2022] GET /identity => generated 271 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:29:05.695409 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde8715b-920f-425d-9696-b2b4fd04bca5 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:29:05.695944 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde8715b-920f-425d-9696-b2b4fd04bca5 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:29:05.696263 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde8715b-920f-425d-9696-b2b4fd04bca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:29:05.801695 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-fde8715b-920f-425d-9696-b2b4fd04bca5 None None] MFA Rules not processed for user `e70b0f8be7e04adca6e3f218fbe3a295`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:29:05.803269 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-fde8715b-920f-425d-9696-b2b4fd04bca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:29:05.919804 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 693/1351] 10.222.0.118 () {58 vars in 1023 bytes} [Thu Jul 14 15:29:05 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:29:09.979712 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714dd9c4-38d3-4b04-b7d6-274e8b3c6fb8 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:29:09.980606 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714dd9c4-38d3-4b04-b7d6-274e8b3c6fb8 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:29:09.981109 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714dd9c4-38d3-4b04-b7d6-274e8b3c6fb8 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:29:09.982973 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 659/1352] 10.222.0.118 () {54 vars in 926 bytes} [Thu Jul 14 15:29:09 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:29:09.988449 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7358b5-618a-411e-8865-84959f2ad657 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:29:09.988896 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7358b5-618a-411e-8865-84959f2ad657 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:29:09.988978 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7358b5-618a-411e-8865-84959f2ad657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:29:10.053197 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:29:10.079684 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-9e7358b5-618a-411e-8865-84959f2ad657 None None] MFA Rules not processed for user `e70b0f8be7e04adca6e3f218fbe3a295`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:29:10.080907 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-9e7358b5-618a-411e-8865-84959f2ad657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:29:10.195513 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 694/1353] 10.222.0.118 () {58 vars in 1023 bytes} [Thu Jul 14 15:29:09 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:29:10.345489 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=59 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:29:11.619366 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2da4c1-4018-406f-a917-b5dadf03d4c9 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:29:11.620013 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2da4c1-4018-406f-a917-b5dadf03d4c9 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:29:11.620013 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2da4c1-4018-406f-a917-b5dadf03d4c9 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:29:11.621299 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 660/1354] 10.222.0.118 () {54 vars in 926 bytes} [Thu Jul 14 15:29:11 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:29:11.627289 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7cb314-9e25-4129-86f8-968499b6d3a5 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:29:11.627745 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7cb314-9e25-4129-86f8-968499b6d3a5 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:29:11.627965 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7cb314-9e25-4129-86f8-968499b6d3a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:29:11.703111 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-8f7cb314-9e25-4129-86f8-968499b6d3a5 None None] MFA Rules not processed for user `e70b0f8be7e04adca6e3f218fbe3a295`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:29:11.704879 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-8f7cb314-9e25-4129-86f8-968499b6d3a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:29:11.750503 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:29:11.816212 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 695/1355] 10.222.0.118 () {58 vars in 1023 bytes} [Thu Jul 14 15:29:11 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:29:15.230016 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0e70e1-2275-4c5f-9fdc-6f7796370a6b None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:29:15.230955 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0e70e1-2275-4c5f-9fdc-6f7796370a6b None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:29:15.231493 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0e70e1-2275-4c5f-9fdc-6f7796370a6b None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:29:15.233237 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 661/1356] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:29:15 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:29:15.239310 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb787d6-d5eb-4883-88cb-ff843b2b22c0 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:29:15.240307 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb787d6-d5eb-4883-88cb-ff843b2b22c0 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:29:15.240805 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb787d6-d5eb-4883-88cb-ff843b2b22c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:29:15.319851 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-9eb787d6-d5eb-4883-88cb-ff843b2b22c0 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:29:15.321058 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-9eb787d6-d5eb-4883-88cb-ff843b2b22c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:29:15.438018 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 696/1357] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:29:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:29:15.490777 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbd1a69-c7d6-4169-894b-8ec158ffcd52 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:29:15.491365 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbd1a69-c7d6-4169-894b-8ec158ffcd52 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:29:15.492093 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbd1a69-c7d6-4169-894b-8ec158ffcd52 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:29:15.493940 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 662/1358] 10.222.0.118 () {54 vars in 966 bytes} [Thu Jul 14 15:29:15 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:29:15.506441 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e01d80-5ca0-4cb3-9c55-0032c2f29195 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:29:15.506753 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e01d80-5ca0-4cb3-9c55-0032c2f29195 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:29:15.507004 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e01d80-5ca0-4cb3-9c55-0032c2f29195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:29:15.529892 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:29:15.595443 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-d7e01d80-5ca0-4cb3-9c55-0032c2f29195 None None] MFA Rules not processed for user `f0177fc696ea40069902803da09f437c`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:29:15.596648 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-d7e01d80-5ca0-4cb3-9c55-0032c2f29195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:29:15.733176 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 697/1359] 10.222.0.118 () {58 vars in 1063 bytes} [Thu Jul 14 15:29:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:29:15.754668 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbd1a69-c7d6-4169-894b-8ec158ffcd52 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:29:15.757368 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-1cbd1a69-c7d6-4169-894b-8ec158ffcd52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:29:15.909364 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbd1a69-c7d6-4169-894b-8ec158ffcd52 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:29:15.988246 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:29:16.040191 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e81c30-daa9-4bd6-ba59-e129698352a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0177fc696ea40069902803da09f437c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:29:16.041125 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e81c30-daa9-4bd6-ba59-e129698352a6 service nova] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:29:16.041531 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e81c30-daa9-4bd6-ba59-e129698352a6 service nova] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:29:16.041937 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e81c30-daa9-4bd6-ba59-e129698352a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:29:16.044489 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-a5e81c30-daa9-4bd6-ba59-e129698352a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:29:16.152680 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e81c30-daa9-4bd6-ba59-e129698352a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:29:16.154672 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e81c30-daa9-4bd6-ba59-e129698352a6 service nova] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:29:16.174811 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 663/1360] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:29:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:29:18.464173 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d2ebdb-b7ee-4390-9f03-2e6203c572c7 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:29:18.464682 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d2ebdb-b7ee-4390-9f03-2e6203c572c7 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:29:18.464682 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d2ebdb-b7ee-4390-9f03-2e6203c572c7 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:29:18.466175 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 698/1361] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:29:18 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:29:18.472048 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88846d62-be27-4c8a-b9cd-89766d52d830 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:29:18.472556 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88846d62-be27-4c8a-b9cd-89766d52d830 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:29:18.472646 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88846d62-be27-4c8a-b9cd-89766d52d830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:29:18.543877 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-88846d62-be27-4c8a-b9cd-89766d52d830 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:29:18.545111 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-88846d62-be27-4c8a-b9cd-89766d52d830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:29:18.585257 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:29:18.659355 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 664/1362] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:29:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:29:18.707415 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d2ebdb-b7ee-4390-9f03-2e6203c572c7 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:29:18.709436 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-82d2ebdb-b7ee-4390-9f03-2e6203c572c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:29:18.788972 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:29:18.906587 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d2ebdb-b7ee-4390-9f03-2e6203c572c7 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:29:19.031561 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429b693c-8657-4636-9518-a2a871b1b9a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0177fc696ea40069902803da09f437c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:29:19.032242 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429b693c-8657-4636-9518-a2a871b1b9a7 service nova] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:29:19.032518 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429b693c-8657-4636-9518-a2a871b1b9a7 service nova] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:29:19.032791 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429b693c-8657-4636-9518-a2a871b1b9a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:29:19.034466 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-429b693c-8657-4636-9518-a2a871b1b9a7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:29:19.058394 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:29:19.131088 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429b693c-8657-4636-9518-a2a871b1b9a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:29:19.132694 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429b693c-8657-4636-9518-a2a871b1b9a7 service nova] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:29:19.151424 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 699/1363] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:29:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:29:21.571784 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc00696-e2e2-405e-a978-a42052c6fe6f None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:29:21.572378 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc00696-e2e2-405e-a978-a42052c6fe6f None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:29:21.572378 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc00696-e2e2-405e-a978-a42052c6fe6f None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:29:21.573900 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 665/1364] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:29:21 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:29:21.579911 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d351b64-f229-475a-a2f6-425af73fff95 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:29:21.580377 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d351b64-f229-475a-a2f6-425af73fff95 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:29:21.580489 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d351b64-f229-475a-a2f6-425af73fff95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:29:21.653440 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-8d351b64-f229-475a-a2f6-425af73fff95 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:29:21.654839 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-8d351b64-f229-475a-a2f6-425af73fff95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:29:21.762317 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:29:21.765618 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 700/1365] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:29:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:29:21.812445 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc9b914-f288-4316-a557-96abf91ee19c None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:29:21.813721 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc9b914-f288-4316-a557-96abf91ee19c None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:29:21.814256 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc9b914-f288-4316-a557-96abf91ee19c None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:29:21.815722 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 666/1366] 10.222.0.118 () {54 vars in 966 bytes} [Thu Jul 14 15:29:21 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:29:21.821670 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7befcc-5a2c-4004-b825-220a6cfc7efb None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:29:21.822139 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7befcc-5a2c-4004-b825-220a6cfc7efb None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:29:21.822442 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7befcc-5a2c-4004-b825-220a6cfc7efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:29:21.903985 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-1d7befcc-5a2c-4004-b825-220a6cfc7efb None None] MFA Rules not processed for user `f0177fc696ea40069902803da09f437c`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:29:21.905193 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-1d7befcc-5a2c-4004-b825-220a6cfc7efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:29:22.037154 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 701/1367] 10.222.0.118 () {58 vars in 1063 bytes} [Thu Jul 14 15:29:21 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:29:22.052333 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc9b914-f288-4316-a557-96abf91ee19c None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:29:22.053945 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-edc9b914-f288-4316-a557-96abf91ee19c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:29:22.210670 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc9b914-f288-4316-a557-96abf91ee19c None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:29:22.239171 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:29:22.346155 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f83a9ee-dea6-4909-8fe3-d4d1f60bd5e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0177fc696ea40069902803da09f437c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:29:22.346845 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f83a9ee-dea6-4909-8fe3-d4d1f60bd5e8 service nova] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:29:22.347123 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f83a9ee-dea6-4909-8fe3-d4d1f60bd5e8 service nova] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:29:22.347420 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f83a9ee-dea6-4909-8fe3-d4d1f60bd5e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:29:22.349133 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-0f83a9ee-dea6-4909-8fe3-d4d1f60bd5e8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:29:22.452963 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f83a9ee-dea6-4909-8fe3-d4d1f60bd5e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:29:22.454912 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f83a9ee-dea6-4909-8fe3-d4d1f60bd5e8 service nova] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:29:22.474904 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 667/1368] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:29:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:29:23.421351 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5cb2ac-5b17-4bc3-b9f5-1e11d51c318f None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:29:23.421919 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5cb2ac-5b17-4bc3-b9f5-1e11d51c318f None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:29:23.421919 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5cb2ac-5b17-4bc3-b9f5-1e11d51c318f None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:29:23.423529 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 702/1369] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:29:23 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:29:23.429071 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9ff260-b52f-4bfd-8768-2429c67243f3 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:29:23.429901 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9ff260-b52f-4bfd-8768-2429c67243f3 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:29:23.430328 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9ff260-b52f-4bfd-8768-2429c67243f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:29:23.470396 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:29:23.524653 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-8f9ff260-b52f-4bfd-8768-2429c67243f3 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:29:23.526002 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-8f9ff260-b52f-4bfd-8768-2429c67243f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:29:23.640311 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 668/1370] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:29:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:29:23.992255 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac82d8c-4f92-44ef-9d64-2408e9229d4e None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:29:23.992546 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac82d8c-4f92-44ef-9d64-2408e9229d4e None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:29:23.992822 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac82d8c-4f92-44ef-9d64-2408e9229d4e None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:29:23.995349 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 703/1371] 10.222.0.118 () {54 vars in 968 bytes} [Thu Jul 14 15:29:23 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:29:24.000935 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfad7ce2-0737-4cfa-a2c3-65233e36a89c None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:29:24.001230 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfad7ce2-0737-4cfa-a2c3-65233e36a89c None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:29:24.001506 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfad7ce2-0737-4cfa-a2c3-65233e36a89c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:29:24.093651 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-bfad7ce2-0737-4cfa-a2c3-65233e36a89c None None] MFA Rules not processed for user `ea647438ea1c438987f28cbe39c3ff2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:29:24.094956 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-bfad7ce2-0737-4cfa-a2c3-65233e36a89c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:29:24.143510 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:29:24.175233 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 669/1372] 10.222.0.118 () {58 vars in 1065 bytes} [Thu Jul 14 15:29:23 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:29:24.182822 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac82d8c-4f92-44ef-9d64-2408e9229d4e None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:29:24.184350 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-aac82d8c-4f92-44ef-9d64-2408e9229d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:29:24.240669 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:29:24.304164 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac82d8c-4f92-44ef-9d64-2408e9229d4e None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:29:24.382601 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b33d17e-7d5e-4cfd-9e82-75c9b50f1b61 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea647438ea1c438987f28cbe39c3ff2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:29:24.383258 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b33d17e-7d5e-4cfd-9e82-75c9b50f1b61 service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:29:24.383535 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b33d17e-7d5e-4cfd-9e82-75c9b50f1b61 service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:29:24.383806 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b33d17e-7d5e-4cfd-9e82-75c9b50f1b61 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:29:24.385496 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-2b33d17e-7d5e-4cfd-9e82-75c9b50f1b61 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:29:24.492209 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:29:24.507892 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b33d17e-7d5e-4cfd-9e82-75c9b50f1b61 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:29:24.509356 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b33d17e-7d5e-4cfd-9e82-75c9b50f1b61 service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:29:24.530281 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 704/1373] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:29:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:29:24.650449 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095320ea-8456-4869-9fb0-1a1990b13e8d None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:29:24.650899 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095320ea-8456-4869-9fb0-1a1990b13e8d None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:29:24.651073 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095320ea-8456-4869-9fb0-1a1990b13e8d None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:29:24.657490 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 670/1374] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:29:24 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:29:24.659308 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07a968a-0536-468c-864f-0810b7eb7ceb None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:29:24.659703 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07a968a-0536-468c-864f-0810b7eb7ceb None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:29:24.660127 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07a968a-0536-468c-864f-0810b7eb7ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:29:24.747033 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-e07a968a-0536-468c-864f-0810b7eb7ceb None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:29:24.748393 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-e07a968a-0536-468c-864f-0810b7eb7ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:29:24.855661 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 705/1375] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:29:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:29:24.899141 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095320ea-8456-4869-9fb0-1a1990b13e8d None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:29:24.900883 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-095320ea-8456-4869-9fb0-1a1990b13e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:29:25.053702 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095320ea-8456-4869-9fb0-1a1990b13e8d None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:29:25.105168 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:29:25.169163 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80941d5e-8170-46f1-b4b7-01952ba5b00a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0177fc696ea40069902803da09f437c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:29:25.169816 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80941d5e-8170-46f1-b4b7-01952ba5b00a service nova] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:29:25.170132 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80941d5e-8170-46f1-b4b7-01952ba5b00a service nova] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:29:25.170438 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80941d5e-8170-46f1-b4b7-01952ba5b00a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:29:25.172258 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-80941d5e-8170-46f1-b4b7-01952ba5b00a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:29:25.269555 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80941d5e-8170-46f1-b4b7-01952ba5b00a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:29:25.271224 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80941d5e-8170-46f1-b4b7-01952ba5b00a service nova] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:29:25.289748 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 671/1376] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:29:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:29:27.374204 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5b51cc-f223-4f8c-b1bc-742f2e9889ab None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:29:27.374740 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5b51cc-f223-4f8c-b1bc-742f2e9889ab None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:29:27.374740 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5b51cc-f223-4f8c-b1bc-742f2e9889ab None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:29:27.376153 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 706/1377] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:29:27 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:29:27.381732 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bef2f1-efe1-4cfa-b96d-b3ca1f82b3de None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:29:27.382169 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bef2f1-efe1-4cfa-b96d-b3ca1f82b3de None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:29:27.382319 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bef2f1-efe1-4cfa-b96d-b3ca1f82b3de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:29:27.452830 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-27bef2f1-efe1-4cfa-b96d-b3ca1f82b3de None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:29:27.454159 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-27bef2f1-efe1-4cfa-b96d-b3ca1f82b3de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:29:27.461301 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:29:27.585447 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 672/1378] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:29:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:29:27.631839 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5b51cc-f223-4f8c-b1bc-742f2e9889ab None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:29:27.633435 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-ab5b51cc-f223-4f8c-b1bc-742f2e9889ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:29:27.695656 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:29:27.791969 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5b51cc-f223-4f8c-b1bc-742f2e9889ab None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:29:27.937769 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dc1a99-d9c0-4485-81d7-7946100ee751 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0177fc696ea40069902803da09f437c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:29:27.938582 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc1a99-d9c0-4485-81d7-7946100ee751 service nova] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:29:27.938864 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc1a99-d9c0-4485-81d7-7946100ee751 service nova] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:29:27.939368 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc1a99-d9c0-4485-81d7-7946100ee751 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:29:27.941090 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-c2dc1a99-d9c0-4485-81d7-7946100ee751 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:29:27.975323 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:29:28.082361 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dc1a99-d9c0-4485-81d7-7946100ee751 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:29:28.085495 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dc1a99-d9c0-4485-81d7-7946100ee751 service nova] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:29:28.119966 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 707/1379] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:29:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:29:30.227137 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ecf7eb-0ade-4e23-a9ec-1975c36312cc None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:29:30.227647 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ecf7eb-0ade-4e23-a9ec-1975c36312cc None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:29:30.227647 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ecf7eb-0ade-4e23-a9ec-1975c36312cc None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:29:30.229572 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 673/1380] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:29:30 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:29:30.234583 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fae904-0a7b-4460-a48d-44787235618d None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:29:30.235069 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fae904-0a7b-4460-a48d-44787235618d None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:29:30.235174 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fae904-0a7b-4460-a48d-44787235618d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:29:30.309551 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-11fae904-0a7b-4460-a48d-44787235618d None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:29:30.310835 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-11fae904-0a7b-4460-a48d-44787235618d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:29:30.408728 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:29:30.416846 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 708/1381] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:29:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:29:30.470268 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ecf7eb-0ade-4e23-a9ec-1975c36312cc None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:29:30.471835 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-82ecf7eb-0ade-4e23-a9ec-1975c36312cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:29:30.619985 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:29:30.632362 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ecf7eb-0ade-4e23-a9ec-1975c36312cc None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:29:30.771000 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96871809-1b9b-4ca9-ba02-b27afaabeab5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0177fc696ea40069902803da09f437c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:29:30.771555 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96871809-1b9b-4ca9-ba02-b27afaabeab5 service nova] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:29:30.771833 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96871809-1b9b-4ca9-ba02-b27afaabeab5 service nova] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:29:30.772107 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96871809-1b9b-4ca9-ba02-b27afaabeab5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:29:30.773750 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-96871809-1b9b-4ca9-ba02-b27afaabeab5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:29:30.869588 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96871809-1b9b-4ca9-ba02-b27afaabeab5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:29:30.871097 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96871809-1b9b-4ca9-ba02-b27afaabeab5 service nova] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:29:30.882405 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:29:30.892871 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 674/1382] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:29:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:29:33.023208 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3ea12c-0a2e-463a-b1b5-b3322a6e68af None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:29:33.024139 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3ea12c-0a2e-463a-b1b5-b3322a6e68af None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:29:33.024139 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3ea12c-0a2e-463a-b1b5-b3322a6e68af None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:29:33.025420 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 709/1383] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:29:33 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:29:33.034037 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c8d98e-f52c-4bf4-bf87-f4e5e895e25a None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:29:33.034608 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c8d98e-f52c-4bf4-bf87-f4e5e895e25a None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:29:33.035030 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c8d98e-f52c-4bf4-bf87-f4e5e895e25a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:29:33.125989 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-39c8d98e-f52c-4bf4-bf87-f4e5e895e25a None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:29:33.127669 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-39c8d98e-f52c-4bf4-bf87-f4e5e895e25a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:29:33.244616 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 675/1384] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:29:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:29:33.292594 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3ea12c-0a2e-463a-b1b5-b3322a6e68af None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:29:33.294143 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-af3ea12c-0a2e-463a-b1b5-b3322a6e68af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:29:33.454494 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3ea12c-0a2e-463a-b1b5-b3322a6e68af None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:29:33.529845 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:29:33.580501 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa43bdb-4b88-4482-a941-0cd723792c07 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0177fc696ea40069902803da09f437c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:29:33.581281 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa43bdb-4b88-4482-a941-0cd723792c07 service nova] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:29:33.581738 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa43bdb-4b88-4482-a941-0cd723792c07 service nova] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:29:33.582100 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa43bdb-4b88-4482-a941-0cd723792c07 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:29:33.584070 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-5fa43bdb-4b88-4482-a941-0cd723792c07 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:29:33.691034 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa43bdb-4b88-4482-a941-0cd723792c07 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:29:33.692964 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa43bdb-4b88-4482-a941-0cd723792c07 service nova] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:29:33.715036 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 710/1385] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:29:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:29:35.807725 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5d8870-30fa-4be7-9631-eb57fa0419a2 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:29:35.808252 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5d8870-30fa-4be7-9631-eb57fa0419a2 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:29:35.808252 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5d8870-30fa-4be7-9631-eb57fa0419a2 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:29:35.809658 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 676/1386] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:29:35 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:29:35.815918 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6dbbb2-24fd-4f5e-864b-0b55a5d65187 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:29:35.816320 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6dbbb2-24fd-4f5e-864b-0b55a5d65187 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:29:35.816461 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6dbbb2-24fd-4f5e-864b-0b55a5d65187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:29:35.892998 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-1a6dbbb2-24fd-4f5e-864b-0b55a5d65187 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:29:35.894311 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-1a6dbbb2-24fd-4f5e-864b-0b55a5d65187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:29:35.936125 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:29:36.017637 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 711/1387] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:29:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:29:36.065605 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5d8870-30fa-4be7-9631-eb57fa0419a2 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:29:36.067149 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-ec5d8870-30fa-4be7-9631-eb57fa0419a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:29:36.148600 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:29:36.221055 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5d8870-30fa-4be7-9631-eb57fa0419a2 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:29:36.341480 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0489a71a-a7e3-4b33-94a3-5a48ebb0a8c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0177fc696ea40069902803da09f437c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:29:36.342156 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0489a71a-a7e3-4b33-94a3-5a48ebb0a8c1 service nova] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:29:36.342432 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0489a71a-a7e3-4b33-94a3-5a48ebb0a8c1 service nova] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:29:36.342705 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0489a71a-a7e3-4b33-94a3-5a48ebb0a8c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:29:36.344827 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-0489a71a-a7e3-4b33-94a3-5a48ebb0a8c1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:29:36.382903 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:29:36.445817 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0489a71a-a7e3-4b33-94a3-5a48ebb0a8c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:29:36.447948 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0489a71a-a7e3-4b33-94a3-5a48ebb0a8c1 service nova] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:29:36.472447 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 677/1388] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:29:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:29:38.573089 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af04c7bb-3e51-4101-875e-526df3bee67c None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:29:38.573607 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af04c7bb-3e51-4101-875e-526df3bee67c None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:29:38.573607 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af04c7bb-3e51-4101-875e-526df3bee67c None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:29:38.574975 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 712/1389] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:29:38 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:29:38.580337 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32079a19-d0f5-4506-800b-3793b3378778 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:29:38.580785 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32079a19-d0f5-4506-800b-3793b3378778 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:29:38.580951 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32079a19-d0f5-4506-800b-3793b3378778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:29:38.647211 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-32079a19-d0f5-4506-800b-3793b3378778 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:29:38.648437 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-32079a19-d0f5-4506-800b-3793b3378778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:29:38.749079 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 678/1390] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:29:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:29:38.793573 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af04c7bb-3e51-4101-875e-526df3bee67c None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:29:38.795146 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-af04c7bb-3e51-4101-875e-526df3bee67c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:29:38.946063 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af04c7bb-3e51-4101-875e-526df3bee67c None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:29:38.965808 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:29:39.062899 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b15bf5-4521-4876-b394-ed8e6e36414a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0177fc696ea40069902803da09f437c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:29:39.063552 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b15bf5-4521-4876-b394-ed8e6e36414a service nova] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:29:39.063833 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b15bf5-4521-4876-b394-ed8e6e36414a service nova] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:29:39.064105 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b15bf5-4521-4876-b394-ed8e6e36414a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:29:39.065744 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-05b15bf5-4521-4876-b394-ed8e6e36414a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:29:39.164701 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b15bf5-4521-4876-b394-ed8e6e36414a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:29:39.171660 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b15bf5-4521-4876-b394-ed8e6e36414a service nova] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:29:39.196347 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 713/1391] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:29:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:29:39.919279 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81066caf-4b60-4293-a10e-81f643fca188 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:29:39.919856 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81066caf-4b60-4293-a10e-81f643fca188 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:29:39.919856 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81066caf-4b60-4293-a10e-81f643fca188 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:29:39.921752 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 679/1392] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:29:39 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:29:39.927102 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7edf1c8-c28f-411c-8e57-3eefba08805a None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:29:39.927552 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7edf1c8-c28f-411c-8e57-3eefba08805a None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:29:39.927658 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7edf1c8-c28f-411c-8e57-3eefba08805a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:29:39.952251 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:29:39.997580 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-d7edf1c8-c28f-411c-8e57-3eefba08805a None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:29:39.998923 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-d7edf1c8-c28f-411c-8e57-3eefba08805a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:29:40.096842 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 714/1393] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:29:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:29:40.153187 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379f7d1d-4e3f-4066-8b91-5c7347626a27 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:29:40.153540 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379f7d1d-4e3f-4066-8b91-5c7347626a27 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:29:40.154160 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379f7d1d-4e3f-4066-8b91-5c7347626a27 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:29:40.156606 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 680/1394] 10.222.0.118 () {54 vars in 967 bytes} [Thu Jul 14 15:29:40 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:29:40.161894 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf155ea6-0b09-46bc-9ce8-e04b1f89c545 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:29:40.162214 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf155ea6-0b09-46bc-9ce8-e04b1f89c545 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:29:40.162492 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf155ea6-0b09-46bc-9ce8-e04b1f89c545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:29:40.238319 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-bf155ea6-0b09-46bc-9ce8-e04b1f89c545 None None] MFA Rules not processed for user `b4336c3d678a4d33b00885def42dfb1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:29:40.239545 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-bf155ea6-0b09-46bc-9ce8-e04b1f89c545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:29:40.280889 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:29:40.319157 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 715/1395] 10.222.0.118 () {58 vars in 1064 bytes} [Thu Jul 14 15:29:40 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:29:40.327177 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379f7d1d-4e3f-4066-8b91-5c7347626a27 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:29:40.329299 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-379f7d1d-4e3f-4066-8b91-5c7347626a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:29:40.343471 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:29:40.435832 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379f7d1d-4e3f-4066-8b91-5c7347626a27 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:29:40.509916 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7452c81f-1dc3-4301-a068-e3c2554cc4f3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4336c3d678a4d33b00885def42dfb1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:29:40.510593 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7452c81f-1dc3-4301-a068-e3c2554cc4f3 service glance] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:29:40.510876 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7452c81f-1dc3-4301-a068-e3c2554cc4f3 service glance] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:29:40.511149 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7452c81f-1dc3-4301-a068-e3c2554cc4f3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:29:40.512829 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-7452c81f-1dc3-4301-a068-e3c2554cc4f3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:29:40.580993 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:29:40.622755 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7452c81f-1dc3-4301-a068-e3c2554cc4f3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:29:40.624288 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7452c81f-1dc3-4301-a068-e3c2554cc4f3 service glance] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:29:40.642815 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 681/1396] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:29:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:29:41.264215 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b18fd14-1d94-42a6-956b-145c1eac8cbb None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:29:41.265257 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b18fd14-1d94-42a6-956b-145c1eac8cbb None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:29:41.265257 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b18fd14-1d94-42a6-956b-145c1eac8cbb None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:29:41.266640 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 716/1397] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:29:41 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:29:41.272454 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3d019c-85d2-420d-b9d7-684c51616bd1 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:29:41.272906 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3d019c-85d2-420d-b9d7-684c51616bd1 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:29:41.273136 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3d019c-85d2-420d-b9d7-684c51616bd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:29:41.343767 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-0c3d019c-85d2-420d-b9d7-684c51616bd1 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:29:41.345151 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-0c3d019c-85d2-420d-b9d7-684c51616bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:29:41.350264 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74560c3a-58b2-4b2c-a2fd-436ae9b7badf None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:29:41.350554 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74560c3a-58b2-4b2c-a2fd-436ae9b7badf None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:29:41.350827 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74560c3a-58b2-4b2c-a2fd-436ae9b7badf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:29:41.424205 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-74560c3a-58b2-4b2c-a2fd-436ae9b7badf None None] MFA Rules not processed for user `f7ad5ae70939416e8157693e02997a58`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:29:41.425515 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-74560c3a-58b2-4b2c-a2fd-436ae9b7badf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:29:41.458520 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 682/1398] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:29:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:29:41.505320 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3d019c-85d2-420d-b9d7-684c51616bd1 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:29:41.506566 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-0c3d019c-85d2-420d-b9d7-684c51616bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:29:41.522932 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 717/1399] 10.222.0.118 () {58 vars in 1014 bytes} [Thu Jul 14 15:29:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:29:41.535603 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:29:41.570421 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6dc251-e868-4ca0-bc5c-61ca32d6e620 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:29:41.570707 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6dc251-e868-4ca0-bc5c-61ca32d6e620 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:29:41.570977 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6dc251-e868-4ca0-bc5c-61ca32d6e620 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:29:41.572759 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 718/1400] 10.222.0.118 () {54 vars in 947 bytes} [Thu Jul 14 15:29:41 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 14 15:29:41.579866 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f831c745-a164-4104-a480-76ec81495445 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:29:41.580240 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f831c745-a164-4104-a480-76ec81495445 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:29:41.580524 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f831c745-a164-4104-a480-76ec81495445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:29:41.630655 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3d019c-85d2-420d-b9d7-684c51616bd1 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:29:41.651310 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:29:41.659383 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-f831c745-a164-4104-a480-76ec81495445 None None] MFA Rules not processed for user `b672a6a601584d2d826147069e90a10f`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:29:41.660766 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-f831c745-a164-4104-a480-76ec81495445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:29:41.760082 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54b77a0-92e8-47ff-af42-019dde9bcc48 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0177fc696ea40069902803da09f437c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:29:41.760742 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54b77a0-92e8-47ff-af42-019dde9bcc48 service nova] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:29:41.761023 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54b77a0-92e8-47ff-af42-019dde9bcc48 service nova] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:29:41.761410 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54b77a0-92e8-47ff-af42-019dde9bcc48 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:29:41.763113 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-b54b77a0-92e8-47ff-af42-019dde9bcc48 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:29:41.782442 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:29:41.784106 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 719/1401] 10.222.0.118 () {58 vars in 1044 bytes} [Thu Jul 14 15:29:41 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:29:41.793578 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f831c745-a164-4104-a480-76ec81495445 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:29:41.803132 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f831c745-a164-4104-a480-76ec81495445 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:29:41.857173 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54b77a0-92e8-47ff-af42-019dde9bcc48 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:29:41.859373 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54b77a0-92e8-47ff-af42-019dde9bcc48 service nova] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:29:41.878072 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 683/1402] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:29:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:29:41.908912 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d73bf96-5307-4059-bc96-aff0c245ecec service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b672a6a601584d2d826147069e90a10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:29:41.909697 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d73bf96-5307-4059-bc96-aff0c245ecec service swift] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:29:41.909983 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d73bf96-5307-4059-bc96-aff0c245ecec service swift] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:29:41.910267 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d73bf96-5307-4059-bc96-aff0c245ecec service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:29:41.911941 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-5d73bf96-5307-4059-bc96-aff0c245ecec service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:29:41.914535 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:29:42.009054 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d73bf96-5307-4059-bc96-aff0c245ecec service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:29:42.010730 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d73bf96-5307-4059-bc96-aff0c245ecec service swift] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:29:42.019702 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 720/1403] 10.222.0.118 () {60 vars in 1389 bytes} [Thu Jul 14 15:29:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 14 15:29:43.966845 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cfaadb-75e0-4fcb-a719-c30f298ab52b None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:29:43.967412 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cfaadb-75e0-4fcb-a719-c30f298ab52b None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:29:43.968184 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cfaadb-75e0-4fcb-a719-c30f298ab52b None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:29:43.969988 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 684/1404] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:29:43 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:29:43.975590 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a87104-f96b-49ff-8c1e-b4e65677bb31 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:29:43.976043 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a87104-f96b-49ff-8c1e-b4e65677bb31 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:29:43.976218 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a87104-f96b-49ff-8c1e-b4e65677bb31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:29:44.054159 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-08a87104-f96b-49ff-8c1e-b4e65677bb31 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:29:44.055468 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-08a87104-f96b-49ff-8c1e-b4e65677bb31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:29:44.167489 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:29:44.174856 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 721/1405] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:29:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:29:44.219287 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cfaadb-75e0-4fcb-a719-c30f298ab52b None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:29:44.221148 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-93cfaadb-75e0-4fcb-a719-c30f298ab52b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:29:44.439544 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:29:44.442026 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cfaadb-75e0-4fcb-a719-c30f298ab52b None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:29:44.570920 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83256a1-3cdb-4ae2-87f6-b1ec1b199748 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0177fc696ea40069902803da09f437c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:29:44.570920 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83256a1-3cdb-4ae2-87f6-b1ec1b199748 service nova] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:29:44.570920 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83256a1-3cdb-4ae2-87f6-b1ec1b199748 service nova] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:29:44.570920 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83256a1-3cdb-4ae2-87f6-b1ec1b199748 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:29:44.572749 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-c83256a1-3cdb-4ae2-87f6-b1ec1b199748 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:29:44.667184 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83256a1-3cdb-4ae2-87f6-b1ec1b199748 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:29:44.668943 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83256a1-3cdb-4ae2-87f6-b1ec1b199748 service nova] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:29:44.689134 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 685/1406] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:29:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:29:46.819658 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411c6b4e-b8ec-457f-b525-92c7e5d5520f None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:29:46.820180 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411c6b4e-b8ec-457f-b525-92c7e5d5520f None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:29:46.820262 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411c6b4e-b8ec-457f-b525-92c7e5d5520f None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:29:46.821604 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 722/1407] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:29:46 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:29:46.826983 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ea1e15-cf87-410b-aeb7-86c2281a92ef None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:29:46.827476 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ea1e15-cf87-410b-aeb7-86c2281a92ef None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:29:46.827568 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ea1e15-cf87-410b-aeb7-86c2281a92ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:29:46.830846 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:29:46.909087 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-b8ea1e15-cf87-410b-aeb7-86c2281a92ef None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:29:46.910358 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-b8ea1e15-cf87-410b-aeb7-86c2281a92ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:29:47.024804 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 686/1408] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:29:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:29:47.071216 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411c6b4e-b8ec-457f-b525-92c7e5d5520f None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:29:47.072766 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-411c6b4e-b8ec-457f-b525-92c7e5d5520f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:29:47.253809 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411c6b4e-b8ec-457f-b525-92c7e5d5520f None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:29:47.350767 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:29:47.402389 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e55ab2-9198-445c-9026-a535dda8315e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0177fc696ea40069902803da09f437c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:29:47.403156 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e55ab2-9198-445c-9026-a535dda8315e service nova] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:29:47.403440 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e55ab2-9198-445c-9026-a535dda8315e service nova] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:29:47.403716 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e55ab2-9198-445c-9026-a535dda8315e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:29:47.406080 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-f0e55ab2-9198-445c-9026-a535dda8315e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:29:47.513354 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e55ab2-9198-445c-9026-a535dda8315e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:29:47.516112 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e55ab2-9198-445c-9026-a535dda8315e service nova] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:29:47.546266 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 723/1409] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:29:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:29:57.022688 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=64 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:29:57.532482 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=64 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:04.720342 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389bf198-7a43-47d7-b8d9-0afee6436d0f None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:04.720908 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389bf198-7a43-47d7-b8d9-0afee6436d0f None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:04.720908 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389bf198-7a43-47d7-b8d9-0afee6436d0f None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:04.722598 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 687/1410] 10.222.0.118 () {54 vars in 923 bytes} [Thu Jul 14 15:30:04 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:30:04.727585 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baf7035-f08c-4bbc-b883-3042d9f918b8 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:04.728014 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baf7035-f08c-4bbc-b883-3042d9f918b8 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:04.728122 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baf7035-f08c-4bbc-b883-3042d9f918b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:04.802063 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-6baf7035-f08c-4bbc-b883-3042d9f918b8 None None] MFA Rules not processed for user `e70b0f8be7e04adca6e3f218fbe3a295`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:30:04.803269 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-6baf7035-f08c-4bbc-b883-3042d9f918b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:04.909266 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 724/1411] 10.222.0.118 () {58 vars in 1020 bytes} [Thu Jul 14 15:30:04 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:30:04.924082 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17ea764-8233-43fb-8372-25b72b126807 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:04.924371 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17ea764-8233-43fb-8372-25b72b126807 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:04.924648 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17ea764-8233-43fb-8372-25b72b126807 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:04.926056 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 688/1412] 10.222.0.118 () {54 vars in 923 bytes} [Thu Jul 14 15:30:04 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:30:04.930866 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14746e43-addf-410c-811a-c3d3c950b5dd None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:04.931184 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14746e43-addf-410c-811a-c3d3c950b5dd None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:04.931458 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14746e43-addf-410c-811a-c3d3c950b5dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:05.003040 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:05.006600 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-14746e43-addf-410c-811a-c3d3c950b5dd None None] MFA Rules not processed for user `f0177fc696ea40069902803da09f437c`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:30:05.008364 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-14746e43-addf-410c-811a-c3d3c950b5dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:05.124391 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 725/1413] 10.222.0.118 () {58 vars in 1020 bytes} [Thu Jul 14 15:30:04 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:30:07.690558 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c180467f-4964-400b-bf79-8a6ab67a5285 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:07.691162 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c180467f-4964-400b-bf79-8a6ab67a5285 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:07.691517 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c180467f-4964-400b-bf79-8a6ab67a5285 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:07.693997 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 689/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 15:30:07 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:30:07.699343 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f540c8e-b011-4eff-b05b-09f6bbf31253 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:07.699804 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f540c8e-b011-4eff-b05b-09f6bbf31253 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:07.699903 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f540c8e-b011-4eff-b05b-09f6bbf31253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:07.766928 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-1f540c8e-b011-4eff-b05b-09f6bbf31253 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:30:07.768152 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-1f540c8e-b011-4eff-b05b-09f6bbf31253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:07.825392 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:07.867887 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 726/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 15:30:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:30:07.910478 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c180467f-4964-400b-bf79-8a6ab67a5285 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:30:07.912100 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-c180467f-4964-400b-bf79-8a6ab67a5285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:08.065160 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c180467f-4964-400b-bf79-8a6ab67a5285 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:30:08.148604 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:08.190436 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4038ef-f707-4eed-a1d5-8722f838d961 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0177fc696ea40069902803da09f437c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:30:08.191085 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4038ef-f707-4eed-a1d5-8722f838d961 service nova] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:08.191368 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4038ef-f707-4eed-a1d5-8722f838d961 service nova] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:08.191641 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4038ef-f707-4eed-a1d5-8722f838d961 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:08.193328 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-af4038ef-f707-4eed-a1d5-8722f838d961 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:08.284676 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4038ef-f707-4eed-a1d5-8722f838d961 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:30:08.296880 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4038ef-f707-4eed-a1d5-8722f838d961 service nova] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:30:08.313012 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 690/1416] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:30:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:30:09.221639 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9665c21e-0455-4311-a397-4c542b3310d2 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:09.222236 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9665c21e-0455-4311-a397-4c542b3310d2 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:09.222236 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9665c21e-0455-4311-a397-4c542b3310d2 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:09.223613 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 727/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 15:30:09 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:30:09.228925 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fd4229-e4e0-46e3-b9b0-fe48f114d764 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:09.229311 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fd4229-e4e0-46e3-b9b0-fe48f114d764 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:09.229481 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fd4229-e4e0-46e3-b9b0-fe48f114d764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:09.304025 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-a4fd4229-e4e0-46e3-b9b0-fe48f114d764 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:30:09.305259 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-a4fd4229-e4e0-46e3-b9b0-fe48f114d764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:09.332315 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:09.401829 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 691/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 15:30:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:30:09.551414 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9665c21e-0455-4311-a397-4c542b3310d2 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:30:09.552844 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-9665c21e-0455-4311-a397-4c542b3310d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:09.699370 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9665c21e-0455-4311-a397-4c542b3310d2 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:30:09.741089 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:09.814907 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8db759-7486-489f-8461-f05d2f753a16 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0177fc696ea40069902803da09f437c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:30:09.815531 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8db759-7486-489f-8461-f05d2f753a16 service nova] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:09.815811 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8db759-7486-489f-8461-f05d2f753a16 service nova] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:09.816085 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8db759-7486-489f-8461-f05d2f753a16 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:09.817749 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-1a8db759-7486-489f-8461-f05d2f753a16 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:09.905602 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8db759-7486-489f-8461-f05d2f753a16 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:30:09.907233 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8db759-7486-489f-8461-f05d2f753a16 service nova] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:30:09.925473 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 728/1419] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:30:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:30:10.826321 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d29ba1a-7374-4e9d-a66d-95c6df33711a None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:10.826934 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d29ba1a-7374-4e9d-a66d-95c6df33711a None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:10.826934 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d29ba1a-7374-4e9d-a66d-95c6df33711a None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:10.828229 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 692/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 15:30:10 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:30:10.833160 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3415c041-8db0-4e6f-80e5-54058db28e81 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:10.833608 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3415c041-8db0-4e6f-80e5-54058db28e81 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:10.833711 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3415c041-8db0-4e6f-80e5-54058db28e81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:10.887441 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:10.911221 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-3415c041-8db0-4e6f-80e5-54058db28e81 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:30:10.912515 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-3415c041-8db0-4e6f-80e5-54058db28e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:11.012868 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 729/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 15:30:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:30:11.163638 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d29ba1a-7374-4e9d-a66d-95c6df33711a None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:30:11.165152 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-4d29ba1a-7374-4e9d-a66d-95c6df33711a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:11.313898 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d29ba1a-7374-4e9d-a66d-95c6df33711a None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:30:11.326981 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:11.441200 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32489cf0-2e06-4c5b-aab9-ea45cba42cd9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0177fc696ea40069902803da09f437c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:30:11.441855 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32489cf0-2e06-4c5b-aab9-ea45cba42cd9 service nova] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:11.442171 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32489cf0-2e06-4c5b-aab9-ea45cba42cd9 service nova] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:11.442447 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32489cf0-2e06-4c5b-aab9-ea45cba42cd9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:11.444129 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-32489cf0-2e06-4c5b-aab9-ea45cba42cd9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:11.537029 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32489cf0-2e06-4c5b-aab9-ea45cba42cd9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:30:11.538679 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32489cf0-2e06-4c5b-aab9-ea45cba42cd9 service nova] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:30:11.557753 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 693/1422] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:30:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:30:12.421459 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9520999c-4414-4782-888a-a49a5ae0091a None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:12.422029 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9520999c-4414-4782-888a-a49a5ae0091a None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:12.422029 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9520999c-4414-4782-888a-a49a5ae0091a None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:12.423426 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 730/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 15:30:12 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:30:12.428431 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5474c3-3789-41a4-a59d-0051c8d44418 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:12.428884 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5474c3-3789-41a4-a59d-0051c8d44418 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:12.428986 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5474c3-3789-41a4-a59d-0051c8d44418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:12.449579 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:12.506250 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-8e5474c3-3789-41a4-a59d-0051c8d44418 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:30:12.507463 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-8e5474c3-3789-41a4-a59d-0051c8d44418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:12.601802 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 694/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 15:30:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:30:12.751722 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9520999c-4414-4782-888a-a49a5ae0091a None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:30:12.753281 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-9520999c-4414-4782-888a-a49a5ae0091a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:12.861088 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:12.897240 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9520999c-4414-4782-888a-a49a5ae0091a None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:30:13.009318 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f3bd2e-bcb7-4df4-b915-fe739446f46f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0177fc696ea40069902803da09f437c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:30:13.009955 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f3bd2e-bcb7-4df4-b915-fe739446f46f service nova] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:13.010254 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f3bd2e-bcb7-4df4-b915-fe739446f46f service nova] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:13.010519 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f3bd2e-bcb7-4df4-b915-fe739446f46f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:13.012156 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-05f3bd2e-bcb7-4df4-b915-fe739446f46f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:13.086340 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:13.099642 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f3bd2e-bcb7-4df4-b915-fe739446f46f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:30:13.101246 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f3bd2e-bcb7-4df4-b915-fe739446f46f service nova] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:30:13.119706 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 731/1425] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:30:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:30:14.003771 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbdff5f-f058-4bd3-b041-0bb644096826 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:14.004274 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbdff5f-f058-4bd3-b041-0bb644096826 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:14.004274 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbdff5f-f058-4bd3-b041-0bb644096826 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:14.005622 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 695/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 15:30:14 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:30:14.010654 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04a9f1d-394a-45d4-9d23-c39669d5a328 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:14.011060 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04a9f1d-394a-45d4-9d23-c39669d5a328 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:14.011317 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04a9f1d-394a-45d4-9d23-c39669d5a328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:14.084842 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-f04a9f1d-394a-45d4-9d23-c39669d5a328 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:30:14.086141 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-f04a9f1d-394a-45d4-9d23-c39669d5a328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:14.184286 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 732/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 15:30:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:30:14.336430 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbdff5f-f058-4bd3-b041-0bb644096826 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:30:14.337941 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-8cbdff5f-f058-4bd3-b041-0bb644096826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:14.423790 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:14.486913 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbdff5f-f058-4bd3-b041-0bb644096826 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:30:14.599788 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645a6929-1b9c-4aa5-82e6-35f2b3cd858c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0177fc696ea40069902803da09f437c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:30:14.600352 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645a6929-1b9c-4aa5-82e6-35f2b3cd858c service nova] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:14.600638 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645a6929-1b9c-4aa5-82e6-35f2b3cd858c service nova] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:14.600912 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645a6929-1b9c-4aa5-82e6-35f2b3cd858c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:14.602692 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-645a6929-1b9c-4aa5-82e6-35f2b3cd858c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:14.651481 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:14.691734 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645a6929-1b9c-4aa5-82e6-35f2b3cd858c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:30:14.693340 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645a6929-1b9c-4aa5-82e6-35f2b3cd858c service nova] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:30:14.711714 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 696/1428] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:30:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:30:15.523471 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc81579a-17c3-483e-8f39-733fc0c34bf7 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:15.524042 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc81579a-17c3-483e-8f39-733fc0c34bf7 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:15.524042 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc81579a-17c3-483e-8f39-733fc0c34bf7 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:15.525409 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 733/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 15:30:15 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:30:15.530959 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6325c8-6700-4aa9-ab51-f0a4e35b1da7 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:15.531365 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6325c8-6700-4aa9-ab51-f0a4e35b1da7 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:15.531513 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6325c8-6700-4aa9-ab51-f0a4e35b1da7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:15.605724 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-9f6325c8-6700-4aa9-ab51-f0a4e35b1da7 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:30:15.607538 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-9f6325c8-6700-4aa9-ab51-f0a4e35b1da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:15.703242 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 697/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 15:30:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:30:15.854054 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc81579a-17c3-483e-8f39-733fc0c34bf7 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:30:15.855549 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-bc81579a-17c3-483e-8f39-733fc0c34bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:15.904834 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:16.004438 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc81579a-17c3-483e-8f39-733fc0c34bf7 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:30:16.115935 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b940d59e-6760-4d7e-83b6-3f9f321799bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0177fc696ea40069902803da09f437c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:30:16.116499 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b940d59e-6760-4d7e-83b6-3f9f321799bc service nova] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:16.116782 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b940d59e-6760-4d7e-83b6-3f9f321799bc service nova] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:16.117053 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b940d59e-6760-4d7e-83b6-3f9f321799bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:16.118743 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-b940d59e-6760-4d7e-83b6-3f9f321799bc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:16.126200 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:16.208778 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b940d59e-6760-4d7e-83b6-3f9f321799bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:30:16.210434 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b940d59e-6760-4d7e-83b6-3f9f321799bc service nova] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:30:16.237242 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 734/1431] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:30:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:30:17.045024 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ccd7ea-755a-4f5c-86cf-848dcc527d2e None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:17.045568 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ccd7ea-755a-4f5c-86cf-848dcc527d2e None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:17.045568 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ccd7ea-755a-4f5c-86cf-848dcc527d2e None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:17.046924 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 698/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 15:30:17 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:30:17.052054 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbf1657-8635-4a7b-86af-b3c906065b81 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:17.052502 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbf1657-8635-4a7b-86af-b3c906065b81 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:17.052600 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbf1657-8635-4a7b-86af-b3c906065b81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:17.127698 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-dcbf1657-8635-4a7b-86af-b3c906065b81 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:30:17.128904 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-dcbf1657-8635-4a7b-86af-b3c906065b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:17.200432 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:17.229936 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 735/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 15:30:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:30:17.380163 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ccd7ea-755a-4f5c-86cf-848dcc527d2e None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:30:17.381638 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-23ccd7ea-755a-4f5c-86cf-848dcc527d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:17.400354 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:17.540846 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ccd7ea-755a-4f5c-86cf-848dcc527d2e None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:30:17.626595 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:17.652231 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca23622-503b-4bac-8c4c-e10e7674a4d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0177fc696ea40069902803da09f437c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:30:17.652888 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca23622-503b-4bac-8c4c-e10e7674a4d2 service nova] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:17.653199 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca23622-503b-4bac-8c4c-e10e7674a4d2 service nova] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:17.653990 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca23622-503b-4bac-8c4c-e10e7674a4d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:17.655686 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-8ca23622-503b-4bac-8c4c-e10e7674a4d2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:17.747825 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca23622-503b-4bac-8c4c-e10e7674a4d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:30:17.749453 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca23622-503b-4bac-8c4c-e10e7674a4d2 service nova] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:30:17.767460 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 699/1434] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:30:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:30:18.591439 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70fee15-816f-44c9-b8aa-716522ce3ccd None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:18.591958 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70fee15-816f-44c9-b8aa-716522ce3ccd None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:18.591958 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70fee15-816f-44c9-b8aa-716522ce3ccd None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:18.593302 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 736/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 15:30:18 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:30:18.598255 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8613d6d3-b89d-4937-be77-1afc69a04f1a None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:18.598660 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8613d6d3-b89d-4937-be77-1afc69a04f1a None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:18.598806 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8613d6d3-b89d-4937-be77-1afc69a04f1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:18.672589 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-8613d6d3-b89d-4937-be77-1afc69a04f1a None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:30:18.673808 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-8613d6d3-b89d-4937-be77-1afc69a04f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:18.715122 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:18.770848 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 700/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 15:30:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:30:18.926331 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70fee15-816f-44c9-b8aa-716522ce3ccd None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:30:18.927835 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-c70fee15-816f-44c9-b8aa-716522ce3ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:19.074982 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70fee15-816f-44c9-b8aa-716522ce3ccd None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:30:19.130236 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:19.191717 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4174b629-a0b6-4f91-b944-bb4829b3eca0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0177fc696ea40069902803da09f437c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:30:19.192283 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4174b629-a0b6-4f91-b944-bb4829b3eca0 service nova] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:19.192570 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4174b629-a0b6-4f91-b944-bb4829b3eca0 service nova] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:19.192833 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4174b629-a0b6-4f91-b944-bb4829b3eca0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:19.194523 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-4174b629-a0b6-4f91-b944-bb4829b3eca0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:19.286310 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4174b629-a0b6-4f91-b944-bb4829b3eca0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:30:19.287905 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4174b629-a0b6-4f91-b944-bb4829b3eca0 service nova] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:30:19.305631 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 737/1437] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:30:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:30:20.123681 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ddd4c6-f6f8-432b-a61e-98e5f5a14889 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:20.124265 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ddd4c6-f6f8-432b-a61e-98e5f5a14889 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:20.124265 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ddd4c6-f6f8-432b-a61e-98e5f5a14889 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:20.125599 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 701/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 15:30:20 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:30:20.130508 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72b34cf-cbb6-4c61-b079-641da4c9b2b3 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:20.130911 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72b34cf-cbb6-4c61-b079-641da4c9b2b3 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:20.131053 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72b34cf-cbb6-4c61-b079-641da4c9b2b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:20.204429 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-e72b34cf-cbb6-4c61-b079-641da4c9b2b3 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:30:20.205638 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-e72b34cf-cbb6-4c61-b079-641da4c9b2b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:20.207673 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:20.307392 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 738/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 15:30:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:30:20.459243 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ddd4c6-f6f8-432b-a61e-98e5f5a14889 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:30:20.460796 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-e3ddd4c6-f6f8-432b-a61e-98e5f5a14889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:20.608685 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ddd4c6-f6f8-432b-a61e-98e5f5a14889 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:30:20.636551 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:20.723546 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad85c0a3-16c3-4f6e-a517-54ad49922031 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0177fc696ea40069902803da09f437c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:30:20.724199 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad85c0a3-16c3-4f6e-a517-54ad49922031 service nova] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:20.724470 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad85c0a3-16c3-4f6e-a517-54ad49922031 service nova] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:20.724739 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad85c0a3-16c3-4f6e-a517-54ad49922031 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:20.726413 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-ad85c0a3-16c3-4f6e-a517-54ad49922031 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:20.815191 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad85c0a3-16c3-4f6e-a517-54ad49922031 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:30:20.816826 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad85c0a3-16c3-4f6e-a517-54ad49922031 service nova] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:30:20.835732 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 702/1440] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:30:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:30:22.799250 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042415a9-588c-4ddc-b7bf-b556fd86509b None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:22.799773 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042415a9-588c-4ddc-b7bf-b556fd86509b None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:22.799773 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042415a9-588c-4ddc-b7bf-b556fd86509b None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:22.801107 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 739/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 15:30:22 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:30:22.806365 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3841806-b978-4a9f-b532-0cb239c244db None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:22.806776 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3841806-b978-4a9f-b532-0cb239c244db None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:22.806907 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3841806-b978-4a9f-b532-0cb239c244db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:22.848536 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:22.874708 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-d3841806-b978-4a9f-b532-0cb239c244db None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:30:22.875929 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-d3841806-b978-4a9f-b532-0cb239c244db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:22.974611 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 703/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 15:30:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:30:23.013853 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042415a9-588c-4ddc-b7bf-b556fd86509b None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:30:23.015404 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-042415a9-588c-4ddc-b7bf-b556fd86509b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:23.118839 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042415a9-588c-4ddc-b7bf-b556fd86509b None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:30:23.151915 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:23.193245 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87321178-faff-4127-b393-cb4f16dac422 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b650be8114b64df0ac88441f1c50b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:30:23.193893 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87321178-faff-4127-b393-cb4f16dac422 service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:23.194202 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87321178-faff-4127-b393-cb4f16dac422 service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:23.194486 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87321178-faff-4127-b393-cb4f16dac422 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:23.196125 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-87321178-faff-4127-b393-cb4f16dac422 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:23.304473 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87321178-faff-4127-b393-cb4f16dac422 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:30:23.305912 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87321178-faff-4127-b393-cb4f16dac422 service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:30:23.324612 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 740/1443] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:30:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:30:25.519658 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc05decf-1301-4675-bef6-536bc339e0ba None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:25.520152 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc05decf-1301-4675-bef6-536bc339e0ba None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:25.520152 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc05decf-1301-4675-bef6-536bc339e0ba None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:25.521669 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 704/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 15:30:25 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:30:25.527196 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a889d28-8fce-4c7d-89f7-1547f561807d None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:25.527679 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a889d28-8fce-4c7d-89f7-1547f561807d None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:25.527798 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a889d28-8fce-4c7d-89f7-1547f561807d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:25.594362 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-7a889d28-8fce-4c7d-89f7-1547f561807d None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:30:25.595601 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-7a889d28-8fce-4c7d-89f7-1547f561807d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:25.609043 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:25.696696 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 741/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 15:30:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:30:25.736334 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc05decf-1301-4675-bef6-536bc339e0ba None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:30:25.737864 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-cc05decf-1301-4675-bef6-536bc339e0ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:25.841451 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc05decf-1301-4675-bef6-536bc339e0ba None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:30:25.853424 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:25.916253 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdbce59-3df1-46a9-8ba3-8d53be120d16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b650be8114b64df0ac88441f1c50b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:30:25.916912 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdbce59-3df1-46a9-8ba3-8d53be120d16 service neutron] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:25.917192 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdbce59-3df1-46a9-8ba3-8d53be120d16 service neutron] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:25.917464 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdbce59-3df1-46a9-8ba3-8d53be120d16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:25.919748 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-bbdbce59-3df1-46a9-8ba3-8d53be120d16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:26.027586 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdbce59-3df1-46a9-8ba3-8d53be120d16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:30:26.029596 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdbce59-3df1-46a9-8ba3-8d53be120d16 service neutron] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:30:26.048221 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 705/1446] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:30:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:30:28.493473 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e35c44-e077-4b52-a359-d68c18518868 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:28.494019 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e35c44-e077-4b52-a359-d68c18518868 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:28.494119 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e35c44-e077-4b52-a359-d68c18518868 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:28.495848 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 742/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 15:30:28 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:30:28.502063 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75926408-dc3f-4481-a46c-5927cd4e72f7 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:28.502493 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75926408-dc3f-4481-a46c-5927cd4e72f7 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:28.502600 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75926408-dc3f-4481-a46c-5927cd4e72f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:28.551994 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:28.571715 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-75926408-dc3f-4481-a46c-5927cd4e72f7 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:30:28.572871 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-75926408-dc3f-4481-a46c-5927cd4e72f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:28.677022 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 706/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 15:30:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:30:28.717943 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e35c44-e077-4b52-a359-d68c18518868 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:30:28.719628 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-b0e35c44-e077-4b52-a359-d68c18518868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:28.832301 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e35c44-e077-4b52-a359-d68c18518868 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:30:28.874989 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:28.912437 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be2d3ce-2f4b-449b-b701-f4328439b86b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b650be8114b64df0ac88441f1c50b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:30:28.913096 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be2d3ce-2f4b-449b-b701-f4328439b86b service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:28.913379 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be2d3ce-2f4b-449b-b701-f4328439b86b service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:28.913654 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be2d3ce-2f4b-449b-b701-f4328439b86b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:28.915384 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-3be2d3ce-2f4b-449b-b701-f4328439b86b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:29.033665 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be2d3ce-2f4b-449b-b701-f4328439b86b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:30:29.035134 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be2d3ce-2f4b-449b-b701-f4328439b86b service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:30:29.054476 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 743/1449] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:30:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:30:31.276910 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6eb23-c0a4-4a5a-9a64-308024b8996a None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:31.277443 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6eb23-c0a4-4a5a-9a64-308024b8996a None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:31.277443 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6eb23-c0a4-4a5a-9a64-308024b8996a None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:31.279371 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 707/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 15:30:31 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:30:31.284896 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e533eef8-0f5f-4ac6-aca5-5668377da228 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:31.285346 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e533eef8-0f5f-4ac6-aca5-5668377da228 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:31.285429 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e533eef8-0f5f-4ac6-aca5-5668377da228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:31.353115 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-e533eef8-0f5f-4ac6-aca5-5668377da228 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:30:31.354671 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-e533eef8-0f5f-4ac6-aca5-5668377da228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:31.378432 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:31.463035 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 744/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 15:30:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:30:31.503581 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca6eb23-c0a4-4a5a-9a64-308024b8996a None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:30:31.505130 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-6ca6eb23-c0a4-4a5a-9a64-308024b8996a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:31.618056 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca6eb23-c0a4-4a5a-9a64-308024b8996a None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:30:31.639453 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:31.696650 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238063bc-6cd0-425a-8005-e3a5a9786526 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b650be8114b64df0ac88441f1c50b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:30:31.697336 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238063bc-6cd0-425a-8005-e3a5a9786526 service neutron] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:31.697734 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238063bc-6cd0-425a-8005-e3a5a9786526 service neutron] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:31.697894 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238063bc-6cd0-425a-8005-e3a5a9786526 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:31.700148 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-238063bc-6cd0-425a-8005-e3a5a9786526 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:31.836324 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238063bc-6cd0-425a-8005-e3a5a9786526 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:30:31.837782 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238063bc-6cd0-425a-8005-e3a5a9786526 service neutron] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:30:31.859868 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 708/1452] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:30:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:30:33.998534 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa29081-5d86-4954-ab79-f2ff269a9f1a None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:33.999408 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa29081-5d86-4954-ab79-f2ff269a9f1a None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:33.999684 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa29081-5d86-4954-ab79-f2ff269a9f1a None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:34.001088 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 745/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 15:30:33 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:30:34.006709 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf127de-c9ce-4b71-94d0-a771ea2d96a0 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:34.007162 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf127de-c9ce-4b71-94d0-a771ea2d96a0 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:34.007270 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf127de-c9ce-4b71-94d0-a771ea2d96a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:34.072547 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:34.076322 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-acf127de-c9ce-4b71-94d0-a771ea2d96a0 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:30:34.078269 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-acf127de-c9ce-4b71-94d0-a771ea2d96a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:34.183129 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 709/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 15:30:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:30:34.222624 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa29081-5d86-4954-ab79-f2ff269a9f1a None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:30:34.224158 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-8aa29081-5d86-4954-ab79-f2ff269a9f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:34.347668 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa29081-5d86-4954-ab79-f2ff269a9f1a None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:30:34.402558 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:34.430547 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0d8f20-2799-4c12-ba85-5d476ba2884d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b650be8114b64df0ac88441f1c50b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:30:34.431642 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d8f20-2799-4c12-ba85-5d476ba2884d service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:34.432044 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d8f20-2799-4c12-ba85-5d476ba2884d service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:34.432407 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d8f20-2799-4c12-ba85-5d476ba2884d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:34.434799 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-9f0d8f20-2799-4c12-ba85-5d476ba2884d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:34.582457 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0d8f20-2799-4c12-ba85-5d476ba2884d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:30:34.584445 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0d8f20-2799-4c12-ba85-5d476ba2884d service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:30:34.607873 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 746/1455] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:30:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:30:36.754130 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6cdef4-bea2-4c8f-a03d-04b7ee800c93 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:36.754651 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6cdef4-bea2-4c8f-a03d-04b7ee800c93 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:36.754747 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6cdef4-bea2-4c8f-a03d-04b7ee800c93 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:36.756063 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 710/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 15:30:36 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:30:36.761217 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a791e4-6d00-444d-8173-fde03255fb7b None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:36.761638 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a791e4-6d00-444d-8173-fde03255fb7b None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:36.762287 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a791e4-6d00-444d-8173-fde03255fb7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:36.827176 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-64a791e4-6d00-444d-8173-fde03255fb7b None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:30:36.828363 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-64a791e4-6d00-444d-8173-fde03255fb7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:36.856669 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:36.924044 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 747/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 15:30:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:30:36.962562 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6cdef4-bea2-4c8f-a03d-04b7ee800c93 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:30:36.964107 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-4f6cdef4-bea2-4c8f-a03d-04b7ee800c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:37.067215 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6cdef4-bea2-4c8f-a03d-04b7ee800c93 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:30:37.094775 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:37.139419 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29cda05-25dd-4341-ab00-77237dd7de20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b650be8114b64df0ac88441f1c50b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:30:37.140064 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29cda05-25dd-4341-ab00-77237dd7de20 service neutron] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:37.140339 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29cda05-25dd-4341-ab00-77237dd7de20 service neutron] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:37.140606 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29cda05-25dd-4341-ab00-77237dd7de20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:37.142289 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-a29cda05-25dd-4341-ab00-77237dd7de20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:37.251714 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29cda05-25dd-4341-ab00-77237dd7de20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:30:37.253156 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29cda05-25dd-4341-ab00-77237dd7de20 service neutron] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:30:37.271244 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 711/1458] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:30:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:30:39.458524 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501d4747-bea2-4ab5-9d56-d67b6cc336db None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:39.459093 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501d4747-bea2-4ab5-9d56-d67b6cc336db None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:39.459093 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501d4747-bea2-4ab5-9d56-d67b6cc336db None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:39.460479 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 748/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 15:30:39 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:30:39.465944 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07146dc4-7c4b-43d9-b12d-97d509be9f31 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:39.466405 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07146dc4-7c4b-43d9-b12d-97d509be9f31 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:39.466545 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07146dc4-7c4b-43d9-b12d-97d509be9f31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:39.532552 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-07146dc4-7c4b-43d9-b12d-97d509be9f31 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:30:39.533787 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-07146dc4-7c4b-43d9-b12d-97d509be9f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:39.542114 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:39.631129 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 712/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 15:30:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:30:39.669842 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501d4747-bea2-4ab5-9d56-d67b6cc336db None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:30:39.671460 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-501d4747-bea2-4ab5-9d56-d67b6cc336db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:39.774547 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501d4747-bea2-4ab5-9d56-d67b6cc336db None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:30:39.829129 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:39.847906 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2438bed6-e10f-4c47-a9bf-9d7e2c8fcaa5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b650be8114b64df0ac88441f1c50b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:30:39.848546 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2438bed6-e10f-4c47-a9bf-9d7e2c8fcaa5 service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:39.848823 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2438bed6-e10f-4c47-a9bf-9d7e2c8fcaa5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:39.849094 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2438bed6-e10f-4c47-a9bf-9d7e2c8fcaa5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:39.850759 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-2438bed6-e10f-4c47-a9bf-9d7e2c8fcaa5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:39.961207 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2438bed6-e10f-4c47-a9bf-9d7e2c8fcaa5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:30:39.962665 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2438bed6-e10f-4c47-a9bf-9d7e2c8fcaa5 service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:30:39.980279 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 749/1461] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:30:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:30:42.101236 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a622f074-ac75-4f16-9dbe-1cfb3152a03d None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:42.101821 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a622f074-ac75-4f16-9dbe-1cfb3152a03d None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:42.101821 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a622f074-ac75-4f16-9dbe-1cfb3152a03d None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:42.103136 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 713/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 15:30:42 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:30:42.108879 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc46ae6b-a426-4814-993f-b35dec9bb4af None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:42.109314 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc46ae6b-a426-4814-993f-b35dec9bb4af None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:42.109435 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc46ae6b-a426-4814-993f-b35dec9bb4af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:42.174293 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-fc46ae6b-a426-4814-993f-b35dec9bb4af None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:30:42.175505 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-fc46ae6b-a426-4814-993f-b35dec9bb4af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:42.214328 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:42.272968 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 750/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 15:30:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:30:42.311847 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a622f074-ac75-4f16-9dbe-1cfb3152a03d None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:30:42.313370 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-a622f074-ac75-4f16-9dbe-1cfb3152a03d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:42.416128 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a622f074-ac75-4f16-9dbe-1cfb3152a03d None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:30:42.456468 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:42.492197 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e1055b-81d3-4a30-a030-6c7ba4d9c8fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b650be8114b64df0ac88441f1c50b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:30:42.492844 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e1055b-81d3-4a30-a030-6c7ba4d9c8fa service neutron] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:42.493122 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e1055b-81d3-4a30-a030-6c7ba4d9c8fa service neutron] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:42.493396 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e1055b-81d3-4a30-a030-6c7ba4d9c8fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:42.495086 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-84e1055b-81d3-4a30-a030-6c7ba4d9c8fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:42.607368 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e1055b-81d3-4a30-a030-6c7ba4d9c8fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:30:42.610232 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e1055b-81d3-4a30-a030-6c7ba4d9c8fa service neutron] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:30:42.634447 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 714/1464] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:30:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:30:44.666370 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d047c7d9-20e4-4198-a9dd-49c58a60cee3 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:44.666956 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d047c7d9-20e4-4198-a9dd-49c58a60cee3 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:44.666956 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d047c7d9-20e4-4198-a9dd-49c58a60cee3 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:44.668919 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 751/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 15:30:44 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:30:44.674186 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cac6da-d6fa-4427-8562-efc9ca48389c None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:44.674644 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cac6da-d6fa-4427-8562-efc9ca48389c None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:44.674834 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cac6da-d6fa-4427-8562-efc9ca48389c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:44.738982 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-28cac6da-d6fa-4427-8562-efc9ca48389c None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:30:44.740184 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-28cac6da-d6fa-4427-8562-efc9ca48389c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:44.758252 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:44.837026 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 715/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 15:30:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:30:44.875129 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d047c7d9-20e4-4198-a9dd-49c58a60cee3 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:30:44.876779 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-d047c7d9-20e4-4198-a9dd-49c58a60cee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:44.979777 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d047c7d9-20e4-4198-a9dd-49c58a60cee3 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:30:45.048566 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:45.055912 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79cb3f9-09d5-46c3-a1a0-7faa94631d4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b650be8114b64df0ac88441f1c50b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:30:45.056554 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79cb3f9-09d5-46c3-a1a0-7faa94631d4e service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:45.056829 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79cb3f9-09d5-46c3-a1a0-7faa94631d4e service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:45.057099 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79cb3f9-09d5-46c3-a1a0-7faa94631d4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:45.058811 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-a79cb3f9-09d5-46c3-a1a0-7faa94631d4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:45.165020 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79cb3f9-09d5-46c3-a1a0-7faa94631d4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:30:45.166472 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79cb3f9-09d5-46c3-a1a0-7faa94631d4e service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:30:45.184340 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 752/1467] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:30:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:30:47.227019 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bef650-9a3f-4ea2-99f9-85e9ce081a14 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:47.227584 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bef650-9a3f-4ea2-99f9-85e9ce081a14 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:47.227584 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bef650-9a3f-4ea2-99f9-85e9ce081a14 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:47.228957 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 716/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 15:30:47 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:30:47.234357 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e567b40-b2ab-4ba1-8f9d-9569d10e5501 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:47.234779 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e567b40-b2ab-4ba1-8f9d-9569d10e5501 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:47.234913 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e567b40-b2ab-4ba1-8f9d-9569d10e5501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:47.300507 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-4e567b40-b2ab-4ba1-8f9d-9569d10e5501 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:30:47.301729 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-4e567b40-b2ab-4ba1-8f9d-9569d10e5501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:47.349048 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:47.397675 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 753/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 15:30:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:30:47.435460 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bef650-9a3f-4ea2-99f9-85e9ce081a14 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:30:47.437140 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-d4bef650-9a3f-4ea2-99f9-85e9ce081a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:47.544595 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bef650-9a3f-4ea2-99f9-85e9ce081a14 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:30:47.592139 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:47.618882 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c7c4b4-af49-429f-8004-102c0a2693c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b650be8114b64df0ac88441f1c50b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:30:47.619570 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c7c4b4-af49-429f-8004-102c0a2693c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:47.619842 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c7c4b4-af49-429f-8004-102c0a2693c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:47.620115 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c7c4b4-af49-429f-8004-102c0a2693c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:47.622101 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-30c7c4b4-af49-429f-8004-102c0a2693c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:47.728916 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c7c4b4-af49-429f-8004-102c0a2693c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:30:47.730486 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c7c4b4-af49-429f-8004-102c0a2693c9 service neutron] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:30:47.749494 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 717/1470] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:30:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:30:57.395832 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=22 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:57.747156 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=66 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:31:07.553437 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd8387-918c-4d28-9247-f933ea177e01 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:31:07.553994 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd8387-918c-4d28-9247-f933ea177e01 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:31:07.553994 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd8387-918c-4d28-9247-f933ea177e01 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:31:07.555328 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 754/1471] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:31:07 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:31:07.561204 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4591dce5-7cd7-4701-b2bc-cdc9377a4155 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:31:07.561674 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4591dce5-7cd7-4701-b2bc-cdc9377a4155 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:31:07.561783 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4591dce5-7cd7-4701-b2bc-cdc9377a4155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:31:07.626894 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-4591dce5-7cd7-4701-b2bc-cdc9377a4155 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:31:07.628110 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-4591dce5-7cd7-4701-b2bc-cdc9377a4155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:31:07.724030 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 718/1472] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:31:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:31:07.808438 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391afd0c-4d23-4916-9658-742151ca93c9 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:31:07.808672 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391afd0c-4d23-4916-9658-742151ca93c9 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:31:07.808952 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391afd0c-4d23-4916-9658-742151ca93c9 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:31:07.810401 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 755/1473] 10.222.0.118 () {54 vars in 967 bytes} [Thu Jul 14 15:31:07 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:31:07.815302 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf8dec4-01eb-4116-a845-f635e6f29cda None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:31:07.815730 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf8dec4-01eb-4116-a845-f635e6f29cda None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:31:07.816008 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf8dec4-01eb-4116-a845-f635e6f29cda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:31:07.889649 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-daf8dec4-01eb-4116-a845-f635e6f29cda None None] MFA Rules not processed for user `b4336c3d678a4d33b00885def42dfb1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:31:07.890889 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-daf8dec4-01eb-4116-a845-f635e6f29cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:31:07.911653 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:31:07.967043 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 719/1474] 10.222.0.118 () {58 vars in 1064 bytes} [Thu Jul 14 15:31:07 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:31:07.974582 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391afd0c-4d23-4916-9658-742151ca93c9 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:31:07.976098 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-391afd0c-4d23-4916-9658-742151ca93c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:31:08.079925 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391afd0c-4d23-4916-9658-742151ca93c9 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:31:08.151188 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca675044-20b6-43d2-abbf-2831666b28f4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4336c3d678a4d33b00885def42dfb1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:31:08.151829 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca675044-20b6-43d2-abbf-2831666b28f4 service glance] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:31:08.152108 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca675044-20b6-43d2-abbf-2831666b28f4 service glance] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:31:08.152382 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca675044-20b6-43d2-abbf-2831666b28f4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:31:08.154080 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-ca675044-20b6-43d2-abbf-2831666b28f4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:31:08.208219 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:31:08.264460 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca675044-20b6-43d2-abbf-2831666b28f4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:31:08.265885 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca675044-20b6-43d2-abbf-2831666b28f4 service glance] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:31:08.284287 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 756/1475] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:31:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:31:10.421537 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4872b6a6-2e7e-4e5c-9a83-9c1397fc6bdf None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:31:10.422092 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4872b6a6-2e7e-4e5c-9a83-9c1397fc6bdf None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:31:10.422190 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4872b6a6-2e7e-4e5c-9a83-9c1397fc6bdf None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:31:10.423562 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 720/1476] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:31:10 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:31:10.428951 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78889b31-87bb-42e8-a43e-2a4ffe7ff13d None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:31:10.429364 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78889b31-87bb-42e8-a43e-2a4ffe7ff13d None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:31:10.429496 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78889b31-87bb-42e8-a43e-2a4ffe7ff13d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:31:10.494492 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-78889b31-87bb-42e8-a43e-2a4ffe7ff13d None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:31:10.495734 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-78889b31-87bb-42e8-a43e-2a4ffe7ff13d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:31:10.591623 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 757/1477] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:31:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:31:10.615125 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4872b6a6-2e7e-4e5c-9a83-9c1397fc6bdf None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:31:10.616670 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-4872b6a6-2e7e-4e5c-9a83-9c1397fc6bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:31:10.745465 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4872b6a6-2e7e-4e5c-9a83-9c1397fc6bdf None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:31:10.793887 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:31:10.838012 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e188a7-88e5-4d62-b325-1419378880e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:31:10.838692 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e188a7-88e5-4d62-b325-1419378880e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:31:10.839034 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e188a7-88e5-4d62-b325-1419378880e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:31:10.839308 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e188a7-88e5-4d62-b325-1419378880e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:31:10.840031 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e188a7-88e5-4d62-b325-1419378880e2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:31:10.842433 dv-cinder-826510-8-smb devstack@keystone.service[80345]: WARNING py.warnings [None req-55e188a7-88e5-4d62-b325-1419378880e2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:31:10.842433 dv-cinder-826510-8-smb devstack@keystone.service[80345]: warnings.warn(msg) Jul 14 15:31:10.842433 dv-cinder-826510-8-smb devstack@keystone.service[80345]: Jul 14 15:31:10.843532 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e188a7-88e5-4d62-b325-1419378880e2 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:31:10.862545 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 721/1478] 10.222.0.118 () {56 vars in 1113 bytes} [Thu Jul 14 15:31:10 2022] GET /identity/v3/projects => generated 2562 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:31:12.955588 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e10440-529d-4280-913c-873fa4de2927 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:31:12.956198 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e10440-529d-4280-913c-873fa4de2927 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:31:12.956198 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e10440-529d-4280-913c-873fa4de2927 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:31:12.957507 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 758/1479] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:31:12 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 14 15:31:12.963020 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaffc8d9-d0ce-4392-8663-7956bd72c11b None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:31:12.963479 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaffc8d9-d0ce-4392-8663-7956bd72c11b None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:31:12.963586 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaffc8d9-d0ce-4392-8663-7956bd72c11b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:31:13.028847 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-aaffc8d9-d0ce-4392-8663-7956bd72c11b None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:31:13.030020 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-aaffc8d9-d0ce-4392-8663-7956bd72c11b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:31:13.127332 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 722/1480] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:31:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:31:13.171252 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e10440-529d-4280-913c-873fa4de2927 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:31:13.172874 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-54e10440-529d-4280-913c-873fa4de2927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:31:13.183355 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:31:13.330636 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e10440-529d-4280-913c-873fa4de2927 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:31:13.420340 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:31:13.453913 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8614065-2a2c-4dd8-93b0-847b92c21286 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0177fc696ea40069902803da09f437c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:31:13.454592 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8614065-2a2c-4dd8-93b0-847b92c21286 service nova] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:31:13.454873 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8614065-2a2c-4dd8-93b0-847b92c21286 service nova] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:31:13.455145 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8614065-2a2c-4dd8-93b0-847b92c21286 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:31:13.456788 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-a8614065-2a2c-4dd8-93b0-847b92c21286 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:31:13.546747 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8614065-2a2c-4dd8-93b0-847b92c21286 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:31:13.548358 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8614065-2a2c-4dd8-93b0-847b92c21286 service nova] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:31:13.573897 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 759/1481] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:31:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:31:15.792465 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b19eba6-fab0-4876-bbc7-fd78d914ec0c None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:31:15.793039 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b19eba6-fab0-4876-bbc7-fd78d914ec0c None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:31:15.793039 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b19eba6-fab0-4876-bbc7-fd78d914ec0c None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:31:15.794573 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 723/1482] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:31:15 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:31:15.799640 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc78f129-f6b0-4c46-b341-8338b3cac3b5 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:31:15.800050 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc78f129-f6b0-4c46-b341-8338b3cac3b5 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:31:15.800197 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc78f129-f6b0-4c46-b341-8338b3cac3b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:31:15.866295 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-fc78f129-f6b0-4c46-b341-8338b3cac3b5 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:31:15.867512 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-fc78f129-f6b0-4c46-b341-8338b3cac3b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:31:15.914079 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:31:15.964128 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 760/1483] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:31:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:31:16.001475 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b19eba6-fab0-4876-bbc7-fd78d914ec0c None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:31:16.003045 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-3b19eba6-fab0-4876-bbc7-fd78d914ec0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:31:16.027960 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:31:16.108550 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b19eba6-fab0-4876-bbc7-fd78d914ec0c None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:31:16.183336 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fefdca9-3eca-4086-bbdd-e56fa5f4d009 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b650be8114b64df0ac88441f1c50b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:31:16.183993 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fefdca9-3eca-4086-bbdd-e56fa5f4d009 service neutron] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:31:16.184271 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fefdca9-3eca-4086-bbdd-e56fa5f4d009 service neutron] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:31:16.184545 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fefdca9-3eca-4086-bbdd-e56fa5f4d009 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:31:16.186870 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-2fefdca9-3eca-4086-bbdd-e56fa5f4d009 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:31:16.264361 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:31:16.299967 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fefdca9-3eca-4086-bbdd-e56fa5f4d009 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:31:16.301421 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fefdca9-3eca-4086-bbdd-e56fa5f4d009 service neutron] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:31:16.320372 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 724/1484] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:31:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:31:18.426173 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eb026e-7ce8-445a-8d69-b14405f6a8e6 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:31:18.426694 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eb026e-7ce8-445a-8d69-b14405f6a8e6 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:31:18.426694 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eb026e-7ce8-445a-8d69-b14405f6a8e6 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:31:18.428117 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 761/1485] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:31:18 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:31:18.433384 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beb0de0-acc7-4091-8b8a-2ebc25dc9747 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:31:18.433797 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beb0de0-acc7-4091-8b8a-2ebc25dc9747 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:31:18.433941 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beb0de0-acc7-4091-8b8a-2ebc25dc9747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:31:18.500030 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-9beb0de0-acc7-4091-8b8a-2ebc25dc9747 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:31:18.501282 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-9beb0de0-acc7-4091-8b8a-2ebc25dc9747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:31:18.596613 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 725/1486] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:31:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:31:18.635673 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eb026e-7ce8-445a-8d69-b14405f6a8e6 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:31:18.637193 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-f5eb026e-7ce8-445a-8d69-b14405f6a8e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:31:18.741938 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eb026e-7ce8-445a-8d69-b14405f6a8e6 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:31:18.815421 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:31:18.817640 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b77bfc-839b-487f-b0d7-bc16782ba154 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b650be8114b64df0ac88441f1c50b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:31:18.818512 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b77bfc-839b-487f-b0d7-bc16782ba154 service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:31:18.818835 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b77bfc-839b-487f-b0d7-bc16782ba154 service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:31:18.819267 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b77bfc-839b-487f-b0d7-bc16782ba154 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:31:18.821090 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-08b77bfc-839b-487f-b0d7-bc16782ba154 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:31:18.929270 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b77bfc-839b-487f-b0d7-bc16782ba154 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:31:18.930733 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b77bfc-839b-487f-b0d7-bc16782ba154 service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:31:18.948815 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 762/1487] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:31:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:31:21.155332 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f717ae7-33ab-4ce5-9194-0b7ed7050a93 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:31:21.155903 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f717ae7-33ab-4ce5-9194-0b7ed7050a93 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:31:21.155903 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f717ae7-33ab-4ce5-9194-0b7ed7050a93 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:31:21.157253 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 726/1488] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:31:21 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:31:21.162638 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8bc0ac-9ea0-4a6b-9698-9de7d502a0c5 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:31:21.163072 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8bc0ac-9ea0-4a6b-9698-9de7d502a0c5 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:31:21.163182 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8bc0ac-9ea0-4a6b-9698-9de7d502a0c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:31:21.228732 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-8c8bc0ac-9ea0-4a6b-9698-9de7d502a0c5 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:31:21.229957 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-8c8bc0ac-9ea0-4a6b-9698-9de7d502a0c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:31:21.283000 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:31:21.329403 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 763/1489] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:31:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:31:21.372825 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f717ae7-33ab-4ce5-9194-0b7ed7050a93 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:31:21.374410 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-7f717ae7-33ab-4ce5-9194-0b7ed7050a93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:31:21.413093 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:31:21.481202 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f717ae7-33ab-4ce5-9194-0b7ed7050a93 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:31:21.553422 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a94837-493b-4fa5-9228-272398007055 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b650be8114b64df0ac88441f1c50b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:31:21.554091 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a94837-493b-4fa5-9228-272398007055 service neutron] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:31:21.554367 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a94837-493b-4fa5-9228-272398007055 service neutron] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:31:21.554631 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a94837-493b-4fa5-9228-272398007055 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:31:21.556252 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-40a94837-493b-4fa5-9228-272398007055 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:31:21.646284 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:31:21.683723 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a94837-493b-4fa5-9228-272398007055 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:31:21.685737 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a94837-493b-4fa5-9228-272398007055 service neutron] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:31:21.704004 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 727/1490] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:31:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:31:23.981949 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c056a916-c5db-4542-8d92-0f228fc2455e None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:31:23.982522 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c056a916-c5db-4542-8d92-0f228fc2455e None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:31:23.982522 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c056a916-c5db-4542-8d92-0f228fc2455e None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:31:23.984177 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 764/1491] 10.222.0.118 () {54 vars in 931 bytes} [Thu Jul 14 15:31:23 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:31:23.989499 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70427536-80c4-4205-b64e-54870a6f910d None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:31:23.989911 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70427536-80c4-4205-b64e-54870a6f910d None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:31:23.990114 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70427536-80c4-4205-b64e-54870a6f910d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:31:24.054545 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-70427536-80c4-4205-b64e-54870a6f910d None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:31:24.055759 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-70427536-80c4-4205-b64e-54870a6f910d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:31:24.155797 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 728/1492] 10.222.0.118 () {58 vars in 1028 bytes} [Thu Jul 14 15:31:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:31:24.195103 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c056a916-c5db-4542-8d92-0f228fc2455e None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:31:24.196711 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-c056a916-c5db-4542-8d92-0f228fc2455e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:31:24.298956 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c056a916-c5db-4542-8d92-0f228fc2455e None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:31:24.371561 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fda60b-3ad2-4527-b5fd-cfa5548f49a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b650be8114b64df0ac88441f1c50b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:31:24.372968 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fda60b-3ad2-4527-b5fd-cfa5548f49a9 service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:31:24.373244 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fda60b-3ad2-4527-b5fd-cfa5548f49a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:31:24.373511 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fda60b-3ad2-4527-b5fd-cfa5548f49a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:31:24.375166 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-66fda60b-3ad2-4527-b5fd-cfa5548f49a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:31:24.384046 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:31:24.487098 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fda60b-3ad2-4527-b5fd-cfa5548f49a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:31:24.488540 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fda60b-3ad2-4527-b5fd-cfa5548f49a9 service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:31:24.508097 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 765/1493] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:31:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:31:34.153253 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=82 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:31:34.505752 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=50 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:32:51.299924 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b015d-863e-4312-adf7-d0f777cc1d4b None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:32:51.300525 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b015d-863e-4312-adf7-d0f777cc1d4b None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:32:51.300525 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b015d-863e-4312-adf7-d0f777cc1d4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:32:51.374228 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-027b015d-863e-4312-adf7-d0f777cc1d4b None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:32:51.375424 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-027b015d-863e-4312-adf7-d0f777cc1d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:32:51.474146 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 729/1494] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:32:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:32:51.482731 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172240c8-9537-4bd8-9d50-8188091cc834 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:32:51.483232 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172240c8-9537-4bd8-9d50-8188091cc834 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:32:51.483338 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172240c8-9537-4bd8-9d50-8188091cc834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:32:51.557667 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-172240c8-9537-4bd8-9d50-8188091cc834 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:32:51.558878 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-172240c8-9537-4bd8-9d50-8188091cc834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:32:51.654668 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 766/1495] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:32:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:32:51.659284 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027b015d-863e-4312-adf7-d0f777cc1d4b None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:32:51.660492 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-027b015d-863e-4312-adf7-d0f777cc1d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:32:51.671661 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027b015d-863e-4312-adf7-d0f777cc1d4b None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:32:51.731700 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:32:51.766034 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be8753-1815-45e7-9ffd-98cc4bd0a308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:32:51.766701 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be8753-1815-45e7-9ffd-98cc4bd0a308 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:32:51.766980 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be8753-1815-45e7-9ffd-98cc4bd0a308 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:32:51.767252 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be8753-1815-45e7-9ffd-98cc4bd0a308 admin admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:32:51.767976 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04be8753-1815-45e7-9ffd-98cc4bd0a308 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:32:51.768284 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04be8753-1815-45e7-9ffd-98cc4bd0a308 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:32:51.769295 dv-cinder-826510-8-smb devstack@keystone.service[80345]: WARNING py.warnings [None req-04be8753-1815-45e7-9ffd-98cc4bd0a308 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:32:51.769295 dv-cinder-826510-8-smb devstack@keystone.service[80345]: warnings.warn(msg) Jul 14 15:32:51.769295 dv-cinder-826510-8-smb devstack@keystone.service[80345]: Jul 14 15:32:51.770350 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04be8753-1815-45e7-9ffd-98cc4bd0a308 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:32:51.782124 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 730/1496] 10.222.0.118 () {58 vars in 1157 bytes} [Thu Jul 14 15:32:51 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:32:51.790359 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172240c8-9537-4bd8-9d50-8188091cc834 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:32:51.799410 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172240c8-9537-4bd8-9d50-8188091cc834 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:32:51.860625 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:32:51.894525 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302331fc-9e0b-4e66-bdf1-664ca9a30915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:32:51.895176 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302331fc-9e0b-4e66-bdf1-664ca9a30915 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:32:51.895456 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302331fc-9e0b-4e66-bdf1-664ca9a30915 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:32:51.895730 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302331fc-9e0b-4e66-bdf1-664ca9a30915 admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:32:51.896420 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302331fc-9e0b-4e66-bdf1-664ca9a30915 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:32:51.898229 dv-cinder-826510-8-smb devstack@keystone.service[80344]: WARNING py.warnings [None req-302331fc-9e0b-4e66-bdf1-664ca9a30915 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:32:51.898229 dv-cinder-826510-8-smb devstack@keystone.service[80344]: warnings.warn(msg) Jul 14 15:32:51.898229 dv-cinder-826510-8-smb devstack@keystone.service[80344]: Jul 14 15:32:51.899470 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302331fc-9e0b-4e66-bdf1-664ca9a30915 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:32:51.954334 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 767/1497] 10.222.0.118 () {60 vars in 1157 bytes} [Thu Jul 14 15:32:51 2022] POST /identity/v3/projects => generated 380 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:32:51.958763 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be8753-1815-45e7-9ffd-98cc4bd0a308 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:32:51.960316 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-04be8753-1815-45e7-9ffd-98cc4bd0a308 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:32:51.993673 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be8753-1815-45e7-9ffd-98cc4bd0a308 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:32:52.087761 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8249141-7c69-46b4-94c0-4b321e83f031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:32:52.088426 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8249141-7c69-46b4-94c0-4b321e83f031 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:32:52.088703 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8249141-7c69-46b4-94c0-4b321e83f031 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:32:52.088974 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8249141-7c69-46b4-94c0-4b321e83f031 admin admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:32:52.089749 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8249141-7c69-46b4-94c0-4b321e83f031 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:32:52.090791 dv-cinder-826510-8-smb devstack@keystone.service[80345]: WARNING py.warnings [None req-c8249141-7c69-46b4-94c0-4b321e83f031 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:32:52.090791 dv-cinder-826510-8-smb devstack@keystone.service[80345]: warnings.warn(msg) Jul 14 15:32:52.090791 dv-cinder-826510-8-smb devstack@keystone.service[80345]: Jul 14 15:32:52.092003 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8249141-7c69-46b4-94c0-4b321e83f031 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:32:52.132079 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 731/1498] 10.222.0.118 () {60 vars in 1148 bytes} [Thu Jul 14 15:32:51 2022] POST /identity/v3/users => generated 291 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:32:52.136136 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302331fc-9e0b-4e66-bdf1-664ca9a30915 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:32:52.138391 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-302331fc-9e0b-4e66-bdf1-664ca9a30915 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:32:52.198158 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302331fc-9e0b-4e66-bdf1-664ca9a30915 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:32:52.285700 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:32:52.415473 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1eeaf6-54ea-47e7-b19d-2622d78c4493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:32:52.416140 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1eeaf6-54ea-47e7-b19d-2622d78c4493 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:32:52.416417 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1eeaf6-54ea-47e7-b19d-2622d78c4493 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:32:52.416686 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1eeaf6-54ea-47e7-b19d-2622d78c4493 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:32:52.417423 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1eeaf6-54ea-47e7-b19d-2622d78c4493 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:32:52.418985 dv-cinder-826510-8-smb devstack@keystone.service[80344]: WARNING py.warnings [None req-7c1eeaf6-54ea-47e7-b19d-2622d78c4493 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:32:52.418985 dv-cinder-826510-8-smb devstack@keystone.service[80344]: warnings.warn(msg) Jul 14 15:32:52.418985 dv-cinder-826510-8-smb devstack@keystone.service[80344]: Jul 14 15:32:52.419870 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1eeaf6-54ea-47e7-b19d-2622d78c4493 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:32:52.432792 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 768/1499] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:32:52 2022] GET /identity/v3/roles => generated 1427 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:32:52.437484 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8249141-7c69-46b4-94c0-4b321e83f031 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:32:52.439078 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-c8249141-7c69-46b4-94c0-4b321e83f031 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:32:52.451051 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8249141-7c69-46b4-94c0-4b321e83f031 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:32:52.475555 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:32:52.547187 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc17348e-dcbc-41d5-9439-7d7dba5894dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:32:52.547898 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc17348e-dcbc-41d5-9439-7d7dba5894dd admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:32:52.548174 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc17348e-dcbc-41d5-9439-7d7dba5894dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:32:52.548454 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc17348e-dcbc-41d5-9439-7d7dba5894dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:32:52.549220 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc17348e-dcbc-41d5-9439-7d7dba5894dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:32:52.550291 dv-cinder-826510-8-smb devstack@keystone.service[80345]: WARNING py.warnings [None req-cc17348e-dcbc-41d5-9439-7d7dba5894dd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:32:52.550291 dv-cinder-826510-8-smb devstack@keystone.service[80345]: warnings.warn(msg) Jul 14 15:32:52.550291 dv-cinder-826510-8-smb devstack@keystone.service[80345]: Jul 14 15:32:52.551194 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc17348e-dcbc-41d5-9439-7d7dba5894dd admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:32:52.568749 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 732/1500] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:32:52 2022] GET /identity/v3/roles => generated 1427 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:32:52.570015 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1eeaf6-54ea-47e7-b19d-2622d78c4493 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:32:52.571610 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-7c1eeaf6-54ea-47e7-b19d-2622d78c4493 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:32:52.604191 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1eeaf6-54ea-47e7-b19d-2622d78c4493 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:32:52.695996 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1253fb-636a-436c-8d8f-c4671ad9fa19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:32:52.696802 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1253fb-636a-436c-8d8f-c4671ad9fa19 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:32:52.697081 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1253fb-636a-436c-8d8f-c4671ad9fa19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:32:52.697354 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1253fb-636a-436c-8d8f-c4671ad9fa19 admin admin] PATH_INFO: `/v3/projects/545aca86f1504bf3bedce078cb252a04/users/74b568c833484cd4b9180f5bc360397a/roles/4abcf5e5e7cd4b53ae1828fec6550d53` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:32:52.720114 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1253fb-636a-436c-8d8f-c4671ad9fa19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=545aca86f1504bf3bedce078cb252a04, user_id=74b568c833484cd4b9180f5bc360397a, role_id=4abcf5e5e7cd4b53ae1828fec6550d53)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:32:52.721156 dv-cinder-826510-8-smb devstack@keystone.service[80344]: WARNING py.warnings [None req-6c1253fb-636a-436c-8d8f-c4671ad9fa19 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:32:52.721156 dv-cinder-826510-8-smb devstack@keystone.service[80344]: warnings.warn(msg) Jul 14 15:32:52.721156 dv-cinder-826510-8-smb devstack@keystone.service[80344]: Jul 14 15:32:52.723130 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1253fb-636a-436c-8d8f-c4671ad9fa19 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:32:52.747926 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 769/1501] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:32:52 2022] PUT /identity/v3/projects/545aca86f1504bf3bedce078cb252a04/users/74b568c833484cd4b9180f5bc360397a/roles/4abcf5e5e7cd4b53ae1828fec6550d53 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:32:52.760425 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6395f0-030c-4c2a-af18-90dbd3d1a39e None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:32:52.760712 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6395f0-030c-4c2a-af18-90dbd3d1a39e None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:32:52.760990 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6395f0-030c-4c2a-af18-90dbd3d1a39e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:32:52.816490 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-7d6395f0-030c-4c2a-af18-90dbd3d1a39e None None] MFA Rules not processed for user `74b568c833484cd4b9180f5bc360397a`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:32:52.817712 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-7d6395f0-030c-4c2a-af18-90dbd3d1a39e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:32:52.892499 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 733/1502] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:32:52 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:32:52.906310 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20fb489-ba77-42a6-97a3-0b5f29f61c53 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:32:52.906605 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20fb489-ba77-42a6-97a3-0b5f29f61c53 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:32:52.906876 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20fb489-ba77-42a6-97a3-0b5f29f61c53 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:32:52.908261 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 770/1503] 10.222.0.118 () {54 vars in 968 bytes} [Thu Jul 14 15:32:52 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:32:52.913150 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d65037-8541-47b7-8f27-f5b1394386f4 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:32:52.913458 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d65037-8541-47b7-8f27-f5b1394386f4 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:32:52.913714 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d65037-8541-47b7-8f27-f5b1394386f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:32:52.943583 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:32:52.987803 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-03d65037-8541-47b7-8f27-f5b1394386f4 None None] MFA Rules not processed for user `ea647438ea1c438987f28cbe39c3ff2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:32:52.989044 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-03d65037-8541-47b7-8f27-f5b1394386f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:32:53.063102 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 734/1504] 10.222.0.118 () {58 vars in 1065 bytes} [Thu Jul 14 15:32:52 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:32:53.070656 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20fb489-ba77-42a6-97a3-0b5f29f61c53 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:32:53.072169 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-d20fb489-ba77-42a6-97a3-0b5f29f61c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:32:53.121451 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:32:53.177550 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20fb489-ba77-42a6-97a3-0b5f29f61c53 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:32:53.250245 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a7024a-d267-4fd7-9c6e-0fc9c2552383 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea647438ea1c438987f28cbe39c3ff2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:32:53.250809 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a7024a-d267-4fd7-9c6e-0fc9c2552383 service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:32:53.251085 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a7024a-d267-4fd7-9c6e-0fc9c2552383 service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:32:53.251353 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a7024a-d267-4fd7-9c6e-0fc9c2552383 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:32:53.252982 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-38a7024a-d267-4fd7-9c6e-0fc9c2552383 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:32:53.350913 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a7024a-d267-4fd7-9c6e-0fc9c2552383 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:32:53.352523 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a7024a-d267-4fd7-9c6e-0fc9c2552383 service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:32:53.355941 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:32:53.370949 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 771/1505] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:32:53 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:32:53.413716 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec37bf5f-abaf-4fb4-9535-61097acce663 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:32:53.414023 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec37bf5f-abaf-4fb4-9535-61097acce663 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:32:53.414303 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec37bf5f-abaf-4fb4-9535-61097acce663 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:32:53.415595 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 735/1506] 10.222.0.118 () {52 vars in 834 bytes} [Thu Jul 14 15:32:53 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:32:53.419280 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a7024a-d267-4fd7-9c6e-0fc9c2552383 service cinder] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:32:53.420473 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-38a7024a-d267-4fd7-9c6e-0fc9c2552383 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:32:53.516638 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a7024a-d267-4fd7-9c6e-0fc9c2552383 service cinder] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:32:53.606301 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f8b062-b4ca-4008-9f38-485beaaf9180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:32:53.607165 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f8b062-b4ca-4008-9f38-485beaaf9180 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:32:53.607437 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f8b062-b4ca-4008-9f38-485beaaf9180 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:32:53.607702 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f8b062-b4ca-4008-9f38-485beaaf9180 admin admin] PATH_INFO: `/v3/users/74b568c833484cd4b9180f5bc360397a` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:32:53.619580 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f8b062-b4ca-4008-9f38-485beaaf9180 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74b568c833484cd4b9180f5bc360397a)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:32:53.620593 dv-cinder-826510-8-smb devstack@keystone.service[80344]: WARNING py.warnings [None req-c6f8b062-b4ca-4008-9f38-485beaaf9180 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:32:53.620593 dv-cinder-826510-8-smb devstack@keystone.service[80344]: warnings.warn(msg) Jul 14 15:32:53.620593 dv-cinder-826510-8-smb devstack@keystone.service[80344]: Jul 14 15:32:53.622351 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f8b062-b4ca-4008-9f38-485beaaf9180 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:32:53.631970 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:32:53.685521 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-c6f8b062-b4ca-4008-9f38-485beaaf9180 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74b568c833484cd4b9180f5bc360397a'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:32:53.697204 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-c6f8b062-b4ca-4008-9f38-485beaaf9180 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74b568c833484cd4b9180f5bc360397a'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:32:53.697746 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-c6f8b062-b4ca-4008-9f38-485beaaf9180 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74b568c833484cd4b9180f5bc360397a'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:32:53.698203 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-c6f8b062-b4ca-4008-9f38-485beaaf9180 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74b568c833484cd4b9180f5bc360397a'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:32:53.716957 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-c6f8b062-b4ca-4008-9f38-485beaaf9180 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74b568c833484cd4b9180f5bc360397a'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:32:53.731675 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 772/1507] 10.222.0.118 () {58 vars in 1228 bytes} [Thu Jul 14 15:32:53 2022] DELETE /identity/v3/users/74b568c833484cd4b9180f5bc360397a => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:32:53.736124 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc910b59-3480-41d1-ab1e-1355ded7e493 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:32:53.736654 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc910b59-3480-41d1-ab1e-1355ded7e493 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:32:53.736752 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc910b59-3480-41d1-ab1e-1355ded7e493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:32:53.792959 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-dc910b59-3480-41d1-ab1e-1355ded7e493 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:32:53.794134 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-dc910b59-3480-41d1-ab1e-1355ded7e493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:32:53.869290 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:32:53.883021 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 736/1508] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:32:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:32:53.892551 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f8b062-b4ca-4008-9f38-485beaaf9180 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:32:53.893802 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-c6f8b062-b4ca-4008-9f38-485beaaf9180 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:32:54.012190 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f8b062-b4ca-4008-9f38-485beaaf9180 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:32:54.067690 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:32:54.088793 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af60117-6b9e-4695-a1c0-e4630a26b72d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b650be8114b64df0ac88441f1c50b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:32:54.089447 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af60117-6b9e-4695-a1c0-e4630a26b72d service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:32:54.089831 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af60117-6b9e-4695-a1c0-e4630a26b72d service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:32:54.090277 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af60117-6b9e-4695-a1c0-e4630a26b72d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:32:54.092103 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-3af60117-6b9e-4695-a1c0-e4630a26b72d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:32:54.200325 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af60117-6b9e-4695-a1c0-e4630a26b72d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:32:54.201762 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af60117-6b9e-4695-a1c0-e4630a26b72d service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:32:54.219822 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 773/1509] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:32:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:32:54.562524 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc910b59-3480-41d1-ab1e-1355ded7e493 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:32:54.563783 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-dc910b59-3480-41d1-ab1e-1355ded7e493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:32:54.576731 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc910b59-3480-41d1-ab1e-1355ded7e493 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:32:54.674539 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429809ad-575b-48a0-8707-8d82af3fdf69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:32:54.675398 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429809ad-575b-48a0-8707-8d82af3fdf69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:32:54.675672 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429809ad-575b-48a0-8707-8d82af3fdf69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:32:54.675938 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429809ad-575b-48a0-8707-8d82af3fdf69 admin admin] PATH_INFO: `/v3/projects/545aca86f1504bf3bedce078cb252a04` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:32:54.686568 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429809ad-575b-48a0-8707-8d82af3fdf69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=545aca86f1504bf3bedce078cb252a04)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:32:54.687599 dv-cinder-826510-8-smb devstack@keystone.service[80345]: WARNING py.warnings [None req-429809ad-575b-48a0-8707-8d82af3fdf69 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:32:54.687599 dv-cinder-826510-8-smb devstack@keystone.service[80345]: warnings.warn(msg) Jul 14 15:32:54.687599 dv-cinder-826510-8-smb devstack@keystone.service[80345]: Jul 14 15:32:54.688807 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429809ad-575b-48a0-8707-8d82af3fdf69 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:32:54.748587 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-429809ad-575b-48a0-8707-8d82af3fdf69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '545aca86f1504bf3bedce078cb252a04', 'request_id': 'req-429809ad-575b-48a0-8707-8d82af3fdf69'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:32:54.761450 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-429809ad-575b-48a0-8707-8d82af3fdf69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '545aca86f1504bf3bedce078cb252a04', 'request_id': 'req-429809ad-575b-48a0-8707-8d82af3fdf69'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:32:54.767455 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-429809ad-575b-48a0-8707-8d82af3fdf69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '545aca86f1504bf3bedce078cb252a04', 'request_id': 'req-429809ad-575b-48a0-8707-8d82af3fdf69'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:32:54.793865 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-429809ad-575b-48a0-8707-8d82af3fdf69 admin admin] The token cache is being invalidate because project 545aca86f1504bf3bedce078cb252a04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:32:54.794282 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-429809ad-575b-48a0-8707-8d82af3fdf69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:32:54.794714 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-429809ad-575b-48a0-8707-8d82af3fdf69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:32:54.796180 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 737/1510] 10.222.0.118 () {58 vars in 1237 bytes} [Thu Jul 14 15:32:54 2022] DELETE /identity/v3/projects/545aca86f1504bf3bedce078cb252a04 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:33:04.217547 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=62 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:33:04.791360 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:34:43.758993 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1194425-e1bb-45dc-ad1d-d741d30905c6 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:34:43.759581 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1194425-e1bb-45dc-ad1d-d741d30905c6 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:34:43.759581 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1194425-e1bb-45dc-ad1d-d741d30905c6 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:34:43.760963 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 774/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 15:34:43 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:34:43.766639 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17d1684-68c3-4c56-8ebb-56e7b62bff4e None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:34:43.767424 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17d1684-68c3-4c56-8ebb-56e7b62bff4e None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:34:43.767424 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17d1684-68c3-4c56-8ebb-56e7b62bff4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:34:43.858879 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-c17d1684-68c3-4c56-8ebb-56e7b62bff4e None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:34:43.860106 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-c17d1684-68c3-4c56-8ebb-56e7b62bff4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:34:43.969557 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 738/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 15:34:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:34:44.137262 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1194425-e1bb-45dc-ad1d-d741d30905c6 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:34:44.142443 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-f1194425-e1bb-45dc-ad1d-d741d30905c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:34:44.264158 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1194425-e1bb-45dc-ad1d-d741d30905c6 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:34:44.270311 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33469a87-9e5c-48d8-81bf-3039c823c96c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0177fc696ea40069902803da09f437c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:34:44.270965 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33469a87-9e5c-48d8-81bf-3039c823c96c service nova] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:34:44.271249 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33469a87-9e5c-48d8-81bf-3039c823c96c service nova] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:34:44.271526 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33469a87-9e5c-48d8-81bf-3039c823c96c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:34:44.280017 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33469a87-9e5c-48d8-81bf-3039c823c96c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:34:44.281619 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33469a87-9e5c-48d8-81bf-3039c823c96c service nova] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:34:44.292115 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 775/1513] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:34:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:34:45.151380 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1cbd54-e106-4cde-84df-3374aea2639a None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:34:45.151929 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1cbd54-e106-4cde-84df-3374aea2639a None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:34:45.152050 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1cbd54-e106-4cde-84df-3374aea2639a None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:34:45.153418 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 739/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 15:34:45 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:34:45.158372 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c741c-3208-41aa-8860-9eafc82037b5 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:34:45.158801 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c741c-3208-41aa-8860-9eafc82037b5 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:34:45.158932 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c741c-3208-41aa-8860-9eafc82037b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:34:45.179843 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-3d0c741c-3208-41aa-8860-9eafc82037b5 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:34:45.181171 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-3d0c741c-3208-41aa-8860-9eafc82037b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:34:45.190065 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 776/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 15:34:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:34:45.344425 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1cbd54-e106-4cde-84df-3374aea2639a None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:34:45.359761 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1cbd54-e106-4cde-84df-3374aea2639a None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:34:45.365898 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e458fa3-3034-4e6f-a152-f37ac61bc8fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0177fc696ea40069902803da09f437c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:34:45.366602 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e458fa3-3034-4e6f-a152-f37ac61bc8fc service nova] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:34:45.366922 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e458fa3-3034-4e6f-a152-f37ac61bc8fc service nova] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:34:45.367235 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e458fa3-3034-4e6f-a152-f37ac61bc8fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:34:45.375996 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e458fa3-3034-4e6f-a152-f37ac61bc8fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:34:45.377641 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e458fa3-3034-4e6f-a152-f37ac61bc8fc service nova] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:34:45.388321 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 740/1516] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:34:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:34:45.555356 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7d798a-d205-457b-91a6-17d871b8189a None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:34:45.555643 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7d798a-d205-457b-91a6-17d871b8189a None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:34:45.555948 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7d798a-d205-457b-91a6-17d871b8189a None None] PATH_INFO: `/v3` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:34:45.557343 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 777/1517] 10.222.0.55 () {54 vars in 929 bytes} [Thu Jul 14 15:34:45 2022] GET /identity/v3 => generated 256 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:34:45.563796 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2a77b-4699-4eac-9e07-913bfdcdc56d None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:34:45.564083 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2a77b-4699-4eac-9e07-913bfdcdc56d None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:34:45.564389 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2a77b-4699-4eac-9e07-913bfdcdc56d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:34:45.622401 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-e9b2a77b-4699-4eac-9e07-913bfdcdc56d None None] MFA Rules not processed for user `e70b0f8be7e04adca6e3f218fbe3a295`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:34:45.623877 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-e9b2a77b-4699-4eac-9e07-913bfdcdc56d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:34:45.640158 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:34:45.694622 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 741/1518] 10.222.0.55 () {58 vars in 1019 bytes} [Thu Jul 14 15:34:45 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:34:49.539196 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf79667-1fde-405c-baa9-4cb3ed6e2d58 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:34:49.540342 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf79667-1fde-405c-baa9-4cb3ed6e2d58 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:34:49.540342 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf79667-1fde-405c-baa9-4cb3ed6e2d58 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:34:49.540953 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 778/1519] 10.222.0.118 () {54 vars in 965 bytes} [Thu Jul 14 15:34:49 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:34:49.546399 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f84b0cd-061c-45aa-9339-44e8d8dd2b62 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:34:49.546890 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f84b0cd-061c-45aa-9339-44e8d8dd2b62 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:34:49.547008 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f84b0cd-061c-45aa-9339-44e8d8dd2b62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:34:49.567950 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-3f84b0cd-061c-45aa-9339-44e8d8dd2b62 None None] MFA Rules not processed for user `e70b0f8be7e04adca6e3f218fbe3a295`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:34:49.569296 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-3f84b0cd-061c-45aa-9339-44e8d8dd2b62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:34:49.578427 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 742/1520] 10.222.0.118 () {58 vars in 1062 bytes} [Thu Jul 14 15:34:49 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:34:49.586098 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf79667-1fde-405c-baa9-4cb3ed6e2d58 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:34:49.599695 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf79667-1fde-405c-baa9-4cb3ed6e2d58 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:34:49.606511 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9467716d-c40d-4693-92b5-eab40cdc8a89 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b0f8be7e04adca6e3f218fbe3a295', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:34:49.606511 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9467716d-c40d-4693-92b5-eab40cdc8a89 service placement] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:34:49.606511 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9467716d-c40d-4693-92b5-eab40cdc8a89 service placement] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:34:49.607199 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9467716d-c40d-4693-92b5-eab40cdc8a89 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:34:49.616880 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9467716d-c40d-4693-92b5-eab40cdc8a89 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:34:49.619007 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9467716d-c40d-4693-92b5-eab40cdc8a89 service placement] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:34:49.629349 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 779/1521] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:34:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:34:56.632596 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0c1fcb-97f6-4818-8a13-593bb8221057 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:34:56.633153 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0c1fcb-97f6-4818-8a13-593bb8221057 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:34:56.633153 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0c1fcb-97f6-4818-8a13-593bb8221057 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:34:56.634569 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 743/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 15:34:56 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:34:56.639311 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1fe981-6027-4443-868f-be72a31279f9 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:34:56.639754 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1fe981-6027-4443-868f-be72a31279f9 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:34:56.639859 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1fe981-6027-4443-868f-be72a31279f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:34:56.658481 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-2a1fe981-6027-4443-868f-be72a31279f9 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:34:56.659684 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-2a1fe981-6027-4443-868f-be72a31279f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:34:56.667943 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 780/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 15:34:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:34:56.824946 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0c1fcb-97f6-4818-8a13-593bb8221057 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:34:56.840123 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0c1fcb-97f6-4818-8a13-593bb8221057 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:34:56.846485 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82793fc4-8129-4727-ae24-be1b466dbd12 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0177fc696ea40069902803da09f437c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:34:56.847123 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82793fc4-8129-4727-ae24-be1b466dbd12 service nova] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:34:56.847403 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82793fc4-8129-4727-ae24-be1b466dbd12 service nova] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:34:56.847675 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82793fc4-8129-4727-ae24-be1b466dbd12 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:34:56.855766 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82793fc4-8129-4727-ae24-be1b466dbd12 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:34:56.857349 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82793fc4-8129-4727-ae24-be1b466dbd12 service nova] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:34:56.866762 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 744/1524] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:34:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:34:57.695816 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34447eff-2257-494c-ab03-aa580c8f7a4c None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:34:57.696400 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34447eff-2257-494c-ab03-aa580c8f7a4c None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:34:57.696400 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34447eff-2257-494c-ab03-aa580c8f7a4c None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:34:57.697785 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 781/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 15:34:57 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:34:57.702937 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f493e3-bb05-4956-a9fb-3d27648c5197 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:34:57.703417 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f493e3-bb05-4956-a9fb-3d27648c5197 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:34:57.703530 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f493e3-bb05-4956-a9fb-3d27648c5197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:34:57.852495 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-25f493e3-bb05-4956-a9fb-3d27648c5197 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:34:57.853741 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-25f493e3-bb05-4956-a9fb-3d27648c5197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:34:57.862197 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 745/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 15:34:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:34:58.015691 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34447eff-2257-494c-ab03-aa580c8f7a4c None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:34:58.030845 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34447eff-2257-494c-ab03-aa580c8f7a4c None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:34:58.036296 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8bb829-a7c7-426b-a50b-3b8233418e01 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0177fc696ea40069902803da09f437c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:34:58.036944 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8bb829-a7c7-426b-a50b-3b8233418e01 service nova] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:34:58.037281 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8bb829-a7c7-426b-a50b-3b8233418e01 service nova] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:34:58.038086 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8bb829-a7c7-426b-a50b-3b8233418e01 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:34:58.047122 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8bb829-a7c7-426b-a50b-3b8233418e01 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:34:58.048742 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8bb829-a7c7-426b-a50b-3b8233418e01 service nova] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:34:58.059255 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 782/1527] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:34:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:35:02.093143 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb791a6-5d25-4e4d-8e0a-13cd95a1504b None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:02.093685 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb791a6-5d25-4e4d-8e0a-13cd95a1504b None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:02.093685 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb791a6-5d25-4e4d-8e0a-13cd95a1504b None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:02.095075 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 746/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 15:35:02 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 14 15:35:02.100312 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3d16da-159f-401a-8a1b-029e10e7b2bd None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:02.100712 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3d16da-159f-401a-8a1b-029e10e7b2bd None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:02.100868 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3d16da-159f-401a-8a1b-029e10e7b2bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:02.118406 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-9c3d16da-159f-401a-8a1b-029e10e7b2bd None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:35:02.119597 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-9c3d16da-159f-401a-8a1b-029e10e7b2bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:35:02.127753 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 783/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 15:35:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:35:02.203703 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb791a6-5d25-4e4d-8e0a-13cd95a1504b None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:02.205420 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-eeb791a6-5d25-4e4d-8e0a-13cd95a1504b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:35:02.285167 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb791a6-5d25-4e4d-8e0a-13cd95a1504b None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:02.288877 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afc6c67-f034-4d1e-9c03-ab9768c34e30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b650be8114b64df0ac88441f1c50b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:02.289529 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afc6c67-f034-4d1e-9c03-ab9768c34e30 service neutron] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:02.289807 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afc6c67-f034-4d1e-9c03-ab9768c34e30 service neutron] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:02.290115 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afc6c67-f034-4d1e-9c03-ab9768c34e30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:02.299278 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afc6c67-f034-4d1e-9c03-ab9768c34e30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:02.300716 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afc6c67-f034-4d1e-9c03-ab9768c34e30 service neutron] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:02.310732 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 747/1530] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:35:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:35:04.340428 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a2196-de82-432e-80cf-777b903425de None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:04.341151 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a2196-de82-432e-80cf-777b903425de None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:04.341151 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a2196-de82-432e-80cf-777b903425de None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:04.342406 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 784/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 15:35:04 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:35:04.348818 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237b1359-b99b-4839-b48d-69958f9bfd08 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:04.349233 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237b1359-b99b-4839-b48d-69958f9bfd08 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:04.349372 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237b1359-b99b-4839-b48d-69958f9bfd08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:04.368214 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-237b1359-b99b-4839-b48d-69958f9bfd08 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:35:04.369432 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-237b1359-b99b-4839-b48d-69958f9bfd08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:35:04.377478 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 748/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 15:35:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:35:04.414582 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018a2196-de82-432e-80cf-777b903425de None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:04.416248 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-018a2196-de82-432e-80cf-777b903425de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:35:04.424152 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=75 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:04.431509 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018a2196-de82-432e-80cf-777b903425de None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:04.435138 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a554ee-780a-462f-933f-8c2d379607b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b650be8114b64df0ac88441f1c50b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:04.435781 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a554ee-780a-462f-933f-8c2d379607b6 service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:04.436060 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a554ee-780a-462f-933f-8c2d379607b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:04.436333 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a554ee-780a-462f-933f-8c2d379607b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:04.445398 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a554ee-780a-462f-933f-8c2d379607b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:04.446865 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a554ee-780a-462f-933f-8c2d379607b6 service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:04.456513 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 785/1533] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:35:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:35:07.961043 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f37564-765e-47c8-82f5-b63ef2d382b4 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:07.961603 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f37564-765e-47c8-82f5-b63ef2d382b4 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:07.961603 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f37564-765e-47c8-82f5-b63ef2d382b4 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:07.963038 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 749/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 15:35:07 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:35:07.968135 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a17c0ad-09c2-400a-b4cd-b4a4f941db1e None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:07.968553 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a17c0ad-09c2-400a-b4cd-b4a4f941db1e None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:07.968679 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a17c0ad-09c2-400a-b4cd-b4a4f941db1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:07.986470 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-8a17c0ad-09c2-400a-b4cd-b4a4f941db1e None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:35:07.987593 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-8a17c0ad-09c2-400a-b4cd-b4a4f941db1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:35:07.995469 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 786/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 15:35:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:35:08.299476 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f37564-765e-47c8-82f5-b63ef2d382b4 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:08.301238 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-60f37564-765e-47c8-82f5-b63ef2d382b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:35:08.367067 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:08.382259 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f37564-765e-47c8-82f5-b63ef2d382b4 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:08.385897 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac1c853-76da-4c60-8da7-e37b53a34820 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea647438ea1c438987f28cbe39c3ff2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:08.386572 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac1c853-76da-4c60-8da7-e37b53a34820 service cinder] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:08.386844 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac1c853-76da-4c60-8da7-e37b53a34820 service cinder] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:08.387109 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac1c853-76da-4c60-8da7-e37b53a34820 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:08.396088 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac1c853-76da-4c60-8da7-e37b53a34820 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:08.397533 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac1c853-76da-4c60-8da7-e37b53a34820 service cinder] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:08.407309 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 750/1536] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:35:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:35:10.530021 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b896d8-cdb7-4c0b-831f-9d5bf81d96c3 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:10.530580 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b896d8-cdb7-4c0b-831f-9d5bf81d96c3 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:10.530580 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b896d8-cdb7-4c0b-831f-9d5bf81d96c3 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:10.532001 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 787/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 15:35:10 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:35:10.538001 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbf72ec-c6a0-41d5-9300-67d5b32ccd7b None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:10.538445 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbf72ec-c6a0-41d5-9300-67d5b32ccd7b None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:10.538547 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbf72ec-c6a0-41d5-9300-67d5b32ccd7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:10.556685 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-7bbf72ec-c6a0-41d5-9300-67d5b32ccd7b None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:35:10.557979 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-7bbf72ec-c6a0-41d5-9300-67d5b32ccd7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:35:10.566050 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 751/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 15:35:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:35:10.869979 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b896d8-cdb7-4c0b-831f-9d5bf81d96c3 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:10.871650 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-b9b896d8-cdb7-4c0b-831f-9d5bf81d96c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:35:10.885982 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b896d8-cdb7-4c0b-831f-9d5bf81d96c3 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:10.889466 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddc4445-5bb0-4d81-9709-1b0989548b9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea647438ea1c438987f28cbe39c3ff2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:10.890201 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddc4445-5bb0-4d81-9709-1b0989548b9a service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:10.890483 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddc4445-5bb0-4d81-9709-1b0989548b9a service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:10.890753 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddc4445-5bb0-4d81-9709-1b0989548b9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:10.900478 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddc4445-5bb0-4d81-9709-1b0989548b9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:10.901909 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddc4445-5bb0-4d81-9709-1b0989548b9a service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:10.911419 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 788/1539] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:35:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:35:20.551866 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=11 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:20.907170 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=14 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:44.985631 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409dfbb2-c8c6-41ab-a2f2-5e09b5d27fa4 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:44.986782 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409dfbb2-c8c6-41ab-a2f2-5e09b5d27fa4 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:44.987279 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409dfbb2-c8c6-41ab-a2f2-5e09b5d27fa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:45.011154 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-409dfbb2-c8c6-41ab-a2f2-5e09b5d27fa4 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:36:45.013206 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-409dfbb2-c8c6-41ab-a2f2-5e09b5d27fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:36:45.028910 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 752/1540] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:36:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:36:45.038094 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1e68b6-f72f-468f-bd83-ea39af1a44ac None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:45.039092 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1e68b6-f72f-468f-bd83-ea39af1a44ac None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:45.039590 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1e68b6-f72f-468f-bd83-ea39af1a44ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:45.062615 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-2f1e68b6-f72f-468f-bd83-ea39af1a44ac None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:36:45.064502 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-2f1e68b6-f72f-468f-bd83-ea39af1a44ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:36:45.078003 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 789/1541] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:36:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:36:45.083098 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409dfbb2-c8c6-41ab-a2f2-5e09b5d27fa4 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:45.094116 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409dfbb2-c8c6-41ab-a2f2-5e09b5d27fa4 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:45.102424 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28935d26-3bb5-4ece-81bd-e7af3526ae6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:45.103461 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28935d26-3bb5-4ece-81bd-e7af3526ae6d admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:45.104273 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28935d26-3bb5-4ece-81bd-e7af3526ae6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:45.104773 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28935d26-3bb5-4ece-81bd-e7af3526ae6d admin admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:45.105719 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28935d26-3bb5-4ece-81bd-e7af3526ae6d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:45.106291 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28935d26-3bb5-4ece-81bd-e7af3526ae6d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:45.108141 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28935d26-3bb5-4ece-81bd-e7af3526ae6d admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:45.121628 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 753/1542] 10.222.0.118 () {58 vars in 1157 bytes} [Thu Jul 14 15:36:45 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:45.130105 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1e68b6-f72f-468f-bd83-ea39af1a44ac None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:45.143394 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1e68b6-f72f-468f-bd83-ea39af1a44ac None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:45.156090 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b506b59-5d81-4355-814b-e4bf34e8485f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:45.157099 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b506b59-5d81-4355-814b-e4bf34e8485f admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:45.157584 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b506b59-5d81-4355-814b-e4bf34e8485f admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:45.158086 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b506b59-5d81-4355-814b-e4bf34e8485f admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:45.159004 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b506b59-5d81-4355-814b-e4bf34e8485f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:45.161715 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b506b59-5d81-4355-814b-e4bf34e8485f admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:45.209312 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 790/1543] 10.222.0.118 () {60 vars in 1157 bytes} [Thu Jul 14 15:36:45 2022] POST /identity/v3/projects => generated 378 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:36:45.214430 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28935d26-3bb5-4ece-81bd-e7af3526ae6d admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:45.226382 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28935d26-3bb5-4ece-81bd-e7af3526ae6d admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:45.301665 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0469b65-48c9-4f97-80ff-2e2b2bebbee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:45.302799 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0469b65-48c9-4f97-80ff-2e2b2bebbee6 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:45.303286 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0469b65-48c9-4f97-80ff-2e2b2bebbee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:45.303748 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0469b65-48c9-4f97-80ff-2e2b2bebbee6 admin admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:45.304665 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0469b65-48c9-4f97-80ff-2e2b2bebbee6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:45.306906 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0469b65-48c9-4f97-80ff-2e2b2bebbee6 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:45.339404 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 754/1544] 10.222.0.118 () {60 vars in 1148 bytes} [Thu Jul 14 15:36:45 2022] POST /identity/v3/users => generated 290 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:36:45.344928 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b506b59-5d81-4355-814b-e4bf34e8485f admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:45.363552 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b506b59-5d81-4355-814b-e4bf34e8485f admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:45.375202 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e20864-f367-4c84-8c18-df612ed99170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:45.375921 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e20864-f367-4c84-8c18-df612ed99170 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:45.376202 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e20864-f367-4c84-8c18-df612ed99170 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:45.376475 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e20864-f367-4c84-8c18-df612ed99170 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:45.377261 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e20864-f367-4c84-8c18-df612ed99170 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:45.379018 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e20864-f367-4c84-8c18-df612ed99170 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:45.405443 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 791/1545] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:36:45 2022] GET /identity/v3/roles => generated 1427 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:36:45.409896 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0469b65-48c9-4f97-80ff-2e2b2bebbee6 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:45.425759 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0469b65-48c9-4f97-80ff-2e2b2bebbee6 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:45.434636 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1835d8f-3c21-4cc0-af97-bc0eabdd477e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:45.435944 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1835d8f-3c21-4cc0-af97-bc0eabdd477e admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:45.436478 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1835d8f-3c21-4cc0-af97-bc0eabdd477e admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:45.436979 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1835d8f-3c21-4cc0-af97-bc0eabdd477e admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:45.437988 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1835d8f-3c21-4cc0-af97-bc0eabdd477e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:45.440272 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1835d8f-3c21-4cc0-af97-bc0eabdd477e admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:45.458958 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 755/1546] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:36:45 2022] GET /identity/v3/roles => generated 1427 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:36:45.463418 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e20864-f367-4c84-8c18-df612ed99170 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:45.485208 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e20864-f367-4c84-8c18-df612ed99170 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:45.492802 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77810ba9-b130-4e59-b75d-b573352d6643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:45.493748 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77810ba9-b130-4e59-b75d-b573352d6643 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:45.494065 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77810ba9-b130-4e59-b75d-b573352d6643 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:45.494345 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77810ba9-b130-4e59-b75d-b573352d6643 admin admin] PATH_INFO: `/v3/projects/c51c65ccf8d148c0ad5343570e22724f/users/d1f95427c9ff4d8287c6ecd33a1a0d2c/roles/4abcf5e5e7cd4b53ae1828fec6550d53` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:45.521145 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77810ba9-b130-4e59-b75d-b573352d6643 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c51c65ccf8d148c0ad5343570e22724f, user_id=d1f95427c9ff4d8287c6ecd33a1a0d2c, role_id=4abcf5e5e7cd4b53ae1828fec6550d53)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:45.523887 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77810ba9-b130-4e59-b75d-b573352d6643 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:45.542222 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 792/1547] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:36:45 2022] PUT /identity/v3/projects/c51c65ccf8d148c0ad5343570e22724f/users/d1f95427c9ff4d8287c6ecd33a1a0d2c/roles/4abcf5e5e7cd4b53ae1828fec6550d53 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:36:45.547659 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c72f46-5e5f-4762-b426-cc6a348e459b None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:45.548242 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c72f46-5e5f-4762-b426-cc6a348e459b None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:45.548737 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c72f46-5e5f-4762-b426-cc6a348e459b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:45.575389 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-f5c72f46-5e5f-4762-b426-cc6a348e459b None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:36:45.577153 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-f5c72f46-5e5f-4762-b426-cc6a348e459b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:36:45.661434 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 756/1548] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:36:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:36:45.672156 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77810ba9-b130-4e59-b75d-b573352d6643 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:45.788145 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77810ba9-b130-4e59-b75d-b573352d6643 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:45.793536 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ddc597-050b-4a22-8636-d88bf69585fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b650be8114b64df0ac88441f1c50b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:45.794489 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ddc597-050b-4a22-8636-d88bf69585fa service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:45.794925 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ddc597-050b-4a22-8636-d88bf69585fa service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:45.795377 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ddc597-050b-4a22-8636-d88bf69585fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:45.810111 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ddc597-050b-4a22-8636-d88bf69585fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:45.812009 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ddc597-050b-4a22-8636-d88bf69585fa service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:45.828241 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 793/1549] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:36:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:36:45.884617 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7185926-b261-4e2f-9ffe-d203af2eaab0 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:45.885010 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7185926-b261-4e2f-9ffe-d203af2eaab0 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:45.885395 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7185926-b261-4e2f-9ffe-d203af2eaab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:45.907854 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a717a15-d963-4e72-85ca-5e528db2b4a3 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:45.908503 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a717a15-d963-4e72-85ca-5e528db2b4a3 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:45.909023 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a717a15-d963-4e72-85ca-5e528db2b4a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:45.919708 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-e7185926-b261-4e2f-9ffe-d203af2eaab0 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:36:45.921120 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-e7185926-b261-4e2f-9ffe-d203af2eaab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:36:45.941781 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 757/1550] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:36:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:36:45.951468 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-1a717a15-d963-4e72-85ca-5e528db2b4a3 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:36:45.953365 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-1a717a15-d963-4e72-85ca-5e528db2b4a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:36:45.977991 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 794/1551] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:36:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:36:45.986717 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0096197b-0499-4d85-9322-7ceec0e7301b None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:45.987295 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0096197b-0499-4d85-9322-7ceec0e7301b None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:45.987387 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0096197b-0499-4d85-9322-7ceec0e7301b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:45.987866 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8655a1-1565-4cf8-a047-9af60bdad3b7 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:45.988371 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8655a1-1565-4cf8-a047-9af60bdad3b7 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:45.989383 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8655a1-1565-4cf8-a047-9af60bdad3b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:46.043616 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-7d8655a1-1565-4cf8-a047-9af60bdad3b7 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:36:46.044881 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-7d8655a1-1565-4cf8-a047-9af60bdad3b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:36:46.047018 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-0096197b-0499-4d85-9322-7ceec0e7301b None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:36:46.057935 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-0096197b-0499-4d85-9322-7ceec0e7301b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:36:46.069330 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 795/1552] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:36:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:36:46.076234 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6883160-d3ba-4f45-a42d-2c1fa1b7df11 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:46.076764 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 758/1553] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:36:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:36:46.077074 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6883160-d3ba-4f45-a42d-2c1fa1b7df11 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:46.077563 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6883160-d3ba-4f45-a42d-2c1fa1b7df11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:46.078462 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddaea75-21d8-4bc3-af2b-2f85aef8f483 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:46.078749 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddaea75-21d8-4bc3-af2b-2f85aef8f483 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:46.082721 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddaea75-21d8-4bc3-af2b-2f85aef8f483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:46.099650 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-4ddaea75-21d8-4bc3-af2b-2f85aef8f483 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:36:46.100878 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-4ddaea75-21d8-4bc3-af2b-2f85aef8f483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:36:46.119911 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 759/1554] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:36:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:36:46.122540 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75718933-54c1-4cf8-a41a-91f79401614c None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:46.123079 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75718933-54c1-4cf8-a41a-91f79401614c None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:46.123692 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75718933-54c1-4cf8-a41a-91f79401614c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:46.125315 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-e6883160-d3ba-4f45-a42d-2c1fa1b7df11 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:36:46.129002 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-e6883160-d3ba-4f45-a42d-2c1fa1b7df11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:36:46.140705 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 796/1555] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:36:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:36:46.141800 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6883160-d3ba-4f45-a42d-2c1fa1b7df11 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:46.166782 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6883160-d3ba-4f45-a42d-2c1fa1b7df11 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:46.171961 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a51570c-d1eb-48f9-b5e3-3bfa86df3e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:46.172754 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a51570c-d1eb-48f9-b5e3-3bfa86df3e4e admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:46.173138 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a51570c-d1eb-48f9-b5e3-3bfa86df3e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:46.173513 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a51570c-d1eb-48f9-b5e3-3bfa86df3e4e admin admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:46.174306 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-75718933-54c1-4cf8-a41a-91f79401614c None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:36:46.174461 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a51570c-d1eb-48f9-b5e3-3bfa86df3e4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:46.174862 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a51570c-d1eb-48f9-b5e3-3bfa86df3e4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:46.175547 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-75718933-54c1-4cf8-a41a-91f79401614c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:36:46.176314 dv-cinder-826510-8-smb devstack@keystone.service[80344]: WARNING py.warnings [None req-2a51570c-d1eb-48f9-b5e3-3bfa86df3e4e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:36:46.176314 dv-cinder-826510-8-smb devstack@keystone.service[80344]: warnings.warn(msg) Jul 14 15:36:46.176314 dv-cinder-826510-8-smb devstack@keystone.service[80344]: Jul 14 15:36:46.178074 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a51570c-d1eb-48f9-b5e3-3bfa86df3e4e admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:46.194070 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 797/1556] 10.222.0.118 () {58 vars in 1157 bytes} [Thu Jul 14 15:36:46 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:46.195752 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c0edd5-a1e2-4ee2-afb6-ed5ca58a02f1 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:46.196139 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c0edd5-a1e2-4ee2-afb6-ed5ca58a02f1 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:46.196514 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c0edd5-a1e2-4ee2-afb6-ed5ca58a02f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:46.206971 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 760/1557] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:36:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:36:46.208509 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75718933-54c1-4cf8-a41a-91f79401614c None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:46.221648 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75718933-54c1-4cf8-a41a-91f79401614c None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:46.231762 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566e79fb-846a-479c-afa7-bc158915d76c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:46.231871 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-73c0edd5-a1e2-4ee2-afb6-ed5ca58a02f1 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:36:46.231964 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e79fb-846a-479c-afa7-bc158915d76c admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:46.231964 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e79fb-846a-479c-afa7-bc158915d76c admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:46.231964 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e79fb-846a-479c-afa7-bc158915d76c admin admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:46.232206 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-73c0edd5-a1e2-4ee2-afb6-ed5ca58a02f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:36:46.232283 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566e79fb-846a-479c-afa7-bc158915d76c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:46.232283 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566e79fb-846a-479c-afa7-bc158915d76c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:46.233347 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566e79fb-846a-479c-afa7-bc158915d76c admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:46.247073 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 798/1558] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:36:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:36:46.254608 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 761/1559] 10.222.0.118 () {58 vars in 1157 bytes} [Thu Jul 14 15:36:46 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:46.254608 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b7dfc6-98be-46c4-aaff-129c0d478286 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:46.254608 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b7dfc6-98be-46c4-aaff-129c0d478286 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:46.254608 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b7dfc6-98be-46c4-aaff-129c0d478286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:46.256580 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9272aa3a-aa09-42c4-843c-18cb12bbd946 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:46.257311 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9272aa3a-aa09-42c4-843c-18cb12bbd946 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:46.258258 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9272aa3a-aa09-42c4-843c-18cb12bbd946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:46.275886 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-e8b7dfc6-98be-46c4-aaff-129c0d478286 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:36:46.277177 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-e8b7dfc6-98be-46c4-aaff-129c0d478286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:36:46.278748 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-9272aa3a-aa09-42c4-843c-18cb12bbd946 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:36:46.280002 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-9272aa3a-aa09-42c4-843c-18cb12bbd946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:36:46.287332 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 762/1560] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:36:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:36:46.289185 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 799/1561] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:36:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:36:46.290495 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355929c2-8d7e-4413-ba25-06400c67efba None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:46.290843 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355929c2-8d7e-4413-ba25-06400c67efba None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:46.291188 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355929c2-8d7e-4413-ba25-06400c67efba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:46.291497 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b7dfc6-98be-46c4-aaff-129c0d478286 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:46.305926 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b7dfc6-98be-46c4-aaff-129c0d478286 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:46.310998 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92b514f-07ab-4219-8830-f5e89cc7d162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:46.311747 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92b514f-07ab-4219-8830-f5e89cc7d162 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:46.312102 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92b514f-07ab-4219-8830-f5e89cc7d162 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:46.312308 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-355929c2-8d7e-4413-ba25-06400c67efba None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:36:46.312540 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92b514f-07ab-4219-8830-f5e89cc7d162 admin admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:46.313315 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92b514f-07ab-4219-8830-f5e89cc7d162 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:46.313735 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-355929c2-8d7e-4413-ba25-06400c67efba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:36:46.314517 dv-cinder-826510-8-smb devstack@keystone.service[80345]: WARNING py.warnings [None req-f92b514f-07ab-4219-8830-f5e89cc7d162 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:36:46.314517 dv-cinder-826510-8-smb devstack@keystone.service[80345]: warnings.warn(msg) Jul 14 15:36:46.314517 dv-cinder-826510-8-smb devstack@keystone.service[80345]: Jul 14 15:36:46.316091 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92b514f-07ab-4219-8830-f5e89cc7d162 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:46.322492 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 800/1562] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:36:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:36:46.323604 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8894fe13-614d-4286-82fe-94e3031029fc None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:46.323888 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8894fe13-614d-4286-82fe-94e3031029fc None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:46.324156 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8894fe13-614d-4286-82fe-94e3031029fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:46.331879 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:46.348927 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-8894fe13-614d-4286-82fe-94e3031029fc None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:36:46.350449 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-8894fe13-614d-4286-82fe-94e3031029fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:36:46.356012 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 763/1563] 10.222.0.118 () {60 vars in 1157 bytes} [Thu Jul 14 15:36:46 2022] POST /identity/v3/projects => generated 394 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:36:46.357430 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924aaa7e-a2ba-4088-904f-c27288c4d335 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:46.357837 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924aaa7e-a2ba-4088-904f-c27288c4d335 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:46.358324 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924aaa7e-a2ba-4088-904f-c27288c4d335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:46.392236 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-924aaa7e-a2ba-4088-904f-c27288c4d335 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:36:46.394551 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-924aaa7e-a2ba-4088-904f-c27288c4d335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:36:46.403617 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:46.438770 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 801/1564] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:36:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:36:46.439899 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8894fe13-614d-4286-82fe-94e3031029fc None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:46.450886 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8894fe13-614d-4286-82fe-94e3031029fc None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:46.457254 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c388b395-5330-4e35-8efe-afe392d31c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:46.458760 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c388b395-5330-4e35-8efe-afe392d31c78 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:46.459118 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c388b395-5330-4e35-8efe-afe392d31c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:46.459462 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c388b395-5330-4e35-8efe-afe392d31c78 admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:46.460246 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c388b395-5330-4e35-8efe-afe392d31c78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:46.462786 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c388b395-5330-4e35-8efe-afe392d31c78 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:46.511927 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 802/1565] 10.222.0.118 () {60 vars in 1157 bytes} [Thu Jul 14 15:36:46 2022] POST /identity/v3/projects => generated 388 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:36:46.511927 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c388b395-5330-4e35-8efe-afe392d31c78 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:46.516478 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 764/1566] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:36:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:36:46.516478 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924aaa7e-a2ba-4088-904f-c27288c4d335 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:46.530368 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924aaa7e-a2ba-4088-904f-c27288c4d335 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:46.593687 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c388b395-5330-4e35-8efe-afe392d31c78 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:46.599627 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d984407e-e016-436f-87fe-96b5e5f36ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:46.600311 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d984407e-e016-436f-87fe-96b5e5f36ea0 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:46.600718 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d984407e-e016-436f-87fe-96b5e5f36ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:46.601005 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d984407e-e016-436f-87fe-96b5e5f36ea0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:46.601749 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d984407e-e016-436f-87fe-96b5e5f36ea0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:46.602089 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d984407e-e016-436f-87fe-96b5e5f36ea0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:46.603750 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d984407e-e016-436f-87fe-96b5e5f36ea0 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:46.615487 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5341883c-b55d-4f1e-aa60-857fedd876c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:46.616182 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5341883c-b55d-4f1e-aa60-857fedd876c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:46.616467 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5341883c-b55d-4f1e-aa60-857fedd876c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:46.616746 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5341883c-b55d-4f1e-aa60-857fedd876c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:46.617286 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 803/1567] 10.222.0.118 () {58 vars in 1157 bytes} [Thu Jul 14 15:36:46 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:46.617492 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5341883c-b55d-4f1e-aa60-857fedd876c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:46.617799 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5341883c-b55d-4f1e-aa60-857fedd876c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:46.619497 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5341883c-b55d-4f1e-aa60-857fedd876c6 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:46.625652 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d984407e-e016-436f-87fe-96b5e5f36ea0 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:46.641630 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 765/1568] 10.222.0.118 () {58 vars in 1157 bytes} [Thu Jul 14 15:36:46 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:46.641630 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5341883c-b55d-4f1e-aa60-857fedd876c6 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:46.642126 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d984407e-e016-436f-87fe-96b5e5f36ea0 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:46.648494 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7532c8fd-853a-4eba-a217-9f66a0527780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:46.649246 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7532c8fd-853a-4eba-a217-9f66a0527780 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:46.649610 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7532c8fd-853a-4eba-a217-9f66a0527780 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:46.649951 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7532c8fd-853a-4eba-a217-9f66a0527780 admin admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:46.650790 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7532c8fd-853a-4eba-a217-9f66a0527780 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:46.651159 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7532c8fd-853a-4eba-a217-9f66a0527780 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:46.652790 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7532c8fd-853a-4eba-a217-9f66a0527780 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:46.655546 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5341883c-b55d-4f1e-aa60-857fedd876c6 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:46.662960 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e8e535-4b01-4f5e-b250-16ec5e6c7424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:46.663813 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e8e535-4b01-4f5e-b250-16ec5e6c7424 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:46.664271 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e8e535-4b01-4f5e-b250-16ec5e6c7424 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:46.664670 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e8e535-4b01-4f5e-b250-16ec5e6c7424 admin admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:46.665488 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e8e535-4b01-4f5e-b250-16ec5e6c7424 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:46.666020 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 804/1569] 10.222.0.118 () {58 vars in 1157 bytes} [Thu Jul 14 15:36:46 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:46.667740 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e8e535-4b01-4f5e-b250-16ec5e6c7424 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:46.671600 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1bef63-ce39-45f1-b3b8-480800474352 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:46.672092 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1bef63-ce39-45f1-b3b8-480800474352 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:46.672555 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1bef63-ce39-45f1-b3b8-480800474352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:46.693901 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 766/1570] 10.222.0.118 () {60 vars in 1148 bytes} [Thu Jul 14 15:36:46 2022] POST /identity/v3/users => generated 298 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:36:46.698075 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e8e535-4b01-4f5e-b250-16ec5e6c7424 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:46.698774 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-bd1bef63-ce39-45f1-b3b8-480800474352 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:36:46.700062 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-bd1bef63-ce39-45f1-b3b8-480800474352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:36:46.715413 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e8e535-4b01-4f5e-b250-16ec5e6c7424 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:46.716751 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 805/1571] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:36:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:36:46.717833 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1bef63-ce39-45f1-b3b8-480800474352 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:46.728413 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7d100f-90ac-42d4-baa7-fd2aefda2f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:46.729118 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7d100f-90ac-42d4-baa7-fd2aefda2f8a admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:46.729313 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1bef63-ce39-45f1-b3b8-480800474352 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:46.729453 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7d100f-90ac-42d4-baa7-fd2aefda2f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:46.729704 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7d100f-90ac-42d4-baa7-fd2aefda2f8a admin admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:46.730415 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7d100f-90ac-42d4-baa7-fd2aefda2f8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:46.732548 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7d100f-90ac-42d4-baa7-fd2aefda2f8a admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:46.734337 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2184e84-308c-4de6-87ea-86b580030d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:46.735025 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2184e84-308c-4de6-87ea-86b580030d34 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:46.735301 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2184e84-308c-4de6-87ea-86b580030d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:46.735571 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2184e84-308c-4de6-87ea-86b580030d34 admin admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:46.736459 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2184e84-308c-4de6-87ea-86b580030d34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:46.736828 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2184e84-308c-4de6-87ea-86b580030d34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:46.738380 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2184e84-308c-4de6-87ea-86b580030d34 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:46.755854 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 806/1572] 10.222.0.118 () {58 vars in 1157 bytes} [Thu Jul 14 15:36:46 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:46.756771 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2184e84-308c-4de6-87ea-86b580030d34 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:46.762349 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 767/1573] 10.222.0.118 () {60 vars in 1148 bytes} [Thu Jul 14 15:36:46 2022] POST /identity/v3/users => generated 295 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:36:46.763584 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7d100f-90ac-42d4-baa7-fd2aefda2f8a admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:46.769568 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2184e84-308c-4de6-87ea-86b580030d34 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:46.783389 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f227db9d-e1c0-44c2-b504-116be6a3d596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:46.784144 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f227db9d-e1c0-44c2-b504-116be6a3d596 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:46.784495 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f227db9d-e1c0-44c2-b504-116be6a3d596 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:46.785072 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f227db9d-e1c0-44c2-b504-116be6a3d596 admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:46.785803 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f227db9d-e1c0-44c2-b504-116be6a3d596 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:46.788791 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f227db9d-e1c0-44c2-b504-116be6a3d596 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:46.789954 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7d100f-90ac-42d4-baa7-fd2aefda2f8a admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:46.798397 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770137d2-8413-4caa-9f6f-74d23a214f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:46.798397 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770137d2-8413-4caa-9f6f-74d23a214f28 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:46.798397 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770137d2-8413-4caa-9f6f-74d23a214f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:46.798397 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770137d2-8413-4caa-9f6f-74d23a214f28 admin admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:46.798913 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770137d2-8413-4caa-9f6f-74d23a214f28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:46.800389 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770137d2-8413-4caa-9f6f-74d23a214f28 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:46.833768 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 807/1574] 10.222.0.118 () {60 vars in 1157 bytes} [Thu Jul 14 15:36:46 2022] POST /identity/v3/projects => generated 362 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:36:46.835485 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f227db9d-e1c0-44c2-b504-116be6a3d596 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:46.844513 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 768/1575] 10.222.0.118 () {60 vars in 1157 bytes} [Thu Jul 14 15:36:46 2022] POST /identity/v3/projects => generated 386 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:36:46.844513 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770137d2-8413-4caa-9f6f-74d23a214f28 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:46.890990 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:46.935651 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:46.943276 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f227db9d-e1c0-44c2-b504-116be6a3d596 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:46.958656 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770137d2-8413-4caa-9f6f-74d23a214f28 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:46.965289 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c342599a-8b04-4038-98c6-6313e5d2fc6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:46.965289 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c342599a-8b04-4038-98c6-6313e5d2fc6b admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:46.965289 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c342599a-8b04-4038-98c6-6313e5d2fc6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:46.965713 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c342599a-8b04-4038-98c6-6313e5d2fc6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:46.966446 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c342599a-8b04-4038-98c6-6313e5d2fc6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:46.968350 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c342599a-8b04-4038-98c6-6313e5d2fc6b admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:46.980061 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 769/1576] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:36:46 2022] GET /identity/v3/roles => generated 1427 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:36:46.984426 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c342599a-8b04-4038-98c6-6313e5d2fc6b admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:46.996067 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c342599a-8b04-4038-98c6-6313e5d2fc6b admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:47.002211 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d146a11-c5db-4b29-9487-c99602099453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:47.003030 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d146a11-c5db-4b29-9487-c99602099453 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:47.003433 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d146a11-c5db-4b29-9487-c99602099453 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:47.003955 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d146a11-c5db-4b29-9487-c99602099453 admin admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:47.005356 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d146a11-c5db-4b29-9487-c99602099453 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:47.005672 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d146a11-c5db-4b29-9487-c99602099453 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:47.007587 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d146a11-c5db-4b29-9487-c99602099453 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:47.022431 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 770/1577] 10.222.0.118 () {58 vars in 1157 bytes} [Thu Jul 14 15:36:46 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:47.026980 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d146a11-c5db-4b29-9487-c99602099453 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:47.038343 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c826342-d262-470d-9a96-2baa0b7eff24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:47.039560 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c826342-d262-470d-9a96-2baa0b7eff24 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:47.040036 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c826342-d262-470d-9a96-2baa0b7eff24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:47.040499 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c826342-d262-470d-9a96-2baa0b7eff24 admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:47.041047 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d146a11-c5db-4b29-9487-c99602099453 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:47.041695 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c826342-d262-470d-9a96-2baa0b7eff24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:47.045396 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c826342-d262-470d-9a96-2baa0b7eff24 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:47.047850 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93b4238-fbf6-4ecf-a41b-a75c68f83578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:47.048611 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93b4238-fbf6-4ecf-a41b-a75c68f83578 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:47.048978 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93b4238-fbf6-4ecf-a41b-a75c68f83578 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:47.049944 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93b4238-fbf6-4ecf-a41b-a75c68f83578 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:47.050978 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93b4238-fbf6-4ecf-a41b-a75c68f83578 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:47.052947 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93b4238-fbf6-4ecf-a41b-a75c68f83578 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:47.069673 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 771/1578] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:36:47 2022] GET /identity/v3/roles => generated 1427 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:36:47.071626 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93b4238-fbf6-4ecf-a41b-a75c68f83578 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:47.087349 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 808/1579] 10.222.0.118 () {60 vars in 1157 bytes} [Thu Jul 14 15:36:46 2022] POST /identity/v3/projects => generated 394 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:36:47.089881 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c826342-d262-470d-9a96-2baa0b7eff24 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:47.091877 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93b4238-fbf6-4ecf-a41b-a75c68f83578 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:47.163683 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa147f23-9dc4-46cf-9fc6-a0f9fbf23d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:47.164480 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa147f23-9dc4-46cf-9fc6-a0f9fbf23d76 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:47.164932 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa147f23-9dc4-46cf-9fc6-a0f9fbf23d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:47.165268 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa147f23-9dc4-46cf-9fc6-a0f9fbf23d76 admin admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:47.166092 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa147f23-9dc4-46cf-9fc6-a0f9fbf23d76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:47.168358 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa147f23-9dc4-46cf-9fc6-a0f9fbf23d76 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:47.171433 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c826342-d262-470d-9a96-2baa0b7eff24 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:47.176588 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337d8061-33b0-4988-a4c3-c85bccc6187b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:47.177733 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337d8061-33b0-4988-a4c3-c85bccc6187b admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:47.178244 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337d8061-33b0-4988-a4c3-c85bccc6187b admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:47.178698 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337d8061-33b0-4988-a4c3-c85bccc6187b admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:47.180211 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337d8061-33b0-4988-a4c3-c85bccc6187b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:47.181458 dv-cinder-826510-8-smb devstack@keystone.service[80344]: WARNING py.warnings [None req-337d8061-33b0-4988-a4c3-c85bccc6187b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:36:47.181458 dv-cinder-826510-8-smb devstack@keystone.service[80344]: warnings.warn(msg) Jul 14 15:36:47.181458 dv-cinder-826510-8-smb devstack@keystone.service[80344]: Jul 14 15:36:47.183078 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337d8061-33b0-4988-a4c3-c85bccc6187b admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:47.208573 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 772/1581] 10.222.0.118 () {60 vars in 1157 bytes} [Thu Jul 14 15:36:47 2022] POST /identity/v3/projects => generated 374 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:36:47.208862 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 809/1581] 10.222.0.118 () {60 vars in 1148 bytes} [Thu Jul 14 15:36:47 2022] POST /identity/v3/users => generated 282 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:36:47.209765 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa147f23-9dc4-46cf-9fc6-a0f9fbf23d76 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:47.210744 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337d8061-33b0-4988-a4c3-c85bccc6187b admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:47.221575 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337d8061-33b0-4988-a4c3-c85bccc6187b admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:47.318940 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa147f23-9dc4-46cf-9fc6-a0f9fbf23d76 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:47.325196 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161b5513-e03d-4690-ba17-0e0b789ce044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:47.325986 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161b5513-e03d-4690-ba17-0e0b789ce044 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:47.326636 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161b5513-e03d-4690-ba17-0e0b789ce044 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:47.326636 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161b5513-e03d-4690-ba17-0e0b789ce044 admin admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:47.327405 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161b5513-e03d-4690-ba17-0e0b789ce044 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:47.329418 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161b5513-e03d-4690-ba17-0e0b789ce044 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:47.333741 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78877673-9abf-4244-aec3-e29f4a05bf62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:47.334813 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78877673-9abf-4244-aec3-e29f4a05bf62 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:47.335177 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78877673-9abf-4244-aec3-e29f4a05bf62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:47.335523 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78877673-9abf-4244-aec3-e29f4a05bf62 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:47.336613 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78877673-9abf-4244-aec3-e29f4a05bf62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:47.342677 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78877673-9abf-4244-aec3-e29f4a05bf62 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:47.358851 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 773/1582] 10.222.0.118 () {60 vars in 1148 bytes} [Thu Jul 14 15:36:47 2022] POST /identity/v3/users => generated 294 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:36:47.362876 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161b5513-e03d-4690-ba17-0e0b789ce044 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:47.367682 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 810/1583] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:36:47 2022] GET /identity/v3/roles => generated 1427 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:36:47.369078 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78877673-9abf-4244-aec3-e29f4a05bf62 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:47.380879 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161b5513-e03d-4690-ba17-0e0b789ce044 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:47.386382 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d09580b-4924-4b27-84bb-25a27ee78395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:47.386806 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78877673-9abf-4244-aec3-e29f4a05bf62 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:47.387060 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d09580b-4924-4b27-84bb-25a27ee78395 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:47.387335 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d09580b-4924-4b27-84bb-25a27ee78395 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:47.387606 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d09580b-4924-4b27-84bb-25a27ee78395 admin admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:47.388468 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d09580b-4924-4b27-84bb-25a27ee78395 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:47.390441 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d09580b-4924-4b27-84bb-25a27ee78395 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:47.394591 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c44c8a-8555-46e7-8789-2d340c1d5e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:47.396627 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c44c8a-8555-46e7-8789-2d340c1d5e01 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:47.397028 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c44c8a-8555-46e7-8789-2d340c1d5e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:47.397386 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c44c8a-8555-46e7-8789-2d340c1d5e01 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:47.398452 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c44c8a-8555-46e7-8789-2d340c1d5e01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:47.400491 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c44c8a-8555-46e7-8789-2d340c1d5e01 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:47.408482 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:47.417331 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 811/1584] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:36:47 2022] GET /identity/v3/roles => generated 1427 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:36:47.418290 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c44c8a-8555-46e7-8789-2d340c1d5e01 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:47.426552 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:47.429050 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 774/1585] 10.222.0.118 () {60 vars in 1157 bytes} [Thu Jul 14 15:36:47 2022] POST /identity/v3/projects => generated 380 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:36:47.429941 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d09580b-4924-4b27-84bb-25a27ee78395 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:47.448522 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c44c8a-8555-46e7-8789-2d340c1d5e01 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:47.547185 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d09580b-4924-4b27-84bb-25a27ee78395 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:47.554747 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafc9cd4-f086-47b6-a22b-193eaaa747bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:47.555172 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed92225-fcd1-499b-9077-d12cdb983f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:47.556206 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafc9cd4-f086-47b6-a22b-193eaaa747bf admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:47.556555 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafc9cd4-f086-47b6-a22b-193eaaa747bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:47.556904 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafc9cd4-f086-47b6-a22b-193eaaa747bf admin admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:47.557944 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed92225-fcd1-499b-9077-d12cdb983f6d admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:47.558119 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafc9cd4-f086-47b6-a22b-193eaaa747bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:47.559061 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed92225-fcd1-499b-9077-d12cdb983f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:47.559722 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed92225-fcd1-499b-9077-d12cdb983f6d admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:47.560967 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed92225-fcd1-499b-9077-d12cdb983f6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:47.561142 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafc9cd4-f086-47b6-a22b-193eaaa747bf admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:47.563592 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed92225-fcd1-499b-9077-d12cdb983f6d admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:47.591898 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 775/1586] 10.222.0.118 () {60 vars in 1148 bytes} [Thu Jul 14 15:36:47 2022] POST /identity/v3/users => generated 288 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:36:47.592759 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 812/1587] 10.222.0.118 () {60 vars in 1148 bytes} [Thu Jul 14 15:36:47 2022] POST /identity/v3/users => generated 298 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:36:47.593850 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed92225-fcd1-499b-9077-d12cdb983f6d admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:47.598256 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafc9cd4-f086-47b6-a22b-193eaaa747bf admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:47.608253 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed92225-fcd1-499b-9077-d12cdb983f6d admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:47.613533 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e282550-07c5-4d9c-aa6c-9fe531088eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:47.614553 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafc9cd4-f086-47b6-a22b-193eaaa747bf admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:47.614760 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e282550-07c5-4d9c-aa6c-9fe531088eda admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:47.615040 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e282550-07c5-4d9c-aa6c-9fe531088eda admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:47.615313 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e282550-07c5-4d9c-aa6c-9fe531088eda admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:47.616050 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e282550-07c5-4d9c-aa6c-9fe531088eda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:47.618253 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e282550-07c5-4d9c-aa6c-9fe531088eda admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:47.620838 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa094e9-bfb6-471c-8185-69e4f1a755d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:47.622197 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa094e9-bfb6-471c-8185-69e4f1a755d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:47.622553 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa094e9-bfb6-471c-8185-69e4f1a755d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:47.623139 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa094e9-bfb6-471c-8185-69e4f1a755d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:47.623949 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa094e9-bfb6-471c-8185-69e4f1a755d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:47.625765 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa094e9-bfb6-471c-8185-69e4f1a755d1 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:47.633223 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 813/1588] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:36:47 2022] GET /identity/v3/roles => generated 1427 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:36:47.634373 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e282550-07c5-4d9c-aa6c-9fe531088eda admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:47.644722 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e282550-07c5-4d9c-aa6c-9fe531088eda admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:47.648099 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 776/1589] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:36:47 2022] GET /identity/v3/roles => generated 1427 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:36:47.649430 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa094e9-bfb6-471c-8185-69e4f1a755d1 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:47.652194 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4265eb6c-116a-405d-a72f-46a2740196e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:47.653207 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4265eb6c-116a-405d-a72f-46a2740196e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:47.653481 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4265eb6c-116a-405d-a72f-46a2740196e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:47.653770 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4265eb6c-116a-405d-a72f-46a2740196e0 admin admin] PATH_INFO: `/v3/projects/d47519e5256047a292363db0ac0fdcbc/users/4c4a0889c40248808900619987f7d6fe/roles/4abcf5e5e7cd4b53ae1828fec6550d53` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:47.663953 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa094e9-bfb6-471c-8185-69e4f1a755d1 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:47.677526 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4265eb6c-116a-405d-a72f-46a2740196e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d47519e5256047a292363db0ac0fdcbc, user_id=4c4a0889c40248808900619987f7d6fe, role_id=4abcf5e5e7cd4b53ae1828fec6550d53)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:47.680535 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4265eb6c-116a-405d-a72f-46a2740196e0 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:47.684029 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ec6e90-6e9f-4abc-8af0-b7dcc7d051cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:47.685521 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ec6e90-6e9f-4abc-8af0-b7dcc7d051cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:47.685869 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ec6e90-6e9f-4abc-8af0-b7dcc7d051cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:47.686280 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ec6e90-6e9f-4abc-8af0-b7dcc7d051cc admin admin] PATH_INFO: `/v3/projects/3e75f82879d1401c95a3fbae144a118b/users/bab083ba82d64af391d09c531b8647e0/roles/4abcf5e5e7cd4b53ae1828fec6550d53` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:47.699100 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 814/1590] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:36:47 2022] PUT /identity/v3/projects/d47519e5256047a292363db0ac0fdcbc/users/4c4a0889c40248808900619987f7d6fe/roles/4abcf5e5e7cd4b53ae1828fec6550d53 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:36:47.700249 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4265eb6c-116a-405d-a72f-46a2740196e0 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:47.705531 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ec6e90-6e9f-4abc-8af0-b7dcc7d051cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e75f82879d1401c95a3fbae144a118b, user_id=bab083ba82d64af391d09c531b8647e0, role_id=4abcf5e5e7cd4b53ae1828fec6550d53)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:47.707034 dv-cinder-826510-8-smb devstack@keystone.service[80345]: WARNING py.warnings [None req-50ec6e90-6e9f-4abc-8af0-b7dcc7d051cc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:36:47.707034 dv-cinder-826510-8-smb devstack@keystone.service[80345]: warnings.warn(msg) Jul 14 15:36:47.707034 dv-cinder-826510-8-smb devstack@keystone.service[80345]: Jul 14 15:36:47.709023 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ec6e90-6e9f-4abc-8af0-b7dcc7d051cc admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:47.726968 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 777/1591] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:36:47 2022] PUT /identity/v3/projects/3e75f82879d1401c95a3fbae144a118b/users/bab083ba82d64af391d09c531b8647e0/roles/4abcf5e5e7cd4b53ae1828fec6550d53 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:36:47.727869 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ec6e90-6e9f-4abc-8af0-b7dcc7d051cc admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:47.778835 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4265eb6c-116a-405d-a72f-46a2740196e0 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:47.826806 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ec6e90-6e9f-4abc-8af0-b7dcc7d051cc admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:47.834212 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bdc134-870b-4acb-9535-696d324eb8cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:47.835493 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bdc134-870b-4acb-9535-696d324eb8cc admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:47.835493 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bdc134-870b-4acb-9535-696d324eb8cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:47.835698 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bdc134-870b-4acb-9535-696d324eb8cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:47.836691 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bdc134-870b-4acb-9535-696d324eb8cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:47.838571 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bdc134-870b-4acb-9535-696d324eb8cc admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:47.850201 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 778/1592] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:36:47 2022] GET /identity/v3/roles => generated 1427 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:36:47.851296 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bdc134-870b-4acb-9535-696d324eb8cc admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:47.853635 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fed8ab-70fa-4f3f-abdf-4942098fa35f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:47.854540 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fed8ab-70fa-4f3f-abdf-4942098fa35f admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:47.854999 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fed8ab-70fa-4f3f-abdf-4942098fa35f admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:47.855453 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fed8ab-70fa-4f3f-abdf-4942098fa35f admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:47.856325 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fed8ab-70fa-4f3f-abdf-4942098fa35f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:47.858579 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fed8ab-70fa-4f3f-abdf-4942098fa35f admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:47.864410 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bdc134-870b-4acb-9535-696d324eb8cc admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:47.869894 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:47.870127 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05779479-b4fc-4a7a-8dc6-d3c1e80f8ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:47.870795 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05779479-b4fc-4a7a-8dc6-d3c1e80f8ea4 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:47.871196 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05779479-b4fc-4a7a-8dc6-d3c1e80f8ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:47.871491 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05779479-b4fc-4a7a-8dc6-d3c1e80f8ea4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:47.872642 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05779479-b4fc-4a7a-8dc6-d3c1e80f8ea4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:47.874580 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05779479-b4fc-4a7a-8dc6-d3c1e80f8ea4 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:47.891076 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 815/1593] 10.222.0.118 () {60 vars in 1148 bytes} [Thu Jul 14 15:36:47 2022] POST /identity/v3/users => generated 291 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:36:47.891291 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 779/1594] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:36:47 2022] GET /identity/v3/roles => generated 1427 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:36:47.891291 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05779479-b4fc-4a7a-8dc6-d3c1e80f8ea4 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:47.893527 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fed8ab-70fa-4f3f-abdf-4942098fa35f admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:47.908460 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05779479-b4fc-4a7a-8dc6-d3c1e80f8ea4 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:47.912486 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fed8ab-70fa-4f3f-abdf-4942098fa35f admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:47.915078 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29404755-c2ed-4541-9b39-b8ab61177ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:47.915898 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29404755-c2ed-4541-9b39-b8ab61177ad4 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:47.916283 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29404755-c2ed-4541-9b39-b8ab61177ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:47.916696 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29404755-c2ed-4541-9b39-b8ab61177ad4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:47.917731 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29404755-c2ed-4541-9b39-b8ab61177ad4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:47.918908 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5784677-9c0b-4ba4-83cb-e3da6b9dbe73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:47.919852 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5784677-9c0b-4ba4-83cb-e3da6b9dbe73 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:47.920028 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29404755-c2ed-4541-9b39-b8ab61177ad4 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:47.920462 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5784677-9c0b-4ba4-83cb-e3da6b9dbe73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:47.920932 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5784677-9c0b-4ba4-83cb-e3da6b9dbe73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:47.921855 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5784677-9c0b-4ba4-83cb-e3da6b9dbe73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:47.924099 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5784677-9c0b-4ba4-83cb-e3da6b9dbe73 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:47.943562 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 816/1595] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:36:47 2022] GET /identity/v3/roles => generated 1427 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:36:47.943562 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da078c2-acfc-42e2-8d79-70dc4da602fa None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:47.943562 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da078c2-acfc-42e2-8d79-70dc4da602fa None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:47.943562 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da078c2-acfc-42e2-8d79-70dc4da602fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:47.944931 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 780/1596] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:36:47 2022] GET /identity/v3/roles => generated 1427 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:36:47.946583 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea763bde-025e-466f-a976-f6e97cdd60a2 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:47.946993 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea763bde-025e-466f-a976-f6e97cdd60a2 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:47.947355 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea763bde-025e-466f-a976-f6e97cdd60a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:47.963723 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-5da078c2-acfc-42e2-8d79-70dc4da602fa None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:36:47.965821 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-5da078c2-acfc-42e2-8d79-70dc4da602fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:36:47.974700 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-ea763bde-025e-466f-a976-f6e97cdd60a2 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:36:47.976209 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-ea763bde-025e-466f-a976-f6e97cdd60a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:36:48.031609 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 817/1597] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:36:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:36:48.031609 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da078c2-acfc-42e2-8d79-70dc4da602fa None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:48.045247 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 781/1598] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:36:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:36:48.045247 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea763bde-025e-466f-a976-f6e97cdd60a2 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:48.045909 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da078c2-acfc-42e2-8d79-70dc4da602fa None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:48.046511 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea763bde-025e-466f-a976-f6e97cdd60a2 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:48.046646 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59160208-a7a2-4e07-8e55-59dd644c6c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:48.046646 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59160208-a7a2-4e07-8e55-59dd644c6c81 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:48.046646 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59160208-a7a2-4e07-8e55-59dd644c6c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:48.046646 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59160208-a7a2-4e07-8e55-59dd644c6c81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:48.046956 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59160208-a7a2-4e07-8e55-59dd644c6c81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:48.047042 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdebf9f-3f29-4b73-ba28-d439f7660801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:48.047042 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdebf9f-3f29-4b73-ba28-d439f7660801 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:48.047042 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdebf9f-3f29-4b73-ba28-d439f7660801 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:48.047042 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdebf9f-3f29-4b73-ba28-d439f7660801 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:48.047373 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59160208-a7a2-4e07-8e55-59dd644c6c81 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:48.047459 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdebf9f-3f29-4b73-ba28-d439f7660801 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:48.047459 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdebf9f-3f29-4b73-ba28-d439f7660801 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:48.060483 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 818/1599] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:36:47 2022] GET /identity/v3/roles => generated 1427 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:36:48.061528 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59160208-a7a2-4e07-8e55-59dd644c6c81 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:48.072267 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 782/1600] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:36:48 2022] GET /identity/v3/roles => generated 1427 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:36:48.073213 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdebf9f-3f29-4b73-ba28-d439f7660801 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:48.084046 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59160208-a7a2-4e07-8e55-59dd644c6c81 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:48.091789 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:48.098581 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdebf9f-3f29-4b73-ba28-d439f7660801 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:48.106251 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78922af7-d9de-4349-a7ad-f460ec2705fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:48.107237 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78922af7-d9de-4349-a7ad-f460ec2705fe admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:48.108949 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78922af7-d9de-4349-a7ad-f460ec2705fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:48.109390 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78922af7-d9de-4349-a7ad-f460ec2705fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:48.109900 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dace7a-ba34-4f85-805e-3dd4da1b19bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:48.110584 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78922af7-d9de-4349-a7ad-f460ec2705fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:48.110958 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dace7a-ba34-4f85-805e-3dd4da1b19bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:48.111317 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dace7a-ba34-4f85-805e-3dd4da1b19bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:48.111728 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dace7a-ba34-4f85-805e-3dd4da1b19bc admin admin] PATH_INFO: `/v3/projects/1e2032eee43241ee812367ad9bf8027a/users/34f09b2afbe54a6ab1ba27292bc5a964/roles/4abcf5e5e7cd4b53ae1828fec6550d53` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:48.113251 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78922af7-d9de-4349-a7ad-f460ec2705fe admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:48.127032 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 819/1601] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:36:48 2022] GET /identity/v3/roles => generated 1427 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:36:48.128162 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78922af7-d9de-4349-a7ad-f460ec2705fe admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:48.143155 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78922af7-d9de-4349-a7ad-f460ec2705fe admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:48.148691 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dace7a-ba34-4f85-805e-3dd4da1b19bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e2032eee43241ee812367ad9bf8027a, user_id=34f09b2afbe54a6ab1ba27292bc5a964, role_id=4abcf5e5e7cd4b53ae1828fec6550d53)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:48.151315 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af8c8c1-8594-45ad-8912-b5dba62fe8a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:48.151628 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dace7a-ba34-4f85-805e-3dd4da1b19bc admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:48.152436 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af8c8c1-8594-45ad-8912-b5dba62fe8a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:48.152862 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af8c8c1-8594-45ad-8912-b5dba62fe8a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:48.153149 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af8c8c1-8594-45ad-8912-b5dba62fe8a6 admin admin] PATH_INFO: `/v3/projects/12f47bd5d0e84f078ed94f71e8db8eab/users/855ded1ec35e407e861753d4c7ddf029/roles/4abcf5e5e7cd4b53ae1828fec6550d53` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:48.174012 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 783/1602] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:36:48 2022] PUT /identity/v3/projects/1e2032eee43241ee812367ad9bf8027a/users/34f09b2afbe54a6ab1ba27292bc5a964/roles/4abcf5e5e7cd4b53ae1828fec6550d53 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:36:48.174012 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dace7a-ba34-4f85-805e-3dd4da1b19bc admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:48.188743 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af8c8c1-8594-45ad-8912-b5dba62fe8a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12f47bd5d0e84f078ed94f71e8db8eab, user_id=855ded1ec35e407e861753d4c7ddf029, role_id=4abcf5e5e7cd4b53ae1828fec6550d53)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:48.193409 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af8c8c1-8594-45ad-8912-b5dba62fe8a6 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:48.214259 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 820/1603] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:36:48 2022] PUT /identity/v3/projects/12f47bd5d0e84f078ed94f71e8db8eab/users/855ded1ec35e407e861753d4c7ddf029/roles/4abcf5e5e7cd4b53ae1828fec6550d53 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:36:48.215512 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af8c8c1-8594-45ad-8912-b5dba62fe8a6 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:48.261049 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dace7a-ba34-4f85-805e-3dd4da1b19bc admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:48.290065 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af8c8c1-8594-45ad-8912-b5dba62fe8a6 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:48.296401 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1074e006-3bcf-4802-a786-dbb70d333feb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b650be8114b64df0ac88441f1c50b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:48.297622 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1074e006-3bcf-4802-a786-dbb70d333feb service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:48.297920 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1074e006-3bcf-4802-a786-dbb70d333feb service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:48.298615 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1074e006-3bcf-4802-a786-dbb70d333feb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:48.325224 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c925550-b0d2-49e1-81f1-2f8bcedad4a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b650be8114b64df0ac88441f1c50b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:48.325950 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c925550-b0d2-49e1-81f1-2f8bcedad4a9 service neutron] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:48.326694 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c925550-b0d2-49e1-81f1-2f8bcedad4a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:48.326694 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c925550-b0d2-49e1-81f1-2f8bcedad4a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:48.378431 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1074e006-3bcf-4802-a786-dbb70d333feb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:48.380762 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1074e006-3bcf-4802-a786-dbb70d333feb service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:48.392955 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 821/1604] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:36:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:36:48.393871 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1074e006-3bcf-4802-a786-dbb70d333feb service neutron] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:48.405415 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c925550-b0d2-49e1-81f1-2f8bcedad4a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:48.407842 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c925550-b0d2-49e1-81f1-2f8bcedad4a9 service neutron] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:48.408726 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1074e006-3bcf-4802-a786-dbb70d333feb service neutron] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:48.413885 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b1ac31-7b5d-4767-86cf-f043bcb690bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:48.414966 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b1ac31-7b5d-4767-86cf-f043bcb690bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:48.415251 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b1ac31-7b5d-4767-86cf-f043bcb690bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:48.415526 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b1ac31-7b5d-4767-86cf-f043bcb690bd admin admin] PATH_INFO: `/v3/projects/55002fa42a4d4ca59ecb709f87b64b87/users/2ada5328227a41d8b10a09f6b5a5e4f9/roles/4abcf5e5e7cd4b53ae1828fec6550d53` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:48.426027 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 784/1605] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:36:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:36:48.427633 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c925550-b0d2-49e1-81f1-2f8bcedad4a9 service neutron] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:48.441016 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c925550-b0d2-49e1-81f1-2f8bcedad4a9 service neutron] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:48.441216 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b1ac31-7b5d-4767-86cf-f043bcb690bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=55002fa42a4d4ca59ecb709f87b64b87, user_id=2ada5328227a41d8b10a09f6b5a5e4f9, role_id=4abcf5e5e7cd4b53ae1828fec6550d53)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:48.445208 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b1ac31-7b5d-4767-86cf-f043bcb690bd admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:48.447009 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcc7113-3c3a-462f-8128-cf9ebffda2c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:48.448223 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcc7113-3c3a-462f-8128-cf9ebffda2c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:48.449116 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcc7113-3c3a-462f-8128-cf9ebffda2c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:48.449550 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcc7113-3c3a-462f-8128-cf9ebffda2c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:48.450858 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcc7113-3c3a-462f-8128-cf9ebffda2c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:48.452961 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcc7113-3c3a-462f-8128-cf9ebffda2c9 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:48.466620 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 822/1606] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:36:48 2022] PUT /identity/v3/projects/55002fa42a4d4ca59ecb709f87b64b87/users/2ada5328227a41d8b10a09f6b5a5e4f9/roles/4abcf5e5e7cd4b53ae1828fec6550d53 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:36:48.467642 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b1ac31-7b5d-4767-86cf-f043bcb690bd admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:48.475387 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 785/1607] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:36:48 2022] GET /identity/v3/roles => generated 1427 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:36:48.477146 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754d137a-16b9-4b00-8b8e-e31f2b197f1e None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:48.478498 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754d137a-16b9-4b00-8b8e-e31f2b197f1e None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:48.478976 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754d137a-16b9-4b00-8b8e-e31f2b197f1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:48.501159 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:48.547883 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-754d137a-16b9-4b00-8b8e-e31f2b197f1e None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:36:48.554660 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-754d137a-16b9-4b00-8b8e-e31f2b197f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:36:48.612446 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b1ac31-7b5d-4767-86cf-f043bcb690bd admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:48.639024 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f8fe33-95ac-40ce-ac74-2b301641974d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:48.639815 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f8fe33-95ac-40ce-ac74-2b301641974d admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:48.640093 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f8fe33-95ac-40ce-ac74-2b301641974d admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:48.640369 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f8fe33-95ac-40ce-ac74-2b301641974d admin admin] PATH_INFO: `/v3/projects/eacfb1428c194adc9d9a74078d31bd4e/users/700ed1b19924496891a54e1758444a4b/roles/4abcf5e5e7cd4b53ae1828fec6550d53` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:48.655446 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:48.679671 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f8fe33-95ac-40ce-ac74-2b301641974d admin admin] RBAC: Authorizing `identity:create_grant(project_id=eacfb1428c194adc9d9a74078d31bd4e, user_id=700ed1b19924496891a54e1758444a4b, role_id=4abcf5e5e7cd4b53ae1828fec6550d53)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:48.682410 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f8fe33-95ac-40ce-ac74-2b301641974d admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:48.742671 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 823/1608] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:36:48 2022] PUT /identity/v3/projects/eacfb1428c194adc9d9a74078d31bd4e/users/700ed1b19924496891a54e1758444a4b/roles/4abcf5e5e7cd4b53ae1828fec6550d53 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:36:48.745381 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 786/1609] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:36:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:36:48.747085 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c1556-e10f-4f06-904a-097eee51251b None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:48.747612 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c1556-e10f-4f06-904a-097eee51251b None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:48.748560 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c1556-e10f-4f06-904a-097eee51251b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:48.752546 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f515f9-3851-4c65-9121-2f466be1ac5c None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:48.752845 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f515f9-3851-4c65-9121-2f466be1ac5c None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:48.753124 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f515f9-3851-4c65-9121-2f466be1ac5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:48.813671 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-c96c1556-e10f-4f06-904a-097eee51251b None None] MFA Rules not processed for user `2ada5328227a41d8b10a09f6b5a5e4f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:36:48.816652 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-c96c1556-e10f-4f06-904a-097eee51251b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:36:48.822653 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-09f515f9-3851-4c65-9121-2f466be1ac5c None None] MFA Rules not processed for user `855ded1ec35e407e861753d4c7ddf029`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:36:48.823918 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-09f515f9-3851-4c65-9121-2f466be1ac5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:36:48.954609 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 787/1610] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:36:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:36:48.954609 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96c1556-e10f-4f06-904a-097eee51251b None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:48.982379 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 824/1611] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:36:48 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:36:48.984065 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64656b9d-be2f-4e87-8552-66c76fa20667 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:48.984353 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64656b9d-be2f-4e87-8552-66c76fa20667 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:48.984633 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64656b9d-be2f-4e87-8552-66c76fa20667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:49.067253 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-64656b9d-be2f-4e87-8552-66c76fa20667 None None] MFA Rules not processed for user `700ed1b19924496891a54e1758444a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:36:49.071742 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-64656b9d-be2f-4e87-8552-66c76fa20667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:36:49.100038 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96c1556-e10f-4f06-904a-097eee51251b None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:49.107171 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24f2feb-2e37-4ac1-a222-529b85e8ecfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:49.108360 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24f2feb-2e37-4ac1-a222-529b85e8ecfc admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:49.108647 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24f2feb-2e37-4ac1-a222-529b85e8ecfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:49.109012 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24f2feb-2e37-4ac1-a222-529b85e8ecfc admin admin] PATH_INFO: `/v3/projects/eec2b8c15d6b4ed19f8d35a8c769718d/users/cb3789b5896349f89ec70d97b70d3e7e/roles/4abcf5e5e7cd4b53ae1828fec6550d53` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:49.140676 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24f2feb-2e37-4ac1-a222-529b85e8ecfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=eec2b8c15d6b4ed19f8d35a8c769718d, user_id=cb3789b5896349f89ec70d97b70d3e7e, role_id=4abcf5e5e7cd4b53ae1828fec6550d53)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:49.147034 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24f2feb-2e37-4ac1-a222-529b85e8ecfc admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:49.179853 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 788/1612] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:36:48 2022] PUT /identity/v3/projects/eec2b8c15d6b4ed19f8d35a8c769718d/users/cb3789b5896349f89ec70d97b70d3e7e/roles/4abcf5e5e7cd4b53ae1828fec6550d53 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:36:49.180965 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24f2feb-2e37-4ac1-a222-529b85e8ecfc admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:49.239905 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 825/1613] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:36:48 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:36:49.241277 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64656b9d-be2f-4e87-8552-66c76fa20667 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:49.264134 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64656b9d-be2f-4e87-8552-66c76fa20667 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:49.296375 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:49.307640 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:49.315437 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24f2feb-2e37-4ac1-a222-529b85e8ecfc admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:49.327513 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586fd1e3-87a0-47c1-8e32-f0826370a55e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b650be8114b64df0ac88441f1c50b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:49.328318 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586fd1e3-87a0-47c1-8e32-f0826370a55e service neutron] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:49.328603 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586fd1e3-87a0-47c1-8e32-f0826370a55e service neutron] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:49.329232 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586fd1e3-87a0-47c1-8e32-f0826370a55e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:49.416201 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98941468-545f-4910-81a9-70371c265810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:49.418704 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98941468-545f-4910-81a9-70371c265810 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:49.419327 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98941468-545f-4910-81a9-70371c265810 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:49.419802 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98941468-545f-4910-81a9-70371c265810 admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:49.420801 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98941468-545f-4910-81a9-70371c265810 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:49.426921 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98941468-545f-4910-81a9-70371c265810 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:49.489059 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 826/1614] 10.222.0.118 () {60 vars in 1157 bytes} [Thu Jul 14 15:36:49 2022] POST /identity/v3/projects => generated 364 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:36:49.491903 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586fd1e3-87a0-47c1-8e32-f0826370a55e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:49.493096 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c7f9b-0dc5-4ea1-8521-2865930757be None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:49.493792 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c7f9b-0dc5-4ea1-8521-2865930757be None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:49.494815 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c7f9b-0dc5-4ea1-8521-2865930757be None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:49.499012 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586fd1e3-87a0-47c1-8e32-f0826370a55e service neutron] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:49.501998 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 827/1615] 10.222.0.118 () {54 vars in 966 bytes} [Thu Jul 14 15:36:49 2022] GET /identity => generated 271 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:36:49.510774 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78512d5d-4e94-42cf-9cf2-534c5ee17ba1 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:49.511346 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78512d5d-4e94-42cf-9cf2-534c5ee17ba1 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:49.512535 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78512d5d-4e94-42cf-9cf2-534c5ee17ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:49.531258 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 789/1616] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:36:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:36:49.532391 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586fd1e3-87a0-47c1-8e32-f0826370a55e service neutron] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:49.554104 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586fd1e3-87a0-47c1-8e32-f0826370a55e service neutron] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:49.554393 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-78512d5d-4e94-42cf-9cf2-534c5ee17ba1 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:36:49.555740 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-78512d5d-4e94-42cf-9cf2-534c5ee17ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:36:49.715769 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8582d25-c3e9-46e6-98c2-da09abaed357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:49.726025 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8582d25-c3e9-46e6-98c2-da09abaed357 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:49.726359 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8582d25-c3e9-46e6-98c2-da09abaed357 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:49.727207 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8582d25-c3e9-46e6-98c2-da09abaed357 admin admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:49.727470 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8582d25-c3e9-46e6-98c2-da09abaed357 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:49.729612 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 828/1617] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:36:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:36:49.729889 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8582d25-c3e9-46e6-98c2-da09abaed357 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:49.731568 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78512d5d-4e94-42cf-9cf2-534c5ee17ba1 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:49.768322 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 790/1618] 10.222.0.118 () {60 vars in 1157 bytes} [Thu Jul 14 15:36:49 2022] POST /identity/v3/projects => generated 394 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:36:49.770908 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337118f1-c676-4b4f-80c3-abb94d9f156b None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:49.771381 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337118f1-c676-4b4f-80c3-abb94d9f156b None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:49.771851 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337118f1-c676-4b4f-80c3-abb94d9f156b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:49.775661 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78512d5d-4e94-42cf-9cf2-534c5ee17ba1 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:49.839989 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-337118f1-c676-4b4f-80c3-abb94d9f156b None None] MFA Rules not processed for user `f0177fc696ea40069902803da09f437c`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:36:49.841495 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-337118f1-c676-4b4f-80c3-abb94d9f156b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:36:49.951129 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 791/1619] 10.222.0.118 () {58 vars in 1063 bytes} [Thu Jul 14 15:36:49 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:36:49.951509 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90a978b-2009-4359-afb7-d745e5cb4f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:49.952301 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90a978b-2009-4359-afb7-d745e5cb4f4d admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:49.952679 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90a978b-2009-4359-afb7-d745e5cb4f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:49.953006 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337118f1-c676-4b4f-80c3-abb94d9f156b None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:49.953159 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90a978b-2009-4359-afb7-d745e5cb4f4d admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:49.954045 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90a978b-2009-4359-afb7-d745e5cb4f4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:49.959198 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90a978b-2009-4359-afb7-d745e5cb4f4d admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:49.960875 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:49.972205 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337118f1-c676-4b4f-80c3-abb94d9f156b None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:49.991469 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9605fb4-1356-4f46-ba4d-2b5aacf35fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:49.992591 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9605fb4-1356-4f46-ba4d-2b5aacf35fc1 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:49.993317 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9605fb4-1356-4f46-ba4d-2b5aacf35fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:49.993834 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9605fb4-1356-4f46-ba4d-2b5aacf35fc1 admin admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:49.994836 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9605fb4-1356-4f46-ba4d-2b5aacf35fc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:49.998684 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9605fb4-1356-4f46-ba4d-2b5aacf35fc1 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:50.005628 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 829/1620] 10.222.0.118 () {60 vars in 1148 bytes} [Thu Jul 14 15:36:49 2022] POST /identity/v3/users => generated 289 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:36:50.005628 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90a978b-2009-4359-afb7-d745e5cb4f4d admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:50.060069 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 792/1621] 10.222.0.118 () {60 vars in 1148 bytes} [Thu Jul 14 15:36:49 2022] POST /identity/v3/users => generated 304 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:36:50.066828 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9605fb4-1356-4f46-ba4d-2b5aacf35fc1 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:50.121808 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9605fb4-1356-4f46-ba4d-2b5aacf35fc1 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:50.131036 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:50.146626 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe3ac04-5c02-4e43-b5be-9414ba3adcec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0177fc696ea40069902803da09f437c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:50.149677 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe3ac04-5c02-4e43-b5be-9414ba3adcec service nova] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:50.150006 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe3ac04-5c02-4e43-b5be-9414ba3adcec service nova] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:50.150275 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe3ac04-5c02-4e43-b5be-9414ba3adcec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:50.187530 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90a978b-2009-4359-afb7-d745e5cb4f4d admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:50.199522 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da2cc8f-928d-46f9-b811-583c3ccedad5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b650be8114b64df0ac88441f1c50b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:50.200237 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da2cc8f-928d-46f9-b811-583c3ccedad5 service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:50.200528 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da2cc8f-928d-46f9-b811-583c3ccedad5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:50.200831 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da2cc8f-928d-46f9-b811-583c3ccedad5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:50.254503 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da2cc8f-928d-46f9-b811-583c3ccedad5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:50.256378 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da2cc8f-928d-46f9-b811-583c3ccedad5 service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:50.287222 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 830/1622] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:36:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:36:50.291392 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da2cc8f-928d-46f9-b811-583c3ccedad5 service neutron] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:50.321728 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da2cc8f-928d-46f9-b811-583c3ccedad5 service neutron] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:50.342682 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0afb73-efce-4d9b-b662-f4b1b9b20993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:50.343565 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0afb73-efce-4d9b-b662-f4b1b9b20993 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:50.344141 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0afb73-efce-4d9b-b662-f4b1b9b20993 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:50.344680 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0afb73-efce-4d9b-b662-f4b1b9b20993 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:50.345945 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0afb73-efce-4d9b-b662-f4b1b9b20993 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:50.350980 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0afb73-efce-4d9b-b662-f4b1b9b20993 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:50.357442 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe3ac04-5c02-4e43-b5be-9414ba3adcec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:50.359294 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe3ac04-5c02-4e43-b5be-9414ba3adcec service nova] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:50.383237 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 793/1623] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:36:50 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:36:50.385835 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe3ac04-5c02-4e43-b5be-9414ba3adcec service nova] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:50.392085 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 831/1624] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:36:50 2022] GET /identity/v3/roles => generated 1427 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:36:50.393365 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0afb73-efce-4d9b-b662-f4b1b9b20993 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:50.412405 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe3ac04-5c02-4e43-b5be-9414ba3adcec service nova] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:50.418666 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0afb73-efce-4d9b-b662-f4b1b9b20993 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:50.432321 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47431e60-1595-45b0-bd4f-ae6c2350209c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:50.433164 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47431e60-1595-45b0-bd4f-ae6c2350209c admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:50.433546 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47431e60-1595-45b0-bd4f-ae6c2350209c admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:50.433924 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47431e60-1595-45b0-bd4f-ae6c2350209c admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:50.434799 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47431e60-1595-45b0-bd4f-ae6c2350209c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:50.436844 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47431e60-1595-45b0-bd4f-ae6c2350209c admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:50.442544 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbbe0a3-8fc7-472f-a32c-e3f02d03fda5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:50.443395 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbbe0a3-8fc7-472f-a32c-e3f02d03fda5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:50.443681 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbbe0a3-8fc7-472f-a32c-e3f02d03fda5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:50.443961 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbbe0a3-8fc7-472f-a32c-e3f02d03fda5 admin admin] PATH_INFO: `/v3/projects/d21e9e58d3c64adfbf1fc6ff65b6ddc5/users/87b76eef2ccb4c33ae06045aee4ac8bb/roles/3b880cef7dcf4baf87b50f8610c0c56e` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:50.457636 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 794/1625] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:36:50 2022] GET /identity/v3/roles => generated 1427 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:36:50.461773 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47431e60-1595-45b0-bd4f-ae6c2350209c admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:50.494881 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47431e60-1595-45b0-bd4f-ae6c2350209c admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:50.501484 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbbe0a3-8fc7-472f-a32c-e3f02d03fda5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d21e9e58d3c64adfbf1fc6ff65b6ddc5, user_id=87b76eef2ccb4c33ae06045aee4ac8bb, role_id=3b880cef7dcf4baf87b50f8610c0c56e)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:50.510963 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbbe0a3-8fc7-472f-a32c-e3f02d03fda5 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:50.511764 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd08e9b3-16d7-48ef-b638-5caed80ae105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:50.515504 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd08e9b3-16d7-48ef-b638-5caed80ae105 admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:50.515759 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd08e9b3-16d7-48ef-b638-5caed80ae105 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:50.516142 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd08e9b3-16d7-48ef-b638-5caed80ae105 admin admin] PATH_INFO: `/v3/projects/764b9b6e5b5f4b2cbc47c6f0b4f18ad6/users/a66a18f5e682456a80420eeb195b9ad7/roles/3b880cef7dcf4baf87b50f8610c0c56e` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:50.545365 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 832/1626] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:36:50 2022] PUT /identity/v3/projects/d21e9e58d3c64adfbf1fc6ff65b6ddc5/users/87b76eef2ccb4c33ae06045aee4ac8bb/roles/3b880cef7dcf4baf87b50f8610c0c56e => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:36:50.549184 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbbe0a3-8fc7-472f-a32c-e3f02d03fda5 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:50.562663 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd08e9b3-16d7-48ef-b638-5caed80ae105 admin admin] RBAC: Authorizing `identity:create_grant(project_id=764b9b6e5b5f4b2cbc47c6f0b4f18ad6, user_id=a66a18f5e682456a80420eeb195b9ad7, role_id=3b880cef7dcf4baf87b50f8610c0c56e)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:50.566431 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd08e9b3-16d7-48ef-b638-5caed80ae105 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:50.592547 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 795/1627] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:36:50 2022] PUT /identity/v3/projects/764b9b6e5b5f4b2cbc47c6f0b4f18ad6/users/a66a18f5e682456a80420eeb195b9ad7/roles/3b880cef7dcf4baf87b50f8610c0c56e => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:36:50.597797 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd08e9b3-16d7-48ef-b638-5caed80ae105 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:50.672186 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbbe0a3-8fc7-472f-a32c-e3f02d03fda5 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:50.738702 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd08e9b3-16d7-48ef-b638-5caed80ae105 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:50.749403 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ef80d2-7a8b-4214-b63e-bfca38086c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:50.753051 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ef80d2-7a8b-4214-b63e-bfca38086c78 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:50.753514 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ef80d2-7a8b-4214-b63e-bfca38086c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:50.754237 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ef80d2-7a8b-4214-b63e-bfca38086c78 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:50.756529 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ef80d2-7a8b-4214-b63e-bfca38086c78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:50.762011 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ef80d2-7a8b-4214-b63e-bfca38086c78 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:50.790271 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 796/1628] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:36:50 2022] GET /identity/v3/roles => generated 1427 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:36:50.792508 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ef80d2-7a8b-4214-b63e-bfca38086c78 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:50.815932 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ef80d2-7a8b-4214-b63e-bfca38086c78 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:50.826482 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda58380-cf08-4b4a-9b06-a80f64cdeb15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:50.828184 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda58380-cf08-4b4a-9b06-a80f64cdeb15 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:50.828458 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b02856-f58f-4fef-a7d4-3d00ef32a0e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:50.829632 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda58380-cf08-4b4a-9b06-a80f64cdeb15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:50.830028 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda58380-cf08-4b4a-9b06-a80f64cdeb15 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:50.830328 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b02856-f58f-4fef-a7d4-3d00ef32a0e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:50.831188 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda58380-cf08-4b4a-9b06-a80f64cdeb15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:50.831715 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b02856-f58f-4fef-a7d4-3d00ef32a0e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:50.832243 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b02856-f58f-4fef-a7d4-3d00ef32a0e1 admin admin] PATH_INFO: `/v3/projects/764b9b6e5b5f4b2cbc47c6f0b4f18ad6/users/a66a18f5e682456a80420eeb195b9ad7/roles/3b880cef7dcf4baf87b50f8610c0c56e` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:50.834658 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda58380-cf08-4b4a-9b06-a80f64cdeb15 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:50.839079 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b02856-f58f-4fef-a7d4-3d00ef32a0e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=764b9b6e5b5f4b2cbc47c6f0b4f18ad6, user_id=a66a18f5e682456a80420eeb195b9ad7, role_id=3b880cef7dcf4baf87b50f8610c0c56e)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:50.843288 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b02856-f58f-4fef-a7d4-3d00ef32a0e1 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:50.864897 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 833/1629] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:36:50 2022] GET /identity/v3/roles => generated 1427 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:36:50.865994 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda58380-cf08-4b4a-9b06-a80f64cdeb15 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:50.877841 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 797/1630] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:36:50 2022] PUT /identity/v3/projects/764b9b6e5b5f4b2cbc47c6f0b4f18ad6/users/a66a18f5e682456a80420eeb195b9ad7/roles/3b880cef7dcf4baf87b50f8610c0c56e => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:36:50.889195 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a89f146-2d52-4336-92be-3dc61d7850af None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:50.890167 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a89f146-2d52-4336-92be-3dc61d7850af None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:50.890668 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a89f146-2d52-4336-92be-3dc61d7850af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:50.897027 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda58380-cf08-4b4a-9b06-a80f64cdeb15 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:50.963581 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-3a89f146-2d52-4336-92be-3dc61d7850af None None] MFA Rules not processed for user `a66a18f5e682456a80420eeb195b9ad7`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:36:50.967025 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-3a89f146-2d52-4336-92be-3dc61d7850af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:36:50.997335 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:51.026490 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:51.029993 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e6ee7e-87d5-4056-a74d-7a9faa96bf57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:51.031450 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e6ee7e-87d5-4056-a74d-7a9faa96bf57 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:51.034121 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e6ee7e-87d5-4056-a74d-7a9faa96bf57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:51.034696 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e6ee7e-87d5-4056-a74d-7a9faa96bf57 admin admin] PATH_INFO: `/v3/projects/d21e9e58d3c64adfbf1fc6ff65b6ddc5/users/87b76eef2ccb4c33ae06045aee4ac8bb/roles/3b880cef7dcf4baf87b50f8610c0c56e` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:51.047916 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e6ee7e-87d5-4056-a74d-7a9faa96bf57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d21e9e58d3c64adfbf1fc6ff65b6ddc5, user_id=87b76eef2ccb4c33ae06045aee4ac8bb, role_id=3b880cef7dcf4baf87b50f8610c0c56e)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:51.053997 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e6ee7e-87d5-4056-a74d-7a9faa96bf57 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:51.074760 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 834/1631] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:36:50 2022] PUT /identity/v3/projects/d21e9e58d3c64adfbf1fc6ff65b6ddc5/users/87b76eef2ccb4c33ae06045aee4ac8bb/roles/3b880cef7dcf4baf87b50f8610c0c56e => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:36:51.076875 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926da01d-e086-43d8-9756-9f333917b0e2 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:51.077402 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926da01d-e086-43d8-9756-9f333917b0e2 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:51.078515 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926da01d-e086-43d8-9756-9f333917b0e2 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:51.080931 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 835/1632] 10.222.0.118 () {54 vars in 917 bytes} [Thu Jul 14 15:36:51 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:36:51.087568 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1747854a-a187-4aaf-84f4-16cbc30e07dd None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:51.088120 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1747854a-a187-4aaf-84f4-16cbc30e07dd None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:51.088789 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1747854a-a187-4aaf-84f4-16cbc30e07dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:51.120860 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-1747854a-a187-4aaf-84f4-16cbc30e07dd None None] MFA Rules not processed for user `f0177fc696ea40069902803da09f437c`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:36:51.123496 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-1747854a-a187-4aaf-84f4-16cbc30e07dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:36:51.185247 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 798/1633] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:36:50 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:36:51.186748 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45c8f75-4d4e-457e-b02d-79c81b3d88fc None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:51.189372 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45c8f75-4d4e-457e-b02d-79c81b3d88fc None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:51.189653 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45c8f75-4d4e-457e-b02d-79c81b3d88fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:51.257232 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 836/1634] 10.222.0.118 () {58 vars in 1014 bytes} [Thu Jul 14 15:36:51 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:36:51.258405 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1747854a-a187-4aaf-84f4-16cbc30e07dd None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:51.271632 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-b45c8f75-4d4e-457e-b02d-79c81b3d88fc None None] MFA Rules not processed for user `87b76eef2ccb4c33ae06045aee4ac8bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:36:51.278054 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-b45c8f75-4d4e-457e-b02d-79c81b3d88fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:36:51.362475 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1747854a-a187-4aaf-84f4-16cbc30e07dd None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:51.373520 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2953e8ba-280c-4ee5-adb2-c855c41e2a1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea647438ea1c438987f28cbe39c3ff2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:51.374763 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2953e8ba-280c-4ee5-adb2-c855c41e2a1e service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:51.378442 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2953e8ba-280c-4ee5-adb2-c855c41e2a1e service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:51.379810 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2953e8ba-280c-4ee5-adb2-c855c41e2a1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:51.453298 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 799/1635] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:36:51 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:36:51.454693 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45c8f75-4d4e-457e-b02d-79c81b3d88fc None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:51.469723 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45c8f75-4d4e-457e-b02d-79c81b3d88fc None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:51.476636 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e434da2-973f-4a82-af86-a13b6a85c224 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea647438ea1c438987f28cbe39c3ff2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:51.477314 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e434da2-973f-4a82-af86-a13b6a85c224 service cinder] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:51.480736 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e434da2-973f-4a82-af86-a13b6a85c224 service cinder] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:51.480736 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e434da2-973f-4a82-af86-a13b6a85c224 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:51.498571 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2953e8ba-280c-4ee5-adb2-c855c41e2a1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:51.501110 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2953e8ba-280c-4ee5-adb2-c855c41e2a1e service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:51.502957 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e434da2-973f-4a82-af86-a13b6a85c224 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:51.505119 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e434da2-973f-4a82-af86-a13b6a85c224 service cinder] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:51.519051 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 800/1636] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:36:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:36:51.538958 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 837/1637] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:36:51 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:36:51.651092 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e434da2-973f-4a82-af86-a13b6a85c224 service cinder] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:51.666017 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e434da2-973f-4a82-af86-a13b6a85c224 service cinder] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:51.679542 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3274d9e-883e-4f9a-9d53-eef3303c54af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea647438ea1c438987f28cbe39c3ff2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:51.683747 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3274d9e-883e-4f9a-9d53-eef3303c54af service cinder] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:51.684223 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3274d9e-883e-4f9a-9d53-eef3303c54af service cinder] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:51.686035 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3274d9e-883e-4f9a-9d53-eef3303c54af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:51.726455 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3274d9e-883e-4f9a-9d53-eef3303c54af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:51.728319 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3274d9e-883e-4f9a-9d53-eef3303c54af service cinder] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:51.744804 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 801/1638] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:36:51 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:36:51.873334 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2953e8ba-280c-4ee5-adb2-c855c41e2a1e service cinder] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:51.885591 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2953e8ba-280c-4ee5-adb2-c855c41e2a1e service cinder] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:51.895525 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b984cb-2fa0-4c95-b3c7-1523ff66ed81 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea647438ea1c438987f28cbe39c3ff2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:51.896818 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b984cb-2fa0-4c95-b3c7-1523ff66ed81 service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:51.899391 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b984cb-2fa0-4c95-b3c7-1523ff66ed81 service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:51.899951 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b984cb-2fa0-4c95-b3c7-1523ff66ed81 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:51.949758 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:52.045912 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b984cb-2fa0-4c95-b3c7-1523ff66ed81 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:52.047441 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b984cb-2fa0-4c95-b3c7-1523ff66ed81 service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:52.074227 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 838/1639] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:36:51 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:36:53.337879 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c006ae-60ce-4fff-945e-f856dfb8798c None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:53.338539 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c006ae-60ce-4fff-945e-f856dfb8798c None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:53.338539 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c006ae-60ce-4fff-945e-f856dfb8798c None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:53.341142 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 802/1640] 10.222.0.118 () {54 vars in 966 bytes} [Thu Jul 14 15:36:53 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:36:53.355935 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b3846a-36a4-472e-8adf-a7bb41cb9ce3 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:53.355935 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b3846a-36a4-472e-8adf-a7bb41cb9ce3 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:53.357021 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b3846a-36a4-472e-8adf-a7bb41cb9ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:53.403351 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-19b3846a-36a4-472e-8adf-a7bb41cb9ce3 None None] MFA Rules not processed for user `f0177fc696ea40069902803da09f437c`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:36:53.405006 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-19b3846a-36a4-472e-8adf-a7bb41cb9ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:36:53.436734 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 839/1641] 10.222.0.118 () {58 vars in 1063 bytes} [Thu Jul 14 15:36:53 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:36:53.442451 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceda225-1ee9-4f68-b2b9-47b7b0c2c553 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:53.443108 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceda225-1ee9-4f68-b2b9-47b7b0c2c553 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:53.443226 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceda225-1ee9-4f68-b2b9-47b7b0c2c553 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:53.445340 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 803/1642] 10.222.0.118 () {54 vars in 917 bytes} [Thu Jul 14 15:36:53 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:36:53.451527 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecc99f7-096a-4b88-9082-0ca6c683a785 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:53.452207 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecc99f7-096a-4b88-9082-0ca6c683a785 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:53.452925 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecc99f7-096a-4b88-9082-0ca6c683a785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:53.513467 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-cecc99f7-096a-4b88-9082-0ca6c683a785 None None] MFA Rules not processed for user `f0177fc696ea40069902803da09f437c`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:36:53.518249 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-cecc99f7-096a-4b88-9082-0ca6c683a785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:36:53.549281 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 840/1643] 10.222.0.118 () {58 vars in 1014 bytes} [Thu Jul 14 15:36:53 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:36:53.573789 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceda225-1ee9-4f68-b2b9-47b7b0c2c553 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:53.601825 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceda225-1ee9-4f68-b2b9-47b7b0c2c553 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:53.609131 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9311459f-5455-4af2-b257-a170dd639553 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea647438ea1c438987f28cbe39c3ff2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:53.611628 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9311459f-5455-4af2-b257-a170dd639553 service cinder] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:53.612296 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9311459f-5455-4af2-b257-a170dd639553 service cinder] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:53.613188 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9311459f-5455-4af2-b257-a170dd639553 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:53.623983 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecc99f7-096a-4b88-9082-0ca6c683a785 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:53.644498 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9311459f-5455-4af2-b257-a170dd639553 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:53.648353 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9311459f-5455-4af2-b257-a170dd639553 service cinder] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:53.693412 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 804/1644] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:36:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:36:53.776479 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecc99f7-096a-4b88-9082-0ca6c683a785 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:53.782531 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6e8036-7183-4118-a3d3-511c97009efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:53.786691 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6e8036-7183-4118-a3d3-511c97009efa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:53.787243 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6e8036-7183-4118-a3d3-511c97009efa admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:53.787785 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6e8036-7183-4118-a3d3-511c97009efa admin admin] PATH_INFO: `/v3/users/855ded1ec35e407e861753d4c7ddf029` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:53.789570 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6e8036-7183-4118-a3d3-511c97009efa admin admin] RBAC: Authorizing `identity:delete_user(user_id=855ded1ec35e407e861753d4c7ddf029)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:53.791931 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6e8036-7183-4118-a3d3-511c97009efa admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:53.908009 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-2c6e8036-7183-4118-a3d3-511c97009efa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '855ded1ec35e407e861753d4c7ddf029'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:36:53.924545 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-2c6e8036-7183-4118-a3d3-511c97009efa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '855ded1ec35e407e861753d4c7ddf029'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:36:53.927332 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-2c6e8036-7183-4118-a3d3-511c97009efa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '855ded1ec35e407e861753d4c7ddf029'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:36:53.928067 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-2c6e8036-7183-4118-a3d3-511c97009efa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '855ded1ec35e407e861753d4c7ddf029'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:36:53.956726 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-2c6e8036-7183-4118-a3d3-511c97009efa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '855ded1ec35e407e861753d4c7ddf029'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:36:53.983285 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 841/1645] 10.222.0.118 () {58 vars in 1228 bytes} [Thu Jul 14 15:36:53 2022] DELETE /identity/v3/users/855ded1ec35e407e861753d4c7ddf029 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:36:53.988234 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80078a53-4d94-4727-9d64-dff58495ac44 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:53.989321 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80078a53-4d94-4727-9d64-dff58495ac44 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:53.989667 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80078a53-4d94-4727-9d64-dff58495ac44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:54.032622 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-80078a53-4d94-4727-9d64-dff58495ac44 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:36:54.037124 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-80078a53-4d94-4727-9d64-dff58495ac44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:36:54.151396 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 805/1646] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:36:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:36:54.171171 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6e8036-7183-4118-a3d3-511c97009efa admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:54.178621 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-2c6e8036-7183-4118-a3d3-511c97009efa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:36:54.249658 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:54.327732 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6e8036-7183-4118-a3d3-511c97009efa admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:54.331527 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd621151-48df-44b4-84af-38ac86162ebb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b650be8114b64df0ac88441f1c50b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:54.332715 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd621151-48df-44b4-84af-38ac86162ebb service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:54.332992 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd621151-48df-44b4-84af-38ac86162ebb service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:54.333259 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd621151-48df-44b4-84af-38ac86162ebb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:54.354616 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd621151-48df-44b4-84af-38ac86162ebb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:54.356486 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd621151-48df-44b4-84af-38ac86162ebb service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:54.377061 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 842/1647] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:36:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:36:55.235509 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80078a53-4d94-4727-9d64-dff58495ac44 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:55.240820 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-80078a53-4d94-4727-9d64-dff58495ac44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:36:55.249693 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:55.261119 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80078a53-4d94-4727-9d64-dff58495ac44 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:55.269215 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c0566d-02be-4b23-a93c-d691b8e7c0b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:55.270403 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c0566d-02be-4b23-a93c-d691b8e7c0b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:55.271426 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c0566d-02be-4b23-a93c-d691b8e7c0b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:55.272047 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c0566d-02be-4b23-a93c-d691b8e7c0b8 admin admin] PATH_INFO: `/v3/users/2ada5328227a41d8b10a09f6b5a5e4f9` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:55.274101 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c0566d-02be-4b23-a93c-d691b8e7c0b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ada5328227a41d8b10a09f6b5a5e4f9)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:55.278062 dv-cinder-826510-8-smb devstack@keystone.service[80345]: WARNING py.warnings [None req-c6c0566d-02be-4b23-a93c-d691b8e7c0b8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:36:55.278062 dv-cinder-826510-8-smb devstack@keystone.service[80345]: warnings.warn(msg) Jul 14 15:36:55.278062 dv-cinder-826510-8-smb devstack@keystone.service[80345]: Jul 14 15:36:55.280447 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c0566d-02be-4b23-a93c-d691b8e7c0b8 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:55.446747 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-c6c0566d-02be-4b23-a93c-d691b8e7c0b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ada5328227a41d8b10a09f6b5a5e4f9'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:36:55.470203 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-c6c0566d-02be-4b23-a93c-d691b8e7c0b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ada5328227a41d8b10a09f6b5a5e4f9'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:36:55.472152 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-c6c0566d-02be-4b23-a93c-d691b8e7c0b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ada5328227a41d8b10a09f6b5a5e4f9'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:36:55.474196 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-c6c0566d-02be-4b23-a93c-d691b8e7c0b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ada5328227a41d8b10a09f6b5a5e4f9'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:36:55.521301 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-c6c0566d-02be-4b23-a93c-d691b8e7c0b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ada5328227a41d8b10a09f6b5a5e4f9'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:36:55.557772 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 806/1648] 10.222.0.118 () {58 vars in 1228 bytes} [Thu Jul 14 15:36:55 2022] DELETE /identity/v3/users/2ada5328227a41d8b10a09f6b5a5e4f9 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:36:55.563474 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e517f981-153c-4e4d-84ca-42f1f3ee65cd None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:55.564338 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e517f981-153c-4e4d-84ca-42f1f3ee65cd None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:55.564757 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e517f981-153c-4e4d-84ca-42f1f3ee65cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:55.604073 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-e517f981-153c-4e4d-84ca-42f1f3ee65cd None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:36:55.608076 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-e517f981-153c-4e4d-84ca-42f1f3ee65cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:36:55.725371 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 843/1649] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:36:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:36:55.761881 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c0566d-02be-4b23-a93c-d691b8e7c0b8 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:55.763617 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-c6c0566d-02be-4b23-a93c-d691b8e7c0b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:36:55.901720 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c0566d-02be-4b23-a93c-d691b8e7c0b8 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:55.918408 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b2ab69-ac36-4b04-af3a-89e45589ebac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b650be8114b64df0ac88441f1c50b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:55.919777 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b2ab69-ac36-4b04-af3a-89e45589ebac service neutron] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:55.921070 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b2ab69-ac36-4b04-af3a-89e45589ebac service neutron] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:55.921621 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b2ab69-ac36-4b04-af3a-89e45589ebac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:55.940017 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b2ab69-ac36-4b04-af3a-89e45589ebac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:55.945056 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b2ab69-ac36-4b04-af3a-89e45589ebac service neutron] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:55.966718 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 807/1650] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:36:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:36:56.651798 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e517f981-153c-4e4d-84ca-42f1f3ee65cd None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:56.653412 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-e517f981-153c-4e4d-84ca-42f1f3ee65cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:36:56.673463 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e517f981-153c-4e4d-84ca-42f1f3ee65cd None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:56.687588 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a978ea-3626-4ae0-867a-e9dc8e6085ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:56.691324 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a978ea-3626-4ae0-867a-e9dc8e6085ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:56.692420 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a978ea-3626-4ae0-867a-e9dc8e6085ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:56.692876 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a978ea-3626-4ae0-867a-e9dc8e6085ec admin admin] PATH_INFO: `/v3/projects/12f47bd5d0e84f078ed94f71e8db8eab` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:56.694661 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a978ea-3626-4ae0-867a-e9dc8e6085ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=12f47bd5d0e84f078ed94f71e8db8eab)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:56.695910 dv-cinder-826510-8-smb devstack@keystone.service[80344]: WARNING py.warnings [None req-c1a978ea-3626-4ae0-867a-e9dc8e6085ec admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:36:56.695910 dv-cinder-826510-8-smb devstack@keystone.service[80344]: warnings.warn(msg) Jul 14 15:36:56.695910 dv-cinder-826510-8-smb devstack@keystone.service[80344]: Jul 14 15:36:56.704568 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a978ea-3626-4ae0-867a-e9dc8e6085ec admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:56.883543 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-c1a978ea-3626-4ae0-867a-e9dc8e6085ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12f47bd5d0e84f078ed94f71e8db8eab', 'request_id': 'req-c1a978ea-3626-4ae0-867a-e9dc8e6085ec'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:36:56.892844 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-c1a978ea-3626-4ae0-867a-e9dc8e6085ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12f47bd5d0e84f078ed94f71e8db8eab', 'request_id': 'req-c1a978ea-3626-4ae0-867a-e9dc8e6085ec'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:36:56.913812 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-c1a978ea-3626-4ae0-867a-e9dc8e6085ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12f47bd5d0e84f078ed94f71e8db8eab', 'request_id': 'req-c1a978ea-3626-4ae0-867a-e9dc8e6085ec'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:36:56.942514 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-c1a978ea-3626-4ae0-867a-e9dc8e6085ec admin admin] The token cache is being invalidate because project 12f47bd5d0e84f078ed94f71e8db8eab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:36:56.943114 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-c1a978ea-3626-4ae0-867a-e9dc8e6085ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:36:56.944161 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-c1a978ea-3626-4ae0-867a-e9dc8e6085ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:36:56.946929 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 844/1651] 10.222.0.118 () {58 vars in 1237 bytes} [Thu Jul 14 15:36:56 2022] DELETE /identity/v3/projects/12f47bd5d0e84f078ed94f71e8db8eab => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:36:56.955048 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b2ab69-ac36-4b04-af3a-89e45589ebac service neutron] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:56.975926 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b2ab69-ac36-4b04-af3a-89e45589ebac service neutron] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:57.092246 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4743feea-17f4-4b84-8b71-435f38473efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:57.093636 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4743feea-17f4-4b84-8b71-435f38473efd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:57.094035 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4743feea-17f4-4b84-8b71-435f38473efd admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:57.094336 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4743feea-17f4-4b84-8b71-435f38473efd admin admin] PATH_INFO: `/v3/users/87b76eef2ccb4c33ae06045aee4ac8bb` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:57.095698 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4743feea-17f4-4b84-8b71-435f38473efd admin admin] RBAC: Authorizing `identity:delete_user(user_id=87b76eef2ccb4c33ae06045aee4ac8bb)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:57.099591 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4743feea-17f4-4b84-8b71-435f38473efd admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:57.131151 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:57.216440 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-4743feea-17f4-4b84-8b71-435f38473efd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87b76eef2ccb4c33ae06045aee4ac8bb'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:36:57.242055 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-4743feea-17f4-4b84-8b71-435f38473efd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87b76eef2ccb4c33ae06045aee4ac8bb'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:36:57.244711 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-4743feea-17f4-4b84-8b71-435f38473efd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87b76eef2ccb4c33ae06045aee4ac8bb'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:36:57.249199 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-4743feea-17f4-4b84-8b71-435f38473efd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87b76eef2ccb4c33ae06045aee4ac8bb'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:36:57.302018 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-4743feea-17f4-4b84-8b71-435f38473efd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87b76eef2ccb4c33ae06045aee4ac8bb'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:36:57.330858 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 808/1652] 10.222.0.118 () {58 vars in 1228 bytes} [Thu Jul 14 15:36:56 2022] DELETE /identity/v3/users/87b76eef2ccb4c33ae06045aee4ac8bb => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:36:57.548693 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a978ea-3626-4ae0-867a-e9dc8e6085ec admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:57.550445 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-c1a978ea-3626-4ae0-867a-e9dc8e6085ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:36:57.579447 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a978ea-3626-4ae0-867a-e9dc8e6085ec admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:57.697383 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:57.719730 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8aa008-dad2-4b5b-9925-6cc35f26ee74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:57.720990 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8aa008-dad2-4b5b-9925-6cc35f26ee74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:57.721483 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8aa008-dad2-4b5b-9925-6cc35f26ee74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:57.728796 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8aa008-dad2-4b5b-9925-6cc35f26ee74 admin admin] PATH_INFO: `/v3/users/700ed1b19924496891a54e1758444a4b` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:57.733468 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8aa008-dad2-4b5b-9925-6cc35f26ee74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=700ed1b19924496891a54e1758444a4b)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:57.735857 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8aa008-dad2-4b5b-9925-6cc35f26ee74 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:57.881478 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-fd8aa008-dad2-4b5b-9925-6cc35f26ee74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '700ed1b19924496891a54e1758444a4b'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:36:57.898204 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-fd8aa008-dad2-4b5b-9925-6cc35f26ee74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '700ed1b19924496891a54e1758444a4b'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:36:57.899244 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-fd8aa008-dad2-4b5b-9925-6cc35f26ee74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '700ed1b19924496891a54e1758444a4b'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:36:57.900108 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-fd8aa008-dad2-4b5b-9925-6cc35f26ee74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '700ed1b19924496891a54e1758444a4b'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:36:57.920125 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-fd8aa008-dad2-4b5b-9925-6cc35f26ee74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '700ed1b19924496891a54e1758444a4b'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:36:57.939887 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 845/1653] 10.222.0.118 () {58 vars in 1228 bytes} [Thu Jul 14 15:36:57 2022] DELETE /identity/v3/users/700ed1b19924496891a54e1758444a4b => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:36:57.944693 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb2f617-086a-4a3c-9927-111f81a8adb2 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:57.945174 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb2f617-086a-4a3c-9927-111f81a8adb2 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:57.945596 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb2f617-086a-4a3c-9927-111f81a8adb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:57.987410 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-9bb2f617-086a-4a3c-9927-111f81a8adb2 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:36:57.990048 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-9bb2f617-086a-4a3c-9927-111f81a8adb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:36:58.144782 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 809/1654] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:36:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:36:58.160230 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6044a946-5ebb-42f0-9f96-39424f80f911 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:58.160531 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6044a946-5ebb-42f0-9f96-39424f80f911 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:58.161049 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6044a946-5ebb-42f0-9f96-39424f80f911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:58.171759 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb2f617-086a-4a3c-9927-111f81a8adb2 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:58.175469 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-9bb2f617-086a-4a3c-9927-111f81a8adb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:36:58.245309 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-6044a946-5ebb-42f0-9f96-39424f80f911 None None] MFA Rules not processed for user `d1f95427c9ff4d8287c6ecd33a1a0d2c`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:36:58.246793 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-6044a946-5ebb-42f0-9f96-39424f80f911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:36:58.407460 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb2f617-086a-4a3c-9927-111f81a8adb2 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:58.431228 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eabb8e-83d7-438c-a4e0-626ac80faa57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b650be8114b64df0ac88441f1c50b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:58.431915 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eabb8e-83d7-438c-a4e0-626ac80faa57 service neutron] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:58.432197 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eabb8e-83d7-438c-a4e0-626ac80faa57 service neutron] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:58.432473 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eabb8e-83d7-438c-a4e0-626ac80faa57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:58.460452 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eabb8e-83d7-438c-a4e0-626ac80faa57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:58.467923 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eabb8e-83d7-438c-a4e0-626ac80faa57 service neutron] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:58.513569 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 810/1655] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:36:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:36:58.518512 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eabb8e-83d7-438c-a4e0-626ac80faa57 service neutron] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:58.522790 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-d4eabb8e-83d7-438c-a4e0-626ac80faa57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:36:58.551355 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 846/1656] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:36:58 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 387 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:36:58.558839 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6044a946-5ebb-42f0-9f96-39424f80f911 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:58.560906 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-6044a946-5ebb-42f0-9f96-39424f80f911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:36:58.573948 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eabb8e-83d7-438c-a4e0-626ac80faa57 service neutron] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:58.601004 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b9e6c3-99f6-401c-930d-b3e1d5abd84d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:58.601004 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b9e6c3-99f6-401c-930d-b3e1d5abd84d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:58.601004 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b9e6c3-99f6-401c-930d-b3e1d5abd84d admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:58.601004 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b9e6c3-99f6-401c-930d-b3e1d5abd84d admin admin] PATH_INFO: `/v3/projects/55002fa42a4d4ca59ecb709f87b64b87` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:58.602705 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b9e6c3-99f6-401c-930d-b3e1d5abd84d admin admin] RBAC: Authorizing `identity:delete_project(project_id=55002fa42a4d4ca59ecb709f87b64b87)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:58.610346 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b9e6c3-99f6-401c-930d-b3e1d5abd84d admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:58.754508 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:58.775953 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:58.796231 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-66b9e6c3-99f6-401c-930d-b3e1d5abd84d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55002fa42a4d4ca59ecb709f87b64b87', 'request_id': 'req-66b9e6c3-99f6-401c-930d-b3e1d5abd84d'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:36:58.825383 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6044a946-5ebb-42f0-9f96-39424f80f911 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:58.845224 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-66b9e6c3-99f6-401c-930d-b3e1d5abd84d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55002fa42a4d4ca59ecb709f87b64b87', 'request_id': 'req-66b9e6c3-99f6-401c-930d-b3e1d5abd84d'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:36:58.874312 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-66b9e6c3-99f6-401c-930d-b3e1d5abd84d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55002fa42a4d4ca59ecb709f87b64b87', 'request_id': 'req-66b9e6c3-99f6-401c-930d-b3e1d5abd84d'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:36:58.906586 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-66b9e6c3-99f6-401c-930d-b3e1d5abd84d admin admin] The token cache is being invalidate because project 55002fa42a4d4ca59ecb709f87b64b87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:36:58.906881 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-66b9e6c3-99f6-401c-930d-b3e1d5abd84d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:36:58.912973 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-66b9e6c3-99f6-401c-930d-b3e1d5abd84d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:36:58.919737 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 811/1657] 10.222.0.118 () {58 vars in 1237 bytes} [Thu Jul 14 15:36:58 2022] DELETE /identity/v3/projects/55002fa42a4d4ca59ecb709f87b64b87 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:36:58.927692 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2afaaca-df04-4350-bc19-de07c60ff3d0 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:58.927982 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2afaaca-df04-4350-bc19-de07c60ff3d0 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:58.928268 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2afaaca-df04-4350-bc19-de07c60ff3d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:58.980488 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-e2afaaca-df04-4350-bc19-de07c60ff3d0 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:36:58.981693 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-e2afaaca-df04-4350-bc19-de07c60ff3d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:36:59.016890 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eeac61-ad9e-4ba6-b193-c1544b2ad178 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0177fc696ea40069902803da09f437c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:59.018769 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eeac61-ad9e-4ba6-b193-c1544b2ad178 service nova] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:59.019285 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eeac61-ad9e-4ba6-b193-c1544b2ad178 service nova] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:59.019977 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eeac61-ad9e-4ba6-b193-c1544b2ad178 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:59.025504 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-a2eeac61-ad9e-4ba6-b193-c1544b2ad178 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:36:59.163191 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 812/1658] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:36:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:36:59.164772 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889f46b7-4e05-4c7b-a95e-579b92cd1278 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:59.165065 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889f46b7-4e05-4c7b-a95e-579b92cd1278 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:59.165341 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889f46b7-4e05-4c7b-a95e-579b92cd1278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:59.194621 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-889f46b7-4e05-4c7b-a95e-579b92cd1278 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:36:59.198376 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-889f46b7-4e05-4c7b-a95e-579b92cd1278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:36:59.200937 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eeac61-ad9e-4ba6-b193-c1544b2ad178 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:59.203261 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eeac61-ad9e-4ba6-b193-c1544b2ad178 service nova] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:59.219381 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 813/1659] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:36:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:36:59.228086 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889f46b7-4e05-4c7b-a95e-579b92cd1278 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:59.238229 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 847/1660] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:36:58 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 680 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:36:59.252199 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889f46b7-4e05-4c7b-a95e-579b92cd1278 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:59.265501 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69666712-4cfa-4cd0-87a0-c2b852220a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:59.266237 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69666712-4cfa-4cd0-87a0-c2b852220a39 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:59.266528 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69666712-4cfa-4cd0-87a0-c2b852220a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:59.266803 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69666712-4cfa-4cd0-87a0-c2b852220a39 admin admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:59.267560 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69666712-4cfa-4cd0-87a0-c2b852220a39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:59.267873 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69666712-4cfa-4cd0-87a0-c2b852220a39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:59.271535 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69666712-4cfa-4cd0-87a0-c2b852220a39 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:59.308533 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 814/1661] 10.222.0.118 () {58 vars in 1157 bytes} [Thu Jul 14 15:36:59 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:59.309755 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eeac61-ad9e-4ba6-b193-c1544b2ad178 service nova] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:59.332246 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eeac61-ad9e-4ba6-b193-c1544b2ad178 service nova] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:59.358015 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da618170-74dc-4053-80d2-7506521b0ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:59.358727 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da618170-74dc-4053-80d2-7506521b0ad0 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:59.359347 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da618170-74dc-4053-80d2-7506521b0ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:59.359633 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da618170-74dc-4053-80d2-7506521b0ad0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:59.360356 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da618170-74dc-4053-80d2-7506521b0ad0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:59.362388 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da618170-74dc-4053-80d2-7506521b0ad0 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:59.447692 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 848/1662] 10.222.0.118 () {60 vars in 1157 bytes} [Thu Jul 14 15:36:59 2022] POST /identity/v3/projects => generated 382 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:36:59.449091 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69666712-4cfa-4cd0-87a0-c2b852220a39 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:59.468436 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69666712-4cfa-4cd0-87a0-c2b852220a39 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:59.650615 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373106d4-9766-4569-b044-7983ec871a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:59.651531 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373106d4-9766-4569-b044-7983ec871a3c admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:59.651816 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373106d4-9766-4569-b044-7983ec871a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:59.652140 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373106d4-9766-4569-b044-7983ec871a3c admin admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:59.652854 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373106d4-9766-4569-b044-7983ec871a3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:59.655001 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373106d4-9766-4569-b044-7983ec871a3c admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:59.705075 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 815/1663] 10.222.0.118 () {60 vars in 1148 bytes} [Thu Jul 14 15:36:59 2022] POST /identity/v3/users => generated 292 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:36:59.709354 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da618170-74dc-4053-80d2-7506521b0ad0 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:59.731267 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da618170-74dc-4053-80d2-7506521b0ad0 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:59.746663 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cd7977-b2e4-40c1-a7c0-52d5fe79547d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:59.747349 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cd7977-b2e4-40c1-a7c0-52d5fe79547d admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:59.747890 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cd7977-b2e4-40c1-a7c0-52d5fe79547d admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:59.750818 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cd7977-b2e4-40c1-a7c0-52d5fe79547d admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:59.750818 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cd7977-b2e4-40c1-a7c0-52d5fe79547d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:59.752233 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cd7977-b2e4-40c1-a7c0-52d5fe79547d admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:59.752739 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373106d4-9766-4569-b044-7983ec871a3c admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:59.755010 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-373106d4-9766-4569-b044-7983ec871a3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:36:59.774997 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 849/1664] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:36:59 2022] GET /identity/v3/roles => generated 1427 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:36:59.779089 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373106d4-9766-4569-b044-7983ec871a3c admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:59.780537 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cd7977-b2e4-40c1-a7c0-52d5fe79547d admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:59.794660 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ca5715-2d16-46a7-b8f2-c569f00113f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:59.795823 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ca5715-2d16-46a7-b8f2-c569f00113f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:59.796323 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ca5715-2d16-46a7-b8f2-c569f00113f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:59.796892 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ca5715-2d16-46a7-b8f2-c569f00113f1 admin admin] PATH_INFO: `/v3/projects/d21e9e58d3c64adfbf1fc6ff65b6ddc5` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:59.799282 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ca5715-2d16-46a7-b8f2-c569f00113f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d21e9e58d3c64adfbf1fc6ff65b6ddc5)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:59.804148 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ca5715-2d16-46a7-b8f2-c569f00113f1 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:59.809359 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cd7977-b2e4-40c1-a7c0-52d5fe79547d admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:59.820419 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c3e54e-3a45-4530-a204-501526abb41c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:59.821295 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c3e54e-3a45-4530-a204-501526abb41c admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:59.821440 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c3e54e-3a45-4530-a204-501526abb41c admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:59.821699 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c3e54e-3a45-4530-a204-501526abb41c admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:59.825088 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c3e54e-3a45-4530-a204-501526abb41c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:59.826799 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c3e54e-3a45-4530-a204-501526abb41c admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:59.857908 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 850/1665] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:36:59 2022] GET /identity/v3/roles => generated 1427 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:36:59.859040 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c3e54e-3a45-4530-a204-501526abb41c admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:59.876890 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:59.890476 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c3e54e-3a45-4530-a204-501526abb41c admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:59.923226 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-53ca5715-2d16-46a7-b8f2-c569f00113f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd21e9e58d3c64adfbf1fc6ff65b6ddc5', 'request_id': 'req-53ca5715-2d16-46a7-b8f2-c569f00113f1'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:36:59.934608 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-53ca5715-2d16-46a7-b8f2-c569f00113f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd21e9e58d3c64adfbf1fc6ff65b6ddc5', 'request_id': 'req-53ca5715-2d16-46a7-b8f2-c569f00113f1'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:36:59.955434 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-53ca5715-2d16-46a7-b8f2-c569f00113f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd21e9e58d3c64adfbf1fc6ff65b6ddc5', 'request_id': 'req-53ca5715-2d16-46a7-b8f2-c569f00113f1'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:36:59.979212 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-53ca5715-2d16-46a7-b8f2-c569f00113f1 admin admin] The token cache is being invalidate because project d21e9e58d3c64adfbf1fc6ff65b6ddc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:36:59.981198 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-53ca5715-2d16-46a7-b8f2-c569f00113f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:36:59.981677 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-53ca5715-2d16-46a7-b8f2-c569f00113f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:36:59.990699 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 816/1666] 10.222.0.118 () {58 vars in 1237 bytes} [Thu Jul 14 15:36:59 2022] DELETE /identity/v3/projects/d21e9e58d3c64adfbf1fc6ff65b6ddc5 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:36:59.992253 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05147409-3d3f-4a56-b831-03af9b263336 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:59.992543 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05147409-3d3f-4a56-b831-03af9b263336 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:59.994918 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05147409-3d3f-4a56-b831-03af9b263336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:59.995735 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:00.019037 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195c5d28-c97b-4c41-acca-b9877422ad11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:00.020544 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195c5d28-c97b-4c41-acca-b9877422ad11 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:00.020826 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195c5d28-c97b-4c41-acca-b9877422ad11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:00.021099 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195c5d28-c97b-4c41-acca-b9877422ad11 admin admin] PATH_INFO: `/v3/projects/e0b43df582c7474aac773f0b73f92f93/users/476616f5b42b4723be2c54ab33848dc6/roles/4abcf5e5e7cd4b53ae1828fec6550d53` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:00.047078 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-05147409-3d3f-4a56-b831-03af9b263336 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:00.049508 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-05147409-3d3f-4a56-b831-03af9b263336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:00.051997 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195c5d28-c97b-4c41-acca-b9877422ad11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0b43df582c7474aac773f0b73f92f93, user_id=476616f5b42b4723be2c54ab33848dc6, role_id=4abcf5e5e7cd4b53ae1828fec6550d53)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:00.054728 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195c5d28-c97b-4c41-acca-b9877422ad11 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:00.069994 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 817/1667] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:36:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:37:00.078512 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde0a489-804a-498b-b01a-4317b77b6a8d None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:00.080498 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde0a489-804a-498b-b01a-4317b77b6a8d None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:00.080729 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde0a489-804a-498b-b01a-4317b77b6a8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:00.097632 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 851/1668] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:36:59 2022] PUT /identity/v3/projects/e0b43df582c7474aac773f0b73f92f93/users/476616f5b42b4723be2c54ab33848dc6/roles/4abcf5e5e7cd4b53ae1828fec6550d53 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:37:00.098799 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be9884-bf29-41ea-b2c0-38fb39346211 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:00.099094 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be9884-bf29-41ea-b2c0-38fb39346211 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:00.099373 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be9884-bf29-41ea-b2c0-38fb39346211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:00.128193 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-fde0a489-804a-498b-b01a-4317b77b6a8d None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:00.133217 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-fde0a489-804a-498b-b01a-4317b77b6a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:00.163630 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-14be9884-bf29-41ea-b2c0-38fb39346211 None None] MFA Rules not processed for user `476616f5b42b4723be2c54ab33848dc6`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:00.164884 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-14be9884-bf29-41ea-b2c0-38fb39346211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:00.297333 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 818/1669] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:37:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:37:00.304838 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde0a489-804a-498b-b01a-4317b77b6a8d None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:00.322908 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde0a489-804a-498b-b01a-4317b77b6a8d None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:00.323928 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 852/1670] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:37:00 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:37:00.324886 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14be9884-bf29-41ea-b2c0-38fb39346211 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:00.330064 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-14be9884-bf29-41ea-b2c0-38fb39346211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:00.336887 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80d5f45-ca2b-409a-8bc1-e963d9c0dd3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:00.337587 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80d5f45-ca2b-409a-8bc1-e963d9c0dd3d admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:00.337869 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80d5f45-ca2b-409a-8bc1-e963d9c0dd3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:00.338182 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80d5f45-ca2b-409a-8bc1-e963d9c0dd3d admin admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:00.339012 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80d5f45-ca2b-409a-8bc1-e963d9c0dd3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:37:00.339470 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80d5f45-ca2b-409a-8bc1-e963d9c0dd3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:00.343456 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80d5f45-ca2b-409a-8bc1-e963d9c0dd3d admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:00.359306 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14be9884-bf29-41ea-b2c0-38fb39346211 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:00.369824 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4294a05-dc33-4459-bf4b-7e9ac0d1645a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:00.370532 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4294a05-dc33-4459-bf4b-7e9ac0d1645a admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:00.370819 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4294a05-dc33-4459-bf4b-7e9ac0d1645a admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:00.371094 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4294a05-dc33-4459-bf4b-7e9ac0d1645a admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:00.371807 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4294a05-dc33-4459-bf4b-7e9ac0d1645a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:00.374102 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4294a05-dc33-4459-bf4b-7e9ac0d1645a admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:00.377658 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 819/1671] 10.222.0.118 () {58 vars in 1157 bytes} [Thu Jul 14 15:37:00 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:37:00.379410 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80d5f45-ca2b-409a-8bc1-e963d9c0dd3d admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:00.403187 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80d5f45-ca2b-409a-8bc1-e963d9c0dd3d admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:00.418796 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8598629d-e225-4ee8-818e-d3c58e478b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:00.419579 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8598629d-e225-4ee8-818e-d3c58e478b41 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:00.419957 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8598629d-e225-4ee8-818e-d3c58e478b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:00.420304 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8598629d-e225-4ee8-818e-d3c58e478b41 admin admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:00.421207 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8598629d-e225-4ee8-818e-d3c58e478b41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:00.424085 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8598629d-e225-4ee8-818e-d3c58e478b41 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:00.436024 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 853/1672] 10.222.0.118 () {60 vars in 1157 bytes} [Thu Jul 14 15:37:00 2022] POST /identity/v3/projects => generated 378 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:37:00.441092 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4294a05-dc33-4459-bf4b-7e9ac0d1645a admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:00.522322 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 820/1673] 10.222.0.118 () {60 vars in 1157 bytes} [Thu Jul 14 15:37:00 2022] POST /identity/v3/projects => generated 368 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:37:00.526866 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8598629d-e225-4ee8-818e-d3c58e478b41 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:00.685938 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4294a05-dc33-4459-bf4b-7e9ac0d1645a admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:00.786433 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8598629d-e225-4ee8-818e-d3c58e478b41 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:00.795114 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da759f19-f22f-443c-9cdd-a55e31c6d0d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:00.796878 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da759f19-f22f-443c-9cdd-a55e31c6d0d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:00.797570 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da759f19-f22f-443c-9cdd-a55e31c6d0d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:00.798034 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da759f19-f22f-443c-9cdd-a55e31c6d0d7 admin admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:00.799285 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da759f19-f22f-443c-9cdd-a55e31c6d0d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:00.802666 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da759f19-f22f-443c-9cdd-a55e31c6d0d7 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:00.851646 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 821/1674] 10.222.0.118 () {60 vars in 1148 bytes} [Thu Jul 14 15:37:00 2022] POST /identity/v3/users => generated 285 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:37:00.853062 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da759f19-f22f-443c-9cdd-a55e31c6d0d7 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:00.881632 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:00.889733 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:00.904814 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da759f19-f22f-443c-9cdd-a55e31c6d0d7 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:00.922383 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba24b193-7236-40c6-9b26-8e02108b9fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:00.924195 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba24b193-7236-40c6-9b26-8e02108b9fbf admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:00.925009 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c31116-c1f7-491d-8881-b8397b7d315c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:00.925475 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba24b193-7236-40c6-9b26-8e02108b9fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:00.926549 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba24b193-7236-40c6-9b26-8e02108b9fbf admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:00.927645 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c31116-c1f7-491d-8881-b8397b7d315c admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:00.928124 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c31116-c1f7-491d-8881-b8397b7d315c admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:00.929624 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba24b193-7236-40c6-9b26-8e02108b9fbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:00.930162 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c31116-c1f7-491d-8881-b8397b7d315c admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:00.931129 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c31116-c1f7-491d-8881-b8397b7d315c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:00.936310 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c31116-c1f7-491d-8881-b8397b7d315c admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:00.936474 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba24b193-7236-40c6-9b26-8e02108b9fbf admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:00.975577 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 822/1675] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:37:00 2022] GET /identity/v3/roles => generated 1427 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:37:00.977938 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba24b193-7236-40c6-9b26-8e02108b9fbf admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:00.986923 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-ba24b193-7236-40c6-9b26-8e02108b9fbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:01.006310 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 854/1676] 10.222.0.118 () {60 vars in 1148 bytes} [Thu Jul 14 15:37:00 2022] POST /identity/v3/users => generated 296 bytes in 563 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:37:01.011159 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c31116-c1f7-491d-8881-b8397b7d315c admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:01.041466 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba24b193-7236-40c6-9b26-8e02108b9fbf admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:01.053812 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b832910a-137d-4a31-95a3-5b2a1a290303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:01.055355 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b832910a-137d-4a31-95a3-5b2a1a290303 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:01.055464 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c31116-c1f7-491d-8881-b8397b7d315c admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:01.055643 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b832910a-137d-4a31-95a3-5b2a1a290303 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:01.055921 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b832910a-137d-4a31-95a3-5b2a1a290303 admin admin] PATH_INFO: `/v3/projects/eacfb1428c194adc9d9a74078d31bd4e` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:01.070081 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b832910a-137d-4a31-95a3-5b2a1a290303 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eacfb1428c194adc9d9a74078d31bd4e)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:01.075313 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a8d2da-22b3-4213-b00b-64c9c7854c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:01.075489 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b832910a-137d-4a31-95a3-5b2a1a290303 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:01.076005 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a8d2da-22b3-4213-b00b-64c9c7854c5c admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:01.076288 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a8d2da-22b3-4213-b00b-64c9c7854c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:01.076564 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a8d2da-22b3-4213-b00b-64c9c7854c5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:01.077316 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a8d2da-22b3-4213-b00b-64c9c7854c5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:01.080928 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a8d2da-22b3-4213-b00b-64c9c7854c5c admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:01.111109 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 855/1677] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:37:01 2022] GET /identity/v3/roles => generated 1427 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:37:01.112124 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a8d2da-22b3-4213-b00b-64c9c7854c5c admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:01.140790 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a8d2da-22b3-4213-b00b-64c9c7854c5c admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:01.163497 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd21214c-cc5c-4cd8-8a08-99b78c4937d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:01.164194 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd21214c-cc5c-4cd8-8a08-99b78c4937d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:01.164475 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd21214c-cc5c-4cd8-8a08-99b78c4937d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:01.164747 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd21214c-cc5c-4cd8-8a08-99b78c4937d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:01.165498 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd21214c-cc5c-4cd8-8a08-99b78c4937d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:01.167203 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd21214c-cc5c-4cd8-8a08-99b78c4937d5 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:01.208833 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 856/1678] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:37:01 2022] GET /identity/v3/roles => generated 1427 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:37:01.212663 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd21214c-cc5c-4cd8-8a08-99b78c4937d5 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:01.236444 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-b832910a-137d-4a31-95a3-5b2a1a290303 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eacfb1428c194adc9d9a74078d31bd4e', 'request_id': 'req-b832910a-137d-4a31-95a3-5b2a1a290303'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:01.248482 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-b832910a-137d-4a31-95a3-5b2a1a290303 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eacfb1428c194adc9d9a74078d31bd4e', 'request_id': 'req-b832910a-137d-4a31-95a3-5b2a1a290303'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:01.253256 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd21214c-cc5c-4cd8-8a08-99b78c4937d5 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:01.256580 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-b832910a-137d-4a31-95a3-5b2a1a290303 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eacfb1428c194adc9d9a74078d31bd4e', 'request_id': 'req-b832910a-137d-4a31-95a3-5b2a1a290303'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:01.281541 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-b832910a-137d-4a31-95a3-5b2a1a290303 admin admin] The token cache is being invalidate because project eacfb1428c194adc9d9a74078d31bd4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:37:01.281844 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-b832910a-137d-4a31-95a3-5b2a1a290303 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:01.282857 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-b832910a-137d-4a31-95a3-5b2a1a290303 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:01.291896 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 823/1679] 10.222.0.118 () {58 vars in 1237 bytes} [Thu Jul 14 15:37:00 2022] DELETE /identity/v3/projects/eacfb1428c194adc9d9a74078d31bd4e => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:37:01.292846 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b832910a-137d-4a31-95a3-5b2a1a290303 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:01.295149 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-b832910a-137d-4a31-95a3-5b2a1a290303 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:01.408099 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1f8d35-c22a-4128-a41d-836f5c79ec80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:01.409110 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1f8d35-c22a-4128-a41d-836f5c79ec80 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:01.409392 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1f8d35-c22a-4128-a41d-836f5c79ec80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:01.409671 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1f8d35-c22a-4128-a41d-836f5c79ec80 admin admin] PATH_INFO: `/v3/projects/f3e649694b43467089191d5dc9e475a1/users/fd9b408e800549f8ae155ce6cf301d02/roles/4abcf5e5e7cd4b53ae1828fec6550d53` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:01.445758 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1f8d35-c22a-4128-a41d-836f5c79ec80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3e649694b43467089191d5dc9e475a1, user_id=fd9b408e800549f8ae155ce6cf301d02, role_id=4abcf5e5e7cd4b53ae1828fec6550d53)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:01.448759 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1f8d35-c22a-4128-a41d-836f5c79ec80 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:01.467766 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b832910a-137d-4a31-95a3-5b2a1a290303 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:01.472862 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 857/1680] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:37:01 2022] PUT /identity/v3/projects/f3e649694b43467089191d5dc9e475a1/users/fd9b408e800549f8ae155ce6cf301d02/roles/4abcf5e5e7cd4b53ae1828fec6550d53 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:37:01.473867 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1f8d35-c22a-4128-a41d-836f5c79ec80 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:01.483501 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-7e1f8d35-c22a-4128-a41d-836f5c79ec80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:01.572620 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee834ad-9b0a-42ee-8e96-f692ca0ae0c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:01.573817 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee834ad-9b0a-42ee-8e96-f692ca0ae0c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:01.574433 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee834ad-9b0a-42ee-8e96-f692ca0ae0c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:01.575294 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee834ad-9b0a-42ee-8e96-f692ca0ae0c7 admin admin] PATH_INFO: `/v3/projects/801356030a114ec89ccb46e4dbcd52df/users/9275b214a1f84862902ce10b4c093c75/roles/3b880cef7dcf4baf87b50f8610c0c56e` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:01.597900 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee834ad-9b0a-42ee-8e96-f692ca0ae0c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=801356030a114ec89ccb46e4dbcd52df, user_id=9275b214a1f84862902ce10b4c093c75, role_id=3b880cef7dcf4baf87b50f8610c0c56e)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:01.601110 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee834ad-9b0a-42ee-8e96-f692ca0ae0c7 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:01.615779 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1f8d35-c22a-4128-a41d-836f5c79ec80 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:01.622141 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 824/1681] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:37:01 2022] PUT /identity/v3/projects/801356030a114ec89ccb46e4dbcd52df/users/9275b214a1f84862902ce10b4c093c75/roles/3b880cef7dcf4baf87b50f8610c0c56e => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:37:01.624237 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8516e3-19cd-4dc7-a15c-15917007d96d None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:01.624941 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8516e3-19cd-4dc7-a15c-15917007d96d None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:01.625601 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8516e3-19cd-4dc7-a15c-15917007d96d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:01.649535 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:01.676165 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-0c8516e3-19cd-4dc7-a15c-15917007d96d None None] MFA Rules not processed for user `fd9b408e800549f8ae155ce6cf301d02`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:01.678346 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-0c8516e3-19cd-4dc7-a15c-15917007d96d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:01.732418 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:01.758130 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9d7445-87f3-4e27-9f2c-b94238243e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:01.759037 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9d7445-87f3-4e27-9f2c-b94238243e71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:01.760069 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9d7445-87f3-4e27-9f2c-b94238243e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:01.760415 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9d7445-87f3-4e27-9f2c-b94238243e71 admin admin] PATH_INFO: `/v3/users/a66a18f5e682456a80420eeb195b9ad7` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:01.761872 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9d7445-87f3-4e27-9f2c-b94238243e71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a66a18f5e682456a80420eeb195b9ad7)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:01.764989 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9d7445-87f3-4e27-9f2c-b94238243e71 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:01.823950 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 825/1682] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:37:01 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:37:01.823950 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8516e3-19cd-4dc7-a15c-15917007d96d None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:01.836846 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8516e3-19cd-4dc7-a15c-15917007d96d None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:01.843052 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8145088-1b1a-4b4a-a323-e59a6d0fe3f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:01.843454 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8145088-1b1a-4b4a-a323-e59a6d0fe3f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:01.844014 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8145088-1b1a-4b4a-a323-e59a6d0fe3f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:01.844296 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8145088-1b1a-4b4a-a323-e59a6d0fe3f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:01.845108 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8145088-1b1a-4b4a-a323-e59a6d0fe3f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:01.847440 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8145088-1b1a-4b4a-a323-e59a6d0fe3f0 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:01.861530 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 826/1683] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:37:01 2022] GET /identity/v3/roles => generated 1427 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:37:01.862644 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8145088-1b1a-4b4a-a323-e59a6d0fe3f0 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:01.865035 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-d8145088-1b1a-4b4a-a323-e59a6d0fe3f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:01.866600 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-8b9d7445-87f3-4e27-9f2c-b94238243e71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a66a18f5e682456a80420eeb195b9ad7'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:01.882245 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8145088-1b1a-4b4a-a323-e59a6d0fe3f0 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:01.894010 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bb00d1-8dff-4c4c-88af-d0f9690e707c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:01.897554 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-8b9d7445-87f3-4e27-9f2c-b94238243e71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a66a18f5e682456a80420eeb195b9ad7'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:01.900205 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bb00d1-8dff-4c4c-88af-d0f9690e707c admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:01.900205 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bb00d1-8dff-4c4c-88af-d0f9690e707c admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:01.900459 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-8b9d7445-87f3-4e27-9f2c-b94238243e71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a66a18f5e682456a80420eeb195b9ad7'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:01.900542 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bb00d1-8dff-4c4c-88af-d0f9690e707c admin admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:01.900542 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bb00d1-8dff-4c4c-88af-d0f9690e707c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:01.901575 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-8b9d7445-87f3-4e27-9f2c-b94238243e71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a66a18f5e682456a80420eeb195b9ad7'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:01.906639 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bb00d1-8dff-4c4c-88af-d0f9690e707c admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:01.943706 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-8b9d7445-87f3-4e27-9f2c-b94238243e71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a66a18f5e682456a80420eeb195b9ad7'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:01.986699 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 858/1684] 10.222.0.118 () {58 vars in 1228 bytes} [Thu Jul 14 15:37:01 2022] DELETE /identity/v3/users/a66a18f5e682456a80420eeb195b9ad7 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:37:01.991640 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 827/1685] 10.222.0.118 () {60 vars in 1157 bytes} [Thu Jul 14 15:37:01 2022] POST /identity/v3/projects => generated 366 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:37:01.991990 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9d7445-87f3-4e27-9f2c-b94238243e71 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:01.995929 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-8b9d7445-87f3-4e27-9f2c-b94238243e71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:01.997801 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bb00d1-8dff-4c4c-88af-d0f9690e707c admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:02.003800 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-88bb00d1-8dff-4c4c-88af-d0f9690e707c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:02.150302 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bb00d1-8dff-4c4c-88af-d0f9690e707c admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:02.163950 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd67a74b-81f4-44b4-bea9-632cbe919e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:02.165233 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd67a74b-81f4-44b4-bea9-632cbe919e15 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:02.165518 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd67a74b-81f4-44b4-bea9-632cbe919e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:02.165792 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd67a74b-81f4-44b4-bea9-632cbe919e15 admin admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:02.168421 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd67a74b-81f4-44b4-bea9-632cbe919e15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:02.174312 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd67a74b-81f4-44b4-bea9-632cbe919e15 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:02.193086 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9d7445-87f3-4e27-9f2c-b94238243e71 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:02.208474 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06304e53-26af-4dee-9d14-de82e2462adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:02.209556 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06304e53-26af-4dee-9d14-de82e2462adf admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:02.209944 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06304e53-26af-4dee-9d14-de82e2462adf admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:02.210353 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06304e53-26af-4dee-9d14-de82e2462adf admin admin] PATH_INFO: `/v3/projects/801356030a114ec89ccb46e4dbcd52df/users/9275b214a1f84862902ce10b4c093c75/roles/3b880cef7dcf4baf87b50f8610c0c56e` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:02.214543 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06304e53-26af-4dee-9d14-de82e2462adf admin admin] RBAC: Authorizing `identity:create_grant(project_id=801356030a114ec89ccb46e4dbcd52df, user_id=9275b214a1f84862902ce10b4c093c75, role_id=3b880cef7dcf4baf87b50f8610c0c56e)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:02.221724 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06304e53-26af-4dee-9d14-de82e2462adf admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:02.240646 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 828/1686] 10.222.0.118 () {60 vars in 1148 bytes} [Thu Jul 14 15:37:01 2022] POST /identity/v3/users => generated 290 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:37:02.244082 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd67a74b-81f4-44b4-bea9-632cbe919e15 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:02.251831 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 859/1687] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:37:01 2022] PUT /identity/v3/projects/801356030a114ec89ccb46e4dbcd52df/users/9275b214a1f84862902ce10b4c093c75/roles/3b880cef7dcf4baf87b50f8610c0c56e => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:37:02.266231 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aa13d3-b01b-4162-9bd3-df1b830fc36e None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:02.266701 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aa13d3-b01b-4162-9bd3-df1b830fc36e None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:02.267073 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aa13d3-b01b-4162-9bd3-df1b830fc36e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:02.282265 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd67a74b-81f4-44b4-bea9-632cbe919e15 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:02.365766 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-61aa13d3-b01b-4162-9bd3-df1b830fc36e None None] MFA Rules not processed for user `9275b214a1f84862902ce10b4c093c75`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:02.371145 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-61aa13d3-b01b-4162-9bd3-df1b830fc36e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:02.488357 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:02.520046 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad66f83-25da-4732-b2f1-7f1a1129f7ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:02.520931 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad66f83-25da-4732-b2f1-7f1a1129f7ce admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:02.521496 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad66f83-25da-4732-b2f1-7f1a1129f7ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:02.521871 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad66f83-25da-4732-b2f1-7f1a1129f7ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:02.523711 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad66f83-25da-4732-b2f1-7f1a1129f7ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:02.532845 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad66f83-25da-4732-b2f1-7f1a1129f7ce admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:02.550010 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:02.564854 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 829/1688] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:37:02 2022] GET /identity/v3/roles => generated 1427 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:37:02.567988 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad66f83-25da-4732-b2f1-7f1a1129f7ce admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:02.589038 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad66f83-25da-4732-b2f1-7f1a1129f7ce admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:02.605321 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f3edc1-29d8-466d-bdd8-23f3d1b71bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:02.607916 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f3edc1-29d8-466d-bdd8-23f3d1b71bb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:02.609891 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f3edc1-29d8-466d-bdd8-23f3d1b71bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:02.610215 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f3edc1-29d8-466d-bdd8-23f3d1b71bb6 admin admin] PATH_INFO: `/v3/projects/5d183a20baac4240a00f7b2abe82618a/users/2dad2b4124f34cb89502a42e567b3793/roles/3b880cef7dcf4baf87b50f8610c0c56e` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:02.616084 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 860/1689] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:37:02 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:37:02.630811 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aa13d3-b01b-4162-9bd3-df1b830fc36e None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:02.632702 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-61aa13d3-b01b-4162-9bd3-df1b830fc36e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:02.656050 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f3edc1-29d8-466d-bdd8-23f3d1b71bb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d183a20baac4240a00f7b2abe82618a, user_id=2dad2b4124f34cb89502a42e567b3793, role_id=3b880cef7dcf4baf87b50f8610c0c56e)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:02.659293 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f3edc1-29d8-466d-bdd8-23f3d1b71bb6 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:02.707944 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 830/1690] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:37:02 2022] PUT /identity/v3/projects/5d183a20baac4240a00f7b2abe82618a/users/2dad2b4124f34cb89502a42e567b3793/roles/3b880cef7dcf4baf87b50f8610c0c56e => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:37:02.713280 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f3edc1-29d8-466d-bdd8-23f3d1b71bb6 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:02.784762 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aa13d3-b01b-4162-9bd3-df1b830fc36e None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:02.877272 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f3edc1-29d8-466d-bdd8-23f3d1b71bb6 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:02.889904 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d886df46-97da-41ba-b608-087ca3ad5571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:02.893586 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d886df46-97da-41ba-b608-087ca3ad5571 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:02.893936 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d886df46-97da-41ba-b608-087ca3ad5571 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:02.894270 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d886df46-97da-41ba-b608-087ca3ad5571 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:02.897678 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d886df46-97da-41ba-b608-087ca3ad5571 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:02.902197 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d886df46-97da-41ba-b608-087ca3ad5571 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:02.913188 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb5ea80-ee2f-48a4-bb83-6b9529a68ec5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea647438ea1c438987f28cbe39c3ff2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:02.914040 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb5ea80-ee2f-48a4-bb83-6b9529a68ec5 service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:02.914579 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb5ea80-ee2f-48a4-bb83-6b9529a68ec5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:02.914815 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb5ea80-ee2f-48a4-bb83-6b9529a68ec5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:02.929306 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 831/1691] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:37:02 2022] GET /identity/v3/roles => generated 1427 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:37:02.932807 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d886df46-97da-41ba-b608-087ca3ad5571 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:02.958738 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d886df46-97da-41ba-b608-087ca3ad5571 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:02.978406 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f62da37-5b7e-49ea-a85e-ba7c733bfc2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:02.979312 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f62da37-5b7e-49ea-a85e-ba7c733bfc2f admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:02.979629 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f62da37-5b7e-49ea-a85e-ba7c733bfc2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:02.979902 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f62da37-5b7e-49ea-a85e-ba7c733bfc2f admin admin] PATH_INFO: `/v3/projects/5d183a20baac4240a00f7b2abe82618a/users/2dad2b4124f34cb89502a42e567b3793/roles/3b880cef7dcf4baf87b50f8610c0c56e` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:02.987088 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f62da37-5b7e-49ea-a85e-ba7c733bfc2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d183a20baac4240a00f7b2abe82618a, user_id=2dad2b4124f34cb89502a42e567b3793, role_id=3b880cef7dcf4baf87b50f8610c0c56e)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:02.990530 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f62da37-5b7e-49ea-a85e-ba7c733bfc2f admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:03.018262 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 832/1692] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:37:02 2022] PUT /identity/v3/projects/5d183a20baac4240a00f7b2abe82618a/users/2dad2b4124f34cb89502a42e567b3793/roles/3b880cef7dcf4baf87b50f8610c0c56e => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:37:03.028638 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a212199-0315-474e-8650-72a2475789ed None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:03.028931 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a212199-0315-474e-8650-72a2475789ed None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:03.029207 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a212199-0315-474e-8650-72a2475789ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:03.078881 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb5ea80-ee2f-48a4-bb83-6b9529a68ec5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:03.080520 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb5ea80-ee2f-48a4-bb83-6b9529a68ec5 service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:03.103144 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-1a212199-0315-474e-8650-72a2475789ed None None] MFA Rules not processed for user `2dad2b4124f34cb89502a42e567b3793`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:03.106464 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-1a212199-0315-474e-8650-72a2475789ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:03.108632 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 861/1693] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:37:02 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:37:03.259083 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb5ea80-ee2f-48a4-bb83-6b9529a68ec5 service cinder] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:03.268796 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb5ea80-ee2f-48a4-bb83-6b9529a68ec5 service cinder] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:03.339720 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 833/1694] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:37:03 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:37:03.363561 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a212199-0315-474e-8650-72a2475789ed None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:03.365026 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-1a212199-0315-474e-8650-72a2475789ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:03.409117 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915d33db-1b77-4d16-b3d0-9ef59da26e8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea647438ea1c438987f28cbe39c3ff2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:03.410973 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915d33db-1b77-4d16-b3d0-9ef59da26e8b service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:03.412034 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915d33db-1b77-4d16-b3d0-9ef59da26e8b service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:03.412320 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915d33db-1b77-4d16-b3d0-9ef59da26e8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:03.416754 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-915d33db-1b77-4d16-b3d0-9ef59da26e8b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:03.429759 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:03.446326 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:03.503442 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a212199-0315-474e-8650-72a2475789ed None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:03.512847 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c932541-04ca-472d-93e0-5712223cdf03 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea647438ea1c438987f28cbe39c3ff2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:03.514837 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c932541-04ca-472d-93e0-5712223cdf03 service cinder] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:03.515176 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c932541-04ca-472d-93e0-5712223cdf03 service cinder] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:03.515454 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c932541-04ca-472d-93e0-5712223cdf03 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:03.547749 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c932541-04ca-472d-93e0-5712223cdf03 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:03.549184 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c932541-04ca-472d-93e0-5712223cdf03 service cinder] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:03.574394 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915d33db-1b77-4d16-b3d0-9ef59da26e8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:03.575281 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 834/1695] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:37:03 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:37:03.576168 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915d33db-1b77-4d16-b3d0-9ef59da26e8b service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:03.616142 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 862/1696] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:37:03 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:37:03.666491 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c932541-04ca-472d-93e0-5712223cdf03 service cinder] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:03.677506 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c932541-04ca-472d-93e0-5712223cdf03 service cinder] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:03.686774 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770dfb77-4bbb-45df-a88d-069346d9600e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea647438ea1c438987f28cbe39c3ff2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:03.687459 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770dfb77-4bbb-45df-a88d-069346d9600e service cinder] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:03.687740 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770dfb77-4bbb-45df-a88d-069346d9600e service cinder] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:03.688014 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770dfb77-4bbb-45df-a88d-069346d9600e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:03.700800 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-770dfb77-4bbb-45df-a88d-069346d9600e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:03.876387 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770dfb77-4bbb-45df-a88d-069346d9600e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:03.879560 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770dfb77-4bbb-45df-a88d-069346d9600e service cinder] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:03.907977 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 835/1697] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:37:03 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:37:05.860562 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915d33db-1b77-4d16-b3d0-9ef59da26e8b service cinder] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:05.862223 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-915d33db-1b77-4d16-b3d0-9ef59da26e8b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:06.013631 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db16421-9991-431f-b5cd-adb779621043 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:06.014237 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db16421-9991-431f-b5cd-adb779621043 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:06.014819 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db16421-9991-431f-b5cd-adb779621043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:06.078193 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915d33db-1b77-4d16-b3d0-9ef59da26e8b service cinder] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:06.092470 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f69474c-7969-40d4-be32-1d4028e87afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:06.093566 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f69474c-7969-40d4-be32-1d4028e87afb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:06.094027 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f69474c-7969-40d4-be32-1d4028e87afb admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:06.094602 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f69474c-7969-40d4-be32-1d4028e87afb admin admin] PATH_INFO: `/v3/projects/764b9b6e5b5f4b2cbc47c6f0b4f18ad6` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:06.094709 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-5db16421-9991-431f-b5cd-adb779621043 None None] MFA Rules not processed for user `4c4a0889c40248808900619987f7d6fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:06.096530 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f69474c-7969-40d4-be32-1d4028e87afb admin admin] RBAC: Authorizing `identity:delete_project(project_id=764b9b6e5b5f4b2cbc47c6f0b4f18ad6)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:06.102940 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-5db16421-9991-431f-b5cd-adb779621043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:06.110879 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f69474c-7969-40d4-be32-1d4028e87afb admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:06.243657 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-5f69474c-7969-40d4-be32-1d4028e87afb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '764b9b6e5b5f4b2cbc47c6f0b4f18ad6', 'request_id': 'req-5f69474c-7969-40d4-be32-1d4028e87afb'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:06.260925 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-5f69474c-7969-40d4-be32-1d4028e87afb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '764b9b6e5b5f4b2cbc47c6f0b4f18ad6', 'request_id': 'req-5f69474c-7969-40d4-be32-1d4028e87afb'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:06.278485 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-5f69474c-7969-40d4-be32-1d4028e87afb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '764b9b6e5b5f4b2cbc47c6f0b4f18ad6', 'request_id': 'req-5f69474c-7969-40d4-be32-1d4028e87afb'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:06.305906 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 836/1698] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:37:06 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:37:06.317661 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336eb55f-f4f7-40ee-9f07-59e4063dad54 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:06.317661 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336eb55f-f4f7-40ee-9f07-59e4063dad54 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:06.317661 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336eb55f-f4f7-40ee-9f07-59e4063dad54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:06.324637 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-5f69474c-7969-40d4-be32-1d4028e87afb admin admin] The token cache is being invalidate because project 764b9b6e5b5f4b2cbc47c6f0b4f18ad6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:37:06.325365 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-5f69474c-7969-40d4-be32-1d4028e87afb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:06.326267 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-5f69474c-7969-40d4-be32-1d4028e87afb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:06.328669 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 863/1699] 10.222.0.118 () {58 vars in 1237 bytes} [Thu Jul 14 15:37:05 2022] DELETE /identity/v3/projects/764b9b6e5b5f4b2cbc47c6f0b4f18ad6 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:37:06.336556 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b82ee64-75a2-4532-a233-907fcb94477c None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:06.336925 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b82ee64-75a2-4532-a233-907fcb94477c None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:06.342671 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b82ee64-75a2-4532-a233-907fcb94477c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:06.366269 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-3b82ee64-75a2-4532-a233-907fcb94477c None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:06.367748 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-3b82ee64-75a2-4532-a233-907fcb94477c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:06.369683 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-336eb55f-f4f7-40ee-9f07-59e4063dad54 None None] MFA Rules not processed for user `4c4a0889c40248808900619987f7d6fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:06.373812 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-336eb55f-f4f7-40ee-9f07-59e4063dad54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:06.474333 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:06.536965 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 837/1700] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:37:06 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:37:06.544596 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b1f38f-0203-4d90-a38d-2894983a0171 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:06.545301 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b1f38f-0203-4d90-a38d-2894983a0171 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:06.545585 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b1f38f-0203-4d90-a38d-2894983a0171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:06.569339 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 864/1701] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:37:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:37:06.577456 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b82ee64-75a2-4532-a233-907fcb94477c None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:06.585823 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-3b82ee64-75a2-4532-a233-907fcb94477c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:06.617762 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:06.641259 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-80b1f38f-0203-4d90-a38d-2894983a0171 None None] MFA Rules not processed for user `cb3789b5896349f89ec70d97b70d3e7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:06.645364 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-80b1f38f-0203-4d90-a38d-2894983a0171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:06.764927 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b82ee64-75a2-4532-a233-907fcb94477c None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:06.783447 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d5c517-ca4c-40e9-be74-6eea0075fdfc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0177fc696ea40069902803da09f437c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:06.785697 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d5c517-ca4c-40e9-be74-6eea0075fdfc service nova] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:06.786128 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d5c517-ca4c-40e9-be74-6eea0075fdfc service nova] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:06.786477 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d5c517-ca4c-40e9-be74-6eea0075fdfc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:06.789313 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-75d5c517-ca4c-40e9-be74-6eea0075fdfc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:06.808473 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d5c517-ca4c-40e9-be74-6eea0075fdfc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:06.810445 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d5c517-ca4c-40e9-be74-6eea0075fdfc service nova] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:06.828440 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 865/1702] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:37:06 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:37:06.830588 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1806b6-1fab-4944-9d47-796808218125 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:06.830888 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1806b6-1fab-4944-9d47-796808218125 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:06.831165 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1806b6-1fab-4944-9d47-796808218125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:06.837912 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 838/1703] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:37:06 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:37:06.859639 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786f9827-599e-47d3-8e52-225f839ef216 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:06.859948 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786f9827-599e-47d3-8e52-225f839ef216 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:06.860204 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786f9827-599e-47d3-8e52-225f839ef216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:06.874249 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-da1806b6-1fab-4944-9d47-796808218125 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:06.875507 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-da1806b6-1fab-4944-9d47-796808218125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:06.891094 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-786f9827-599e-47d3-8e52-225f839ef216 None None] MFA Rules not processed for user `cb3789b5896349f89ec70d97b70d3e7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:06.893492 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-786f9827-599e-47d3-8e52-225f839ef216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:06.902497 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 866/1704] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:37:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:37:06.904514 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1806b6-1fab-4944-9d47-796808218125 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:06.924042 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 839/1705] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:37:06 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:37:06.930640 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786f9827-599e-47d3-8e52-225f839ef216 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:06.932614 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-786f9827-599e-47d3-8e52-225f839ef216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:06.942535 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1806b6-1fab-4944-9d47-796808218125 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:06.964326 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6b7e47-c5c7-43e5-8a81-93af88d8e460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:06.964945 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b7e47-c5c7-43e5-8a81-93af88d8e460 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:06.965222 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b7e47-c5c7-43e5-8a81-93af88d8e460 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:06.965504 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b7e47-c5c7-43e5-8a81-93af88d8e460 admin admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:06.966285 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6b7e47-c5c7-43e5-8a81-93af88d8e460 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:37:06.966610 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6b7e47-c5c7-43e5-8a81-93af88d8e460 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:06.968233 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6b7e47-c5c7-43e5-8a81-93af88d8e460 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:07.010670 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786f9827-599e-47d3-8e52-225f839ef216 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:07.011224 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 867/1706] 10.222.0.118 () {58 vars in 1157 bytes} [Thu Jul 14 15:37:06 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:37:07.016537 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6b7e47-c5c7-43e5-8a81-93af88d8e460 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:07.028003 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6b7e47-c5c7-43e5-8a81-93af88d8e460 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:07.028134 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5563d37-2186-4529-93df-dd68a9b7be7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0177fc696ea40069902803da09f437c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:07.029131 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5563d37-2186-4529-93df-dd68a9b7be7c service nova] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:07.029421 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5563d37-2186-4529-93df-dd68a9b7be7c service nova] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:07.029705 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5563d37-2186-4529-93df-dd68a9b7be7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:07.033601 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b05b4ba-5427-48a0-8948-4ac41252a11a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:07.034477 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b05b4ba-5427-48a0-8948-4ac41252a11a admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:07.035442 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b05b4ba-5427-48a0-8948-4ac41252a11a admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:07.035843 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b05b4ba-5427-48a0-8948-4ac41252a11a admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:07.036685 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b05b4ba-5427-48a0-8948-4ac41252a11a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:07.039246 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b05b4ba-5427-48a0-8948-4ac41252a11a admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:07.061436 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5563d37-2186-4529-93df-dd68a9b7be7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:07.063111 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5563d37-2186-4529-93df-dd68a9b7be7c service nova] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:07.086437 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 840/1707] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:37:06 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:37:07.141828 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 868/1708] 10.222.0.118 () {60 vars in 1157 bytes} [Thu Jul 14 15:37:07 2022] POST /identity/v3/projects => generated 380 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:37:07.146617 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5563d37-2186-4529-93df-dd68a9b7be7c service nova] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:07.164984 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5563d37-2186-4529-93df-dd68a9b7be7c service nova] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:07.336047 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b2708c-4c4d-4115-be67-320d965bc9eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:07.343241 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b2708c-4c4d-4115-be67-320d965bc9eb admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:07.349779 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b2708c-4c4d-4115-be67-320d965bc9eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:07.349779 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b2708c-4c4d-4115-be67-320d965bc9eb admin admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:07.349779 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b2708c-4c4d-4115-be67-320d965bc9eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:07.356251 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b2708c-4c4d-4115-be67-320d965bc9eb admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:07.418242 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 841/1709] 10.222.0.118 () {60 vars in 1148 bytes} [Thu Jul 14 15:37:07 2022] POST /identity/v3/users => generated 291 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:37:07.422487 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b05b4ba-5427-48a0-8948-4ac41252a11a admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:07.443240 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b05b4ba-5427-48a0-8948-4ac41252a11a admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:07.461991 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4818c782-19c5-4303-87bf-7794da1aeb92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:07.463088 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4818c782-19c5-4303-87bf-7794da1aeb92 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:07.467605 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4818c782-19c5-4303-87bf-7794da1aeb92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:07.467852 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4818c782-19c5-4303-87bf-7794da1aeb92 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:07.468920 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4818c782-19c5-4303-87bf-7794da1aeb92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:07.479807 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4818c782-19c5-4303-87bf-7794da1aeb92 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:07.528955 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 869/1710] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:37:07 2022] GET /identity/v3/roles => generated 1427 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:37:07.530301 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b2708c-4c4d-4115-be67-320d965bc9eb admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:07.562546 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b2708c-4c4d-4115-be67-320d965bc9eb admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:07.592267 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fb7b4f-062a-41f1-bd35-efddc5310d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:07.592977 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fb7b4f-062a-41f1-bd35-efddc5310d6d admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:07.593259 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fb7b4f-062a-41f1-bd35-efddc5310d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:07.593537 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fb7b4f-062a-41f1-bd35-efddc5310d6d admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:07.594316 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fb7b4f-062a-41f1-bd35-efddc5310d6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:07.597760 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fb7b4f-062a-41f1-bd35-efddc5310d6d admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:07.637815 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 842/1711] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:37:07 2022] GET /identity/v3/roles => generated 1427 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:37:07.643805 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4818c782-19c5-4303-87bf-7794da1aeb92 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:07.660469 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4818c782-19c5-4303-87bf-7794da1aeb92 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:07.678288 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718301a6-3e24-4862-80ad-aa49c37e40df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:07.679923 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718301a6-3e24-4862-80ad-aa49c37e40df admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:07.680310 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718301a6-3e24-4862-80ad-aa49c37e40df admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:07.680658 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718301a6-3e24-4862-80ad-aa49c37e40df admin admin] PATH_INFO: `/v3/projects/4f2401d9eacd4654a5645dcc76f5b89b/users/b33ee82102824f6ab9589067663cc57e/roles/4abcf5e5e7cd4b53ae1828fec6550d53` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:07.713878 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718301a6-3e24-4862-80ad-aa49c37e40df admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f2401d9eacd4654a5645dcc76f5b89b, user_id=b33ee82102824f6ab9589067663cc57e, role_id=4abcf5e5e7cd4b53ae1828fec6550d53)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:07.717405 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718301a6-3e24-4862-80ad-aa49c37e40df admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:07.756923 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 870/1712] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:37:07 2022] PUT /identity/v3/projects/4f2401d9eacd4654a5645dcc76f5b89b/users/b33ee82102824f6ab9589067663cc57e/roles/4abcf5e5e7cd4b53ae1828fec6550d53 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:37:07.771695 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a6e431-e75a-41a0-b45a-4cba62414739 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:07.771973 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a6e431-e75a-41a0-b45a-4cba62414739 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:07.772249 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a6e431-e75a-41a0-b45a-4cba62414739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:07.852887 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-e3a6e431-e75a-41a0-b45a-4cba62414739 None None] MFA Rules not processed for user `b33ee82102824f6ab9589067663cc57e`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:07.852887 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-e3a6e431-e75a-41a0-b45a-4cba62414739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:08.056239 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:08.104112 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 843/1713] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:37:07 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:37:08.109494 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718301a6-3e24-4862-80ad-aa49c37e40df admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:08.229668 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:08.262024 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718301a6-3e24-4862-80ad-aa49c37e40df admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:08.268410 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff7b9b1-8c2b-4f8e-afa6-0820403aa724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:08.272103 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff7b9b1-8c2b-4f8e-afa6-0820403aa724 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:08.272901 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff7b9b1-8c2b-4f8e-afa6-0820403aa724 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:08.273741 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff7b9b1-8c2b-4f8e-afa6-0820403aa724 admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:08.277465 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff7b9b1-8c2b-4f8e-afa6-0820403aa724 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:08.298374 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff7b9b1-8c2b-4f8e-afa6-0820403aa724 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:08.311633 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f17842-06af-4ae7-af4d-289b9d2d35be None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:08.312260 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f17842-06af-4ae7-af4d-289b9d2d35be None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:08.312845 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f17842-06af-4ae7-af4d-289b9d2d35be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:08.359655 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-23f17842-06af-4ae7-af4d-289b9d2d35be None None] MFA Rules not processed for user `d1f95427c9ff4d8287c6ecd33a1a0d2c`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:08.363462 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-23f17842-06af-4ae7-af4d-289b9d2d35be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:08.402097 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 871/1714] 10.222.0.118 () {60 vars in 1157 bytes} [Thu Jul 14 15:37:08 2022] POST /identity/v3/projects => generated 378 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:37:08.403349 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7dcc7e-c2f3-4e77-9e38-1063b2e79147 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:08.403643 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7dcc7e-c2f3-4e77-9e38-1063b2e79147 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:08.403922 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7dcc7e-c2f3-4e77-9e38-1063b2e79147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:08.472423 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-0e7dcc7e-c2f3-4e77-9e38-1063b2e79147 None None] MFA Rules not processed for user `bab083ba82d64af391d09c531b8647e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:08.479627 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-0e7dcc7e-c2f3-4e77-9e38-1063b2e79147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:08.514928 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 844/1715] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:37:08 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:37:08.516144 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f17842-06af-4ae7-af4d-289b9d2d35be None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:08.554408 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f17842-06af-4ae7-af4d-289b9d2d35be None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:08.635025 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 872/1716] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:37:08 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:37:08.636169 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131a27c6-6b9b-433f-9c2b-28f43683640d None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:08.636459 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131a27c6-6b9b-433f-9c2b-28f43683640d None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:08.636736 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131a27c6-6b9b-433f-9c2b-28f43683640d None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:08.638050 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 873/1717] 10.222.0.118 () {54 vars in 917 bytes} [Thu Jul 14 15:37:08 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:37:08.656582 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e67b565-a5fa-4465-83a3-02402236d8e7 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:08.656869 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e67b565-a5fa-4465-83a3-02402236d8e7 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:08.657147 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e67b565-a5fa-4465-83a3-02402236d8e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:08.692259 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d308953-3aa6-4a66-9ee6-fea3e448d5d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:08.695134 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d308953-3aa6-4a66-9ee6-fea3e448d5d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:08.695606 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d308953-3aa6-4a66-9ee6-fea3e448d5d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:08.696089 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d308953-3aa6-4a66-9ee6-fea3e448d5d0 admin admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:08.697447 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d308953-3aa6-4a66-9ee6-fea3e448d5d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:08.699763 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d308953-3aa6-4a66-9ee6-fea3e448d5d0 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:08.783395 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-6e67b565-a5fa-4465-83a3-02402236d8e7 None None] MFA Rules not processed for user `b650be8114b64df0ac88441f1c50b2cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:08.784708 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-6e67b565-a5fa-4465-83a3-02402236d8e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:08.785935 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 845/1718] 10.222.0.118 () {60 vars in 1148 bytes} [Thu Jul 14 15:37:08 2022] POST /identity/v3/users => generated 290 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:37:08.787459 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fcf0e6-b31c-4278-b275-a2f2090bfed5 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:08.787749 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fcf0e6-b31c-4278-b275-a2f2090bfed5 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:08.788030 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fcf0e6-b31c-4278-b275-a2f2090bfed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:08.849097 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-56fcf0e6-b31c-4278-b275-a2f2090bfed5 None None] MFA Rules not processed for user `34f09b2afbe54a6ab1ba27292bc5a964`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:08.852154 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-56fcf0e6-b31c-4278-b275-a2f2090bfed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:08.899349 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 874/1719] 10.222.0.118 () {58 vars in 1014 bytes} [Thu Jul 14 15:37:08 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:37:08.900997 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e67b565-a5fa-4465-83a3-02402236d8e7 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:08.917517 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e67b565-a5fa-4465-83a3-02402236d8e7 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:08.929755 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844eace6-b072-493d-a9fa-c0beaab16554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:08.931415 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844eace6-b072-493d-a9fa-c0beaab16554 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:08.931963 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844eace6-b072-493d-a9fa-c0beaab16554 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:08.932393 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844eace6-b072-493d-a9fa-c0beaab16554 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:08.934346 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844eace6-b072-493d-a9fa-c0beaab16554 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:08.943926 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844eace6-b072-493d-a9fa-c0beaab16554 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:08.960601 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 875/1720] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:37:08 2022] GET /identity/v3/roles => generated 1427 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:37:08.962101 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844eace6-b072-493d-a9fa-c0beaab16554 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:08.964095 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-844eace6-b072-493d-a9fa-c0beaab16554 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:08.984770 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844eace6-b072-493d-a9fa-c0beaab16554 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:08.994419 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4db257-6f9f-41c0-afdc-4e75e6383368 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b650be8114b64df0ac88441f1c50b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:08.995964 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4db257-6f9f-41c0-afdc-4e75e6383368 service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:08.997169 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4db257-6f9f-41c0-afdc-4e75e6383368 service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:08.999368 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4db257-6f9f-41c0-afdc-4e75e6383368 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:09.014958 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4db257-6f9f-41c0-afdc-4e75e6383368 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:09.017764 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4db257-6f9f-41c0-afdc-4e75e6383368 service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:09.032449 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 876/1721] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:37:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:37:09.034343 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4db257-6f9f-41c0-afdc-4e75e6383368 service neutron] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:09.055566 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4db257-6f9f-41c0-afdc-4e75e6383368 service neutron] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:09.061927 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e05c86-50c8-4383-b501-4bac90154a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:09.062955 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e05c86-50c8-4383-b501-4bac90154a09 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:09.063502 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e05c86-50c8-4383-b501-4bac90154a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:09.064007 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e05c86-50c8-4383-b501-4bac90154a09 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:09.065326 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e05c86-50c8-4383-b501-4bac90154a09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:09.068267 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e05c86-50c8-4383-b501-4bac90154a09 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:09.091601 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 846/1722] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:37:08 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:37:09.099967 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 877/1723] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:37:09 2022] GET /identity/v3/roles => generated 1427 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:37:09.101816 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e05c86-50c8-4383-b501-4bac90154a09 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:09.101925 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845644fb-4a2f-4b5a-a84b-598f2e04b42c None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:09.102170 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845644fb-4a2f-4b5a-a84b-598f2e04b42c None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:09.112405 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845644fb-4a2f-4b5a-a84b-598f2e04b42c None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:09.114795 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 847/1724] 10.222.0.118 () {54 vars in 917 bytes} [Thu Jul 14 15:37:09 2022] GET /identity => generated 271 bytes in 23 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:37:09.116938 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e05c86-50c8-4383-b501-4bac90154a09 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:09.121808 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47789bb4-fb8c-4395-9df8-9aa86d1a1953 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:09.122142 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47789bb4-fb8c-4395-9df8-9aa86d1a1953 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:09.122635 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47789bb4-fb8c-4395-9df8-9aa86d1a1953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:09.127184 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f65d43-4432-4122-91c3-0a8b344e1f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:09.129613 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f65d43-4432-4122-91c3-0a8b344e1f11 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:09.130496 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f65d43-4432-4122-91c3-0a8b344e1f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:09.131100 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f65d43-4432-4122-91c3-0a8b344e1f11 admin admin] PATH_INFO: `/v3/projects/cf50ef78dd0c455db8de3becb98bb926/users/214ce715c31048f8b24ec1854ca79916/roles/4abcf5e5e7cd4b53ae1828fec6550d53` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:09.167532 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f65d43-4432-4122-91c3-0a8b344e1f11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf50ef78dd0c455db8de3becb98bb926, user_id=214ce715c31048f8b24ec1854ca79916, role_id=4abcf5e5e7cd4b53ae1828fec6550d53)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:09.171210 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f65d43-4432-4122-91c3-0a8b344e1f11 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:09.178712 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:09.208417 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 878/1725] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:37:09 2022] PUT /identity/v3/projects/cf50ef78dd0c455db8de3becb98bb926/users/214ce715c31048f8b24ec1854ca79916/roles/4abcf5e5e7cd4b53ae1828fec6550d53 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:37:09.211218 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f65d43-4432-4122-91c3-0a8b344e1f11 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:09.216609 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-c5f65d43-4432-4122-91c3-0a8b344e1f11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:09.223524 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-47789bb4-fb8c-4395-9df8-9aa86d1a1953 None None] MFA Rules not processed for user `b650be8114b64df0ac88441f1c50b2cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:09.227049 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-47789bb4-fb8c-4395-9df8-9aa86d1a1953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:09.244521 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:09.378745 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 848/1726] 10.222.0.118 () {58 vars in 1014 bytes} [Thu Jul 14 15:37:09 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:37:09.381265 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f702a6-b42c-4ce8-96b7-a40d1e09ec10 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:09.385428 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f702a6-b42c-4ce8-96b7-a40d1e09ec10 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:09.385766 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f702a6-b42c-4ce8-96b7-a40d1e09ec10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:09.429856 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f65d43-4432-4122-91c3-0a8b344e1f11 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:09.435853 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc09a901-69dc-4871-8fed-eee7dc4674c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:09.441548 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc09a901-69dc-4871-8fed-eee7dc4674c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:09.442693 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc09a901-69dc-4871-8fed-eee7dc4674c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:09.444474 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc09a901-69dc-4871-8fed-eee7dc4674c1 admin admin] PATH_INFO: `/v3/users/fd9b408e800549f8ae155ce6cf301d02` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:09.449582 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc09a901-69dc-4871-8fed-eee7dc4674c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd9b408e800549f8ae155ce6cf301d02)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:09.453086 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc09a901-69dc-4871-8fed-eee7dc4674c1 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:09.471375 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-a0f702a6-b42c-4ce8-96b7-a40d1e09ec10 None None] MFA Rules not processed for user `214ce715c31048f8b24ec1854ca79916`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:09.473374 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-a0f702a6-b42c-4ce8-96b7-a40d1e09ec10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:09.567462 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-dc09a901-69dc-4871-8fed-eee7dc4674c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd9b408e800549f8ae155ce6cf301d02'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:09.611689 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-dc09a901-69dc-4871-8fed-eee7dc4674c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd9b408e800549f8ae155ce6cf301d02'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:09.612913 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-dc09a901-69dc-4871-8fed-eee7dc4674c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd9b408e800549f8ae155ce6cf301d02'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:09.616910 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-dc09a901-69dc-4871-8fed-eee7dc4674c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd9b408e800549f8ae155ce6cf301d02'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:09.652928 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 849/1727] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:37:09 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:37:09.657994 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f702a6-b42c-4ce8-96b7-a40d1e09ec10 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:09.661095 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-a0f702a6-b42c-4ce8-96b7-a40d1e09ec10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:09.675945 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f702a6-b42c-4ce8-96b7-a40d1e09ec10 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:09.679791 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba822e5c-c091-4cd7-ab14-0014158d5a13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b650be8114b64df0ac88441f1c50b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:09.681594 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba822e5c-c091-4cd7-ab14-0014158d5a13 service neutron] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:09.681941 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba822e5c-c091-4cd7-ab14-0014158d5a13 service neutron] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:09.682268 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba822e5c-c091-4cd7-ab14-0014158d5a13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:09.695017 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-dc09a901-69dc-4871-8fed-eee7dc4674c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd9b408e800549f8ae155ce6cf301d02'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:09.695718 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-ba822e5c-c091-4cd7-ab14-0014158d5a13 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:09.727807 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 879/1728] 10.222.0.118 () {58 vars in 1228 bytes} [Thu Jul 14 15:37:09 2022] DELETE /identity/v3/users/fd9b408e800549f8ae155ce6cf301d02 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:37:09.727994 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba822e5c-c091-4cd7-ab14-0014158d5a13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:09.728101 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc09a901-69dc-4871-8fed-eee7dc4674c1 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:09.729502 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-dc09a901-69dc-4871-8fed-eee7dc4674c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:09.733259 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba822e5c-c091-4cd7-ab14-0014158d5a13 service neutron] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:09.748383 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 850/1729] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:37:09 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:37:09.762443 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ce855e-cf88-4e09-a3fc-043f02b27945 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:09.762894 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ce855e-cf88-4e09-a3fc-043f02b27945 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:09.763336 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ce855e-cf88-4e09-a3fc-043f02b27945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:09.809143 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-54ce855e-cf88-4e09-a3fc-043f02b27945 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:09.814272 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-54ce855e-cf88-4e09-a3fc-043f02b27945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:09.945996 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc09a901-69dc-4871-8fed-eee7dc4674c1 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:09.956907 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b428e04-82ca-441c-8069-606d090cd3be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:09.958528 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b428e04-82ca-441c-8069-606d090cd3be admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:09.958740 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b428e04-82ca-441c-8069-606d090cd3be admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:09.960408 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b428e04-82ca-441c-8069-606d090cd3be admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:09.962139 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b428e04-82ca-441c-8069-606d090cd3be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:09.967368 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b428e04-82ca-441c-8069-606d090cd3be admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:10.039859 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:10.047445 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 880/1730] 10.222.0.118 () {60 vars in 1157 bytes} [Thu Jul 14 15:37:09 2022] POST /identity/v3/projects => generated 380 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:37:10.051929 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b428e04-82ca-441c-8069-606d090cd3be admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:10.064831 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 851/1731] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:37:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:37:10.082729 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ce855e-cf88-4e09-a3fc-043f02b27945 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:10.089023 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-54ce855e-cf88-4e09-a3fc-043f02b27945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:10.237323 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b428e04-82ca-441c-8069-606d090cd3be admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:10.253769 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c837c4-972d-4ca3-8382-be158f1d68e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:10.255926 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c837c4-972d-4ca3-8382-be158f1d68e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:10.256209 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c837c4-972d-4ca3-8382-be158f1d68e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:10.260312 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c837c4-972d-4ca3-8382-be158f1d68e7 admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:10.262080 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c837c4-972d-4ca3-8382-be158f1d68e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:10.267373 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c837c4-972d-4ca3-8382-be158f1d68e7 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:10.285557 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:10.338721 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 881/1732] 10.222.0.118 () {60 vars in 1148 bytes} [Thu Jul 14 15:37:10 2022] POST /identity/v3/users => generated 297 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:37:10.345690 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4ea643-653f-42c8-a9fe-fb2d3ee72e54 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:10.346974 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4ea643-653f-42c8-a9fe-fb2d3ee72e54 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:10.350346 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4ea643-653f-42c8-a9fe-fb2d3ee72e54 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:10.357868 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ce855e-cf88-4e09-a3fc-043f02b27945 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:10.358400 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 882/1733] 10.222.0.118 () {54 vars in 965 bytes} [Thu Jul 14 15:37:10 2022] GET /identity => generated 271 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:37:10.359380 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4ea643-653f-42c8-a9fe-fb2d3ee72e54 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:10.429350 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4ea643-653f-42c8-a9fe-fb2d3ee72e54 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:10.445211 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879aed4c-38b8-43cb-883b-620d489ed670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:10.452284 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879aed4c-38b8-43cb-883b-620d489ed670 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:10.452654 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879aed4c-38b8-43cb-883b-620d489ed670 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:10.452944 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879aed4c-38b8-43cb-883b-620d489ed670 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:10.455906 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879aed4c-38b8-43cb-883b-620d489ed670 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:10.461650 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879aed4c-38b8-43cb-883b-620d489ed670 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:10.498812 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 883/1734] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:37:10 2022] GET /identity/v3/roles => generated 1427 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:37:10.500867 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f751bdd1-83f5-4df8-8528-2ea0566c07b8 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:10.501717 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f751bdd1-83f5-4df8-8528-2ea0566c07b8 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:10.502037 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f751bdd1-83f5-4df8-8528-2ea0566c07b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:10.555676 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-f751bdd1-83f5-4df8-8528-2ea0566c07b8 None None] MFA Rules not processed for user `e70b0f8be7e04adca6e3f218fbe3a295`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:10.557515 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d25e0a-3271-4165-b667-6d52c0abf933 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b650be8114b64df0ac88441f1c50b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:10.558872 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d25e0a-3271-4165-b667-6d52c0abf933 service neutron] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:10.560044 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d25e0a-3271-4165-b667-6d52c0abf933 service neutron] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:10.560398 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d25e0a-3271-4165-b667-6d52c0abf933 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:10.560602 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-f751bdd1-83f5-4df8-8528-2ea0566c07b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:10.587796 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d25e0a-3271-4165-b667-6d52c0abf933 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:10.589801 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d25e0a-3271-4165-b667-6d52c0abf933 service neutron] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:10.613018 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 852/1735] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:37:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 534 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:37:10.614232 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d25e0a-3271-4165-b667-6d52c0abf933 service neutron] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:10.633609 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d25e0a-3271-4165-b667-6d52c0abf933 service neutron] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:10.639183 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9d6ef8-3510-477c-bffe-b35b1f9187e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:10.640732 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d6ef8-3510-477c-bffe-b35b1f9187e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:10.640908 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d6ef8-3510-477c-bffe-b35b1f9187e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:10.641327 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d6ef8-3510-477c-bffe-b35b1f9187e6 admin admin] PATH_INFO: `/v3/projects/ecd835230ca34bf4b7e7c538940427b1/users/ff0087f20b7b43498f56a0c904e90627/roles/3b880cef7dcf4baf87b50f8610c0c56e` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:10.685593 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9d6ef8-3510-477c-bffe-b35b1f9187e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecd835230ca34bf4b7e7c538940427b1, user_id=ff0087f20b7b43498f56a0c904e90627, role_id=3b880cef7dcf4baf87b50f8610c0c56e)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:10.688949 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9d6ef8-3510-477c-bffe-b35b1f9187e6 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:10.747325 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 884/1736] 10.222.0.118 () {58 vars in 1062 bytes} [Thu Jul 14 15:37:10 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:37:10.752169 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 853/1737] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:37:10 2022] PUT /identity/v3/projects/ecd835230ca34bf4b7e7c538940427b1/users/ff0087f20b7b43498f56a0c904e90627/roles/3b880cef7dcf4baf87b50f8610c0c56e => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:37:10.755514 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9d6ef8-3510-477c-bffe-b35b1f9187e6 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:10.758042 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f751bdd1-83f5-4df8-8528-2ea0566c07b8 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:10.786559 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f751bdd1-83f5-4df8-8528-2ea0566c07b8 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:10.943690 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9d6ef8-3510-477c-bffe-b35b1f9187e6 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:10.950106 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cc6a7c-8b1f-4b29-a125-6e4fcb9338b6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b0f8be7e04adca6e3f218fbe3a295', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:10.952079 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cc6a7c-8b1f-4b29-a125-6e4fcb9338b6 service placement] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:10.952470 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cc6a7c-8b1f-4b29-a125-6e4fcb9338b6 service placement] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:10.953300 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cc6a7c-8b1f-4b29-a125-6e4fcb9338b6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:10.956170 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-d1cc6a7c-8b1f-4b29-a125-6e4fcb9338b6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:10.982613 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b622c87a-192b-407c-87a7-29ead1b7bbb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:10.985925 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b622c87a-192b-407c-87a7-29ead1b7bbb2 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:10.987391 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b622c87a-192b-407c-87a7-29ead1b7bbb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:10.987851 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b622c87a-192b-407c-87a7-29ead1b7bbb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:10.989905 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b622c87a-192b-407c-87a7-29ead1b7bbb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:10.992614 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b622c87a-192b-407c-87a7-29ead1b7bbb2 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:11.002444 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cc6a7c-8b1f-4b29-a125-6e4fcb9338b6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:11.022153 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cc6a7c-8b1f-4b29-a125-6e4fcb9338b6 service placement] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:11.054967 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 885/1738] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:37:10 2022] GET /identity/v3/roles => generated 1427 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:37:11.070163 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 854/1739] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:37:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:37:11.078411 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b622c87a-192b-407c-87a7-29ead1b7bbb2 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:11.078584 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cc6a7c-8b1f-4b29-a125-6e4fcb9338b6 service placement] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:11.080116 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-d1cc6a7c-8b1f-4b29-a125-6e4fcb9338b6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:11.157019 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b622c87a-192b-407c-87a7-29ead1b7bbb2 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:11.169745 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd185ef7-a129-43a2-9da9-d279c84e5be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:11.174881 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd185ef7-a129-43a2-9da9-d279c84e5be3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:11.174881 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd185ef7-a129-43a2-9da9-d279c84e5be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:11.175266 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd185ef7-a129-43a2-9da9-d279c84e5be3 admin admin] PATH_INFO: `/v3/projects/ecd835230ca34bf4b7e7c538940427b1/users/ff0087f20b7b43498f56a0c904e90627/roles/3b880cef7dcf4baf87b50f8610c0c56e` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:11.180618 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd185ef7-a129-43a2-9da9-d279c84e5be3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecd835230ca34bf4b7e7c538940427b1, user_id=ff0087f20b7b43498f56a0c904e90627, role_id=3b880cef7dcf4baf87b50f8610c0c56e)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:11.187175 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd185ef7-a129-43a2-9da9-d279c84e5be3 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:11.223018 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:11.263146 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 886/1740] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:37:11 2022] PUT /identity/v3/projects/ecd835230ca34bf4b7e7c538940427b1/users/ff0087f20b7b43498f56a0c904e90627/roles/3b880cef7dcf4baf87b50f8610c0c56e => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:37:11.265071 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7014332-366a-477b-ba85-13c2fc9a87ff None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:11.265361 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7014332-366a-477b-ba85-13c2fc9a87ff None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:11.265644 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7014332-366a-477b-ba85-13c2fc9a87ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:11.353835 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:11.375622 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-b7014332-366a-477b-ba85-13c2fc9a87ff None None] MFA Rules not processed for user `ff0087f20b7b43498f56a0c904e90627`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:11.377331 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-b7014332-366a-477b-ba85-13c2fc9a87ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:11.412972 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cc6a7c-8b1f-4b29-a125-6e4fcb9338b6 service placement] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:11.537826 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 887/1741] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:37:11 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:37:11.547167 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7014332-366a-477b-ba85-13c2fc9a87ff None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:11.549254 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-b7014332-366a-477b-ba85-13c2fc9a87ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:11.689167 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7014332-366a-477b-ba85-13c2fc9a87ff None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:11.697837 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301e4245-1a94-423f-9358-c34559396d73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea647438ea1c438987f28cbe39c3ff2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:11.699105 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301e4245-1a94-423f-9358-c34559396d73 service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:11.699390 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301e4245-1a94-423f-9358-c34559396d73 service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:11.699667 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301e4245-1a94-423f-9358-c34559396d73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:11.710837 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e4f3ef-270f-4b84-8a32-2ac3f7b88466 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0177fc696ea40069902803da09f437c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:11.712167 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e4f3ef-270f-4b84-8a32-2ac3f7b88466 service nova] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:11.712454 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e4f3ef-270f-4b84-8a32-2ac3f7b88466 service nova] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:11.712710 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e4f3ef-270f-4b84-8a32-2ac3f7b88466 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:11.723722 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-14e4f3ef-270f-4b84-8a32-2ac3f7b88466 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:11.729331 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301e4245-1a94-423f-9358-c34559396d73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:11.739123 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301e4245-1a94-423f-9358-c34559396d73 service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:11.768665 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 888/1742] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:37:11 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:37:11.848210 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301e4245-1a94-423f-9358-c34559396d73 service cinder] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:11.849696 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-301e4245-1a94-423f-9358-c34559396d73 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:11.870812 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301e4245-1a94-423f-9358-c34559396d73 service cinder] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:11.905509 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f799a574-a3b6-46fb-82fa-7ee955161ec1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea647438ea1c438987f28cbe39c3ff2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:11.906279 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f799a574-a3b6-46fb-82fa-7ee955161ec1 service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:11.906544 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f799a574-a3b6-46fb-82fa-7ee955161ec1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:11.906814 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f799a574-a3b6-46fb-82fa-7ee955161ec1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:11.912522 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-f799a574-a3b6-46fb-82fa-7ee955161ec1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:11.982579 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e4f3ef-270f-4b84-8a32-2ac3f7b88466 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:11.989502 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e4f3ef-270f-4b84-8a32-2ac3f7b88466 service nova] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:12.041439 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 855/1743] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:37:11 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 964 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:37:12.059903 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f799a574-a3b6-46fb-82fa-7ee955161ec1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:12.061288 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f799a574-a3b6-46fb-82fa-7ee955161ec1 service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:12.085079 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 889/1744] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:37:11 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:37:12.209764 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e4f3ef-270f-4b84-8a32-2ac3f7b88466 service nova] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:12.229244 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e4f3ef-270f-4b84-8a32-2ac3f7b88466 service nova] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:12.248331 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ffe65d-4840-4f95-90ca-75026fa7230b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0177fc696ea40069902803da09f437c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:12.249583 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ffe65d-4840-4f95-90ca-75026fa7230b service nova] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:12.250141 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ffe65d-4840-4f95-90ca-75026fa7230b service nova] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:12.250672 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ffe65d-4840-4f95-90ca-75026fa7230b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:12.252820 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-19ffe65d-4840-4f95-90ca-75026fa7230b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:12.259853 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f799a574-a3b6-46fb-82fa-7ee955161ec1 service cinder] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:12.261653 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-f799a574-a3b6-46fb-82fa-7ee955161ec1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:12.385955 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:12.508063 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ffe65d-4840-4f95-90ca-75026fa7230b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:12.510776 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f799a574-a3b6-46fb-82fa-7ee955161ec1 service cinder] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:12.510914 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ffe65d-4840-4f95-90ca-75026fa7230b service nova] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:12.517307 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830f422c-f1ca-42fb-89fa-e3677abc60c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:12.518741 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830f422c-f1ca-42fb-89fa-e3677abc60c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:12.518938 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830f422c-f1ca-42fb-89fa-e3677abc60c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:12.520225 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830f422c-f1ca-42fb-89fa-e3677abc60c6 admin admin] PATH_INFO: `/v3/projects/f3e649694b43467089191d5dc9e475a1` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:12.522868 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830f422c-f1ca-42fb-89fa-e3677abc60c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3e649694b43467089191d5dc9e475a1)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:12.526943 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830f422c-f1ca-42fb-89fa-e3677abc60c6 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:12.537955 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 856/1745] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:37:12 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:37:12.705560 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-830f422c-f1ca-42fb-89fa-e3677abc60c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3e649694b43467089191d5dc9e475a1', 'request_id': 'req-830f422c-f1ca-42fb-89fa-e3677abc60c6'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:12.730682 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-830f422c-f1ca-42fb-89fa-e3677abc60c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3e649694b43467089191d5dc9e475a1', 'request_id': 'req-830f422c-f1ca-42fb-89fa-e3677abc60c6'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:12.755907 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-830f422c-f1ca-42fb-89fa-e3677abc60c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3e649694b43467089191d5dc9e475a1', 'request_id': 'req-830f422c-f1ca-42fb-89fa-e3677abc60c6'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:12.795538 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-830f422c-f1ca-42fb-89fa-e3677abc60c6 admin admin] The token cache is being invalidate because project f3e649694b43467089191d5dc9e475a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:37:12.796553 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-830f422c-f1ca-42fb-89fa-e3677abc60c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:12.798851 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-830f422c-f1ca-42fb-89fa-e3677abc60c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:12.805346 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 890/1746] 10.222.0.118 () {58 vars in 1237 bytes} [Thu Jul 14 15:37:12 2022] DELETE /identity/v3/projects/f3e649694b43467089191d5dc9e475a1 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:37:12.810812 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ffe65d-4840-4f95-90ca-75026fa7230b service nova] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:12.833849 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ffe65d-4840-4f95-90ca-75026fa7230b service nova] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:12.904167 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830f422c-f1ca-42fb-89fa-e3677abc60c6 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:12.905789 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-830f422c-f1ca-42fb-89fa-e3677abc60c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:13.006050 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:13.110334 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd9961e-d839-4f98-82fc-98171aabdf2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:13.111239 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd9961e-d839-4f98-82fc-98171aabdf2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:13.112159 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd9961e-d839-4f98-82fc-98171aabdf2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:13.112465 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd9961e-d839-4f98-82fc-98171aabdf2e admin admin] PATH_INFO: `/v3/users/2dad2b4124f34cb89502a42e567b3793` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:13.117323 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd9961e-d839-4f98-82fc-98171aabdf2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2dad2b4124f34cb89502a42e567b3793)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:13.119323 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd9961e-d839-4f98-82fc-98171aabdf2e admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:13.213214 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830f422c-f1ca-42fb-89fa-e3677abc60c6 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:13.236429 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdaf81e-40c9-406c-92cf-8cc29afdee0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:13.239578 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdaf81e-40c9-406c-92cf-8cc29afdee0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:13.239872 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdaf81e-40c9-406c-92cf-8cc29afdee0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:13.242284 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdaf81e-40c9-406c-92cf-8cc29afdee0c admin admin] PATH_INFO: `/v3/users/476616f5b42b4723be2c54ab33848dc6` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:13.251847 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdaf81e-40c9-406c-92cf-8cc29afdee0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=476616f5b42b4723be2c54ab33848dc6)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:13.252838 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-ebd9961e-d839-4f98-82fc-98171aabdf2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2dad2b4124f34cb89502a42e567b3793'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:13.264423 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdaf81e-40c9-406c-92cf-8cc29afdee0c admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:13.288512 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-ebd9961e-d839-4f98-82fc-98171aabdf2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2dad2b4124f34cb89502a42e567b3793'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:13.290181 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-ebd9961e-d839-4f98-82fc-98171aabdf2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2dad2b4124f34cb89502a42e567b3793'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:13.291385 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-ebd9961e-d839-4f98-82fc-98171aabdf2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2dad2b4124f34cb89502a42e567b3793'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:13.320152 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-ebd9961e-d839-4f98-82fc-98171aabdf2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2dad2b4124f34cb89502a42e567b3793'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:13.357327 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 857/1747] 10.222.0.118 () {58 vars in 1228 bytes} [Thu Jul 14 15:37:12 2022] DELETE /identity/v3/users/2dad2b4124f34cb89502a42e567b3793 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:37:13.359176 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a67ff-b1c1-49af-9d1a-cea3ad776e41 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:13.364595 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a67ff-b1c1-49af-9d1a-cea3ad776e41 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:13.365289 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a67ff-b1c1-49af-9d1a-cea3ad776e41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:13.422009 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-786a67ff-b1c1-49af-9d1a-cea3ad776e41 None None] MFA Rules not processed for user `4c4a0889c40248808900619987f7d6fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:13.423626 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-786a67ff-b1c1-49af-9d1a-cea3ad776e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:13.431303 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-ebdaf81e-40c9-406c-92cf-8cc29afdee0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '476616f5b42b4723be2c54ab33848dc6'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:13.468661 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-ebdaf81e-40c9-406c-92cf-8cc29afdee0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '476616f5b42b4723be2c54ab33848dc6'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:13.481311 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-ebdaf81e-40c9-406c-92cf-8cc29afdee0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '476616f5b42b4723be2c54ab33848dc6'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:13.483273 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-ebdaf81e-40c9-406c-92cf-8cc29afdee0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '476616f5b42b4723be2c54ab33848dc6'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:13.485196 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:13.538910 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-ebdaf81e-40c9-406c-92cf-8cc29afdee0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '476616f5b42b4723be2c54ab33848dc6'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:13.563974 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 891/1748] 10.222.0.118 () {58 vars in 1228 bytes} [Thu Jul 14 15:37:12 2022] DELETE /identity/v3/users/476616f5b42b4723be2c54ab33848dc6 => generated 0 bytes in 660 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:37:13.569060 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5940816e-2462-400e-bf63-a3cfc039bfa7 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:13.569585 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5940816e-2462-400e-bf63-a3cfc039bfa7 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:13.569980 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5940816e-2462-400e-bf63-a3cfc039bfa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:13.617546 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-5940816e-2462-400e-bf63-a3cfc039bfa7 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:13.620903 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-5940816e-2462-400e-bf63-a3cfc039bfa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:13.685796 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 858/1749] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:37:13 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:37:13.789934 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 892/1750] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:37:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:37:13.802151 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786a67ff-b1c1-49af-9d1a-cea3ad776e41 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:13.803628 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-786a67ff-b1c1-49af-9d1a-cea3ad776e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:13.937754 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786a67ff-b1c1-49af-9d1a-cea3ad776e41 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:13.957021 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:14.090614 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0f0f6a-aefe-4d10-b9f1-2c4234517ccd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b650be8114b64df0ac88441f1c50b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:14.092429 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f0f6a-aefe-4d10-b9f1-2c4234517ccd service neutron] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:14.093883 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f0f6a-aefe-4d10-b9f1-2c4234517ccd service neutron] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:14.095266 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f0f6a-aefe-4d10-b9f1-2c4234517ccd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:14.138299 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0f0f6a-aefe-4d10-b9f1-2c4234517ccd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:14.143116 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0f0f6a-aefe-4d10-b9f1-2c4234517ccd service neutron] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:14.196805 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 859/1751] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:37:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:37:14.554577 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5940816e-2462-400e-bf63-a3cfc039bfa7 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:14.557171 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-5940816e-2462-400e-bf63-a3cfc039bfa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:14.614010 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5940816e-2462-400e-bf63-a3cfc039bfa7 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:14.632366 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300ff183-f8c6-4d77-a572-d7e430b28457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:14.633904 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300ff183-f8c6-4d77-a572-d7e430b28457 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:14.645309 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300ff183-f8c6-4d77-a572-d7e430b28457 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:14.645844 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300ff183-f8c6-4d77-a572-d7e430b28457 admin admin] PATH_INFO: `/v3/projects/5d183a20baac4240a00f7b2abe82618a` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:14.648112 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300ff183-f8c6-4d77-a572-d7e430b28457 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d183a20baac4240a00f7b2abe82618a)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:14.652693 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300ff183-f8c6-4d77-a572-d7e430b28457 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:14.810811 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-300ff183-f8c6-4d77-a572-d7e430b28457 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d183a20baac4240a00f7b2abe82618a', 'request_id': 'req-300ff183-f8c6-4d77-a572-d7e430b28457'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:14.846397 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-300ff183-f8c6-4d77-a572-d7e430b28457 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d183a20baac4240a00f7b2abe82618a', 'request_id': 'req-300ff183-f8c6-4d77-a572-d7e430b28457'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:14.889402 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-300ff183-f8c6-4d77-a572-d7e430b28457 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d183a20baac4240a00f7b2abe82618a', 'request_id': 'req-300ff183-f8c6-4d77-a572-d7e430b28457'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:14.923443 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-300ff183-f8c6-4d77-a572-d7e430b28457 admin admin] The token cache is being invalidate because project 5d183a20baac4240a00f7b2abe82618a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:37:14.923733 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-300ff183-f8c6-4d77-a572-d7e430b28457 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:14.930474 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-300ff183-f8c6-4d77-a572-d7e430b28457 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:14.932592 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 893/1752] 10.222.0.118 () {58 vars in 1237 bytes} [Thu Jul 14 15:37:14 2022] DELETE /identity/v3/projects/5d183a20baac4240a00f7b2abe82618a => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:37:14.937626 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b9c8d8-f770-4913-a5fc-22a15cc0b0b7 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:14.939411 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b9c8d8-f770-4913-a5fc-22a15cc0b0b7 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:14.939864 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b9c8d8-f770-4913-a5fc-22a15cc0b0b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:14.984904 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-38b9c8d8-f770-4913-a5fc-22a15cc0b0b7 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:14.991557 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-38b9c8d8-f770-4913-a5fc-22a15cc0b0b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:15.171904 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 860/1753] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:37:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:37:15.173402 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cc2149-9216-435f-bbaa-e024627521b6 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:15.173689 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cc2149-9216-435f-bbaa-e024627521b6 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:15.173980 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cc2149-9216-435f-bbaa-e024627521b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:15.235536 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-b4cc2149-9216-435f-bbaa-e024627521b6 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:15.236804 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-b4cc2149-9216-435f-bbaa-e024627521b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:15.270170 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 894/1754] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:37:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:37:15.274663 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b9c8d8-f770-4913-a5fc-22a15cc0b0b7 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:15.291477 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b9c8d8-f770-4913-a5fc-22a15cc0b0b7 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:15.308101 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18673080-dc04-4a03-944a-f404893c7db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:15.308949 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18673080-dc04-4a03-944a-f404893c7db3 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:15.310674 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18673080-dc04-4a03-944a-f404893c7db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:15.310996 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18673080-dc04-4a03-944a-f404893c7db3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:15.314096 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18673080-dc04-4a03-944a-f404893c7db3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:37:15.314096 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18673080-dc04-4a03-944a-f404893c7db3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:15.319038 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18673080-dc04-4a03-944a-f404893c7db3 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:15.379269 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 861/1755] 10.222.0.118 () {58 vars in 1157 bytes} [Thu Jul 14 15:37:15 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:37:15.383446 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cc2149-9216-435f-bbaa-e024627521b6 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:15.404020 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cc2149-9216-435f-bbaa-e024627521b6 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:15.420704 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62e9038-7906-49fe-9f80-a29d8cc58178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:15.421633 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62e9038-7906-49fe-9f80-a29d8cc58178 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:15.422111 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62e9038-7906-49fe-9f80-a29d8cc58178 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:15.422558 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62e9038-7906-49fe-9f80-a29d8cc58178 admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:15.423431 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62e9038-7906-49fe-9f80-a29d8cc58178 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:15.432765 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62e9038-7906-49fe-9f80-a29d8cc58178 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:15.537029 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 895/1756] 10.222.0.118 () {60 vars in 1157 bytes} [Thu Jul 14 15:37:15 2022] POST /identity/v3/projects => generated 382 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:37:15.541421 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18673080-dc04-4a03-944a-f404893c7db3 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:15.573714 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18673080-dc04-4a03-944a-f404893c7db3 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:15.679585 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a6f187-097b-45c2-a923-6762765c0447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:15.680400 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a6f187-097b-45c2-a923-6762765c0447 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:15.680784 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a6f187-097b-45c2-a923-6762765c0447 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:15.681162 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a6f187-097b-45c2-a923-6762765c0447 admin admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:15.682153 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a6f187-097b-45c2-a923-6762765c0447 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:15.684248 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a6f187-097b-45c2-a923-6762765c0447 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:15.738780 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 862/1757] 10.222.0.118 () {60 vars in 1148 bytes} [Thu Jul 14 15:37:15 2022] POST /identity/v3/users => generated 292 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:37:15.742720 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62e9038-7906-49fe-9f80-a29d8cc58178 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:15.761325 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62e9038-7906-49fe-9f80-a29d8cc58178 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:15.768416 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aa6d8f-298d-4ae4-9798-6d8e3cca2383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:15.770062 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aa6d8f-298d-4ae4-9798-6d8e3cca2383 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:15.770622 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aa6d8f-298d-4ae4-9798-6d8e3cca2383 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:15.771125 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aa6d8f-298d-4ae4-9798-6d8e3cca2383 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:15.772354 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aa6d8f-298d-4ae4-9798-6d8e3cca2383 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:15.774691 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aa6d8f-298d-4ae4-9798-6d8e3cca2383 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:15.789986 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 896/1758] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:37:15 2022] GET /identity/v3/roles => generated 1427 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:37:15.793869 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a6f187-097b-45c2-a923-6762765c0447 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:15.808967 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a6f187-097b-45c2-a923-6762765c0447 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:15.816979 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e62318-0f5a-4c07-a1cf-440fe3bc6f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:15.829144 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e62318-0f5a-4c07-a1cf-440fe3bc6f47 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:15.830266 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e62318-0f5a-4c07-a1cf-440fe3bc6f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:15.830905 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e62318-0f5a-4c07-a1cf-440fe3bc6f47 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:15.832501 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e62318-0f5a-4c07-a1cf-440fe3bc6f47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:15.836130 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e62318-0f5a-4c07-a1cf-440fe3bc6f47 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:15.870927 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 863/1759] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:37:15 2022] GET /identity/v3/roles => generated 1427 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:37:15.875977 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aa6d8f-298d-4ae4-9798-6d8e3cca2383 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:15.901290 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aa6d8f-298d-4ae4-9798-6d8e3cca2383 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:15.909685 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba328ea-c287-4217-be03-bf8ad8e6e964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:15.910738 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba328ea-c287-4217-be03-bf8ad8e6e964 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:15.912125 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba328ea-c287-4217-be03-bf8ad8e6e964 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:15.912527 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba328ea-c287-4217-be03-bf8ad8e6e964 admin admin] PATH_INFO: `/v3/projects/03fba6cd7c2b42f9b4bce0dd1deeb532/users/4fa8444403ea4f59bcf020f3a4b9d532/roles/4abcf5e5e7cd4b53ae1828fec6550d53` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:15.961515 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba328ea-c287-4217-be03-bf8ad8e6e964 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03fba6cd7c2b42f9b4bce0dd1deeb532, user_id=4fa8444403ea4f59bcf020f3a4b9d532, role_id=4abcf5e5e7cd4b53ae1828fec6550d53)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:15.989110 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba328ea-c287-4217-be03-bf8ad8e6e964 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:15.992483 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:16.021894 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 897/1760] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:37:15 2022] PUT /identity/v3/projects/03fba6cd7c2b42f9b4bce0dd1deeb532/users/4fa8444403ea4f59bcf020f3a4b9d532/roles/4abcf5e5e7cd4b53ae1828fec6550d53 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:37:16.037923 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306c61b7-9afa-4d91-8143-660a97df0338 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:16.038437 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306c61b7-9afa-4d91-8143-660a97df0338 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:16.038524 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306c61b7-9afa-4d91-8143-660a97df0338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:16.088091 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee70da0b-8ea1-4d41-a202-af2eb41ed54c None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:16.088685 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee70da0b-8ea1-4d41-a202-af2eb41ed54c None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:16.091175 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee70da0b-8ea1-4d41-a202-af2eb41ed54c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:16.143464 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-306c61b7-9afa-4d91-8143-660a97df0338 None None] MFA Rules not processed for user `4fa8444403ea4f59bcf020f3a4b9d532`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:16.144799 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-306c61b7-9afa-4d91-8143-660a97df0338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:16.177071 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-ee70da0b-8ea1-4d41-a202-af2eb41ed54c None None] MFA Rules not processed for user `f7ad5ae70939416e8157693e02997a58`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:16.180274 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-ee70da0b-8ea1-4d41-a202-af2eb41ed54c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:16.200706 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:16.402049 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 898/1761] 10.222.0.118 () {58 vars in 1014 bytes} [Thu Jul 14 15:37:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:37:16.410090 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 864/1762] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:37:16 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 373 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:37:16.420776 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee70da0b-8ea1-4d41-a202-af2eb41ed54c None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:16.679178 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee70da0b-8ea1-4d41-a202-af2eb41ed54c None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:16.688420 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e78a1c-3817-4cb5-acd2-09d204755682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:16.689125 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e78a1c-3817-4cb5-acd2-09d204755682 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:16.689378 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e78a1c-3817-4cb5-acd2-09d204755682 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:16.689734 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e78a1c-3817-4cb5-acd2-09d204755682 admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:16.690431 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e78a1c-3817-4cb5-acd2-09d204755682 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:16.692495 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e78a1c-3817-4cb5-acd2-09d204755682 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:16.702912 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306c61b7-9afa-4d91-8143-660a97df0338 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:16.704551 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-306c61b7-9afa-4d91-8143-660a97df0338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:16.781924 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 899/1763] 10.222.0.118 () {60 vars in 1157 bytes} [Thu Jul 14 15:37:16 2022] POST /identity/v3/projects => generated 384 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:37:16.786383 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e78a1c-3817-4cb5-acd2-09d204755682 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:16.792905 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-f1e78a1c-3817-4cb5-acd2-09d204755682 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:16.943390 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:16.975913 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306c61b7-9afa-4d91-8143-660a97df0338 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:16.976252 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e78a1c-3817-4cb5-acd2-09d204755682 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:16.989652 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce6e18b-c637-4490-b072-80ae915a5b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:16.992401 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce6e18b-c637-4490-b072-80ae915a5b94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:16.992864 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce6e18b-c637-4490-b072-80ae915a5b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:16.993328 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce6e18b-c637-4490-b072-80ae915a5b94 admin admin] PATH_INFO: `/v3/users/b33ee82102824f6ab9589067663cc57e` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:16.998044 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce6e18b-c637-4490-b072-80ae915a5b94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b33ee82102824f6ab9589067663cc57e)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:17.002661 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce6e18b-c637-4490-b072-80ae915a5b94 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:17.095210 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea98927-cc2a-4000-b3b3-4153f8da6e19 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b672a6a601584d2d826147069e90a10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:17.096540 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea98927-cc2a-4000-b3b3-4153f8da6e19 service swift] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:17.097701 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea98927-cc2a-4000-b3b3-4153f8da6e19 service swift] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:17.098360 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea98927-cc2a-4000-b3b3-4153f8da6e19 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:17.109209 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-1ce6e18b-c637-4490-b072-80ae915a5b94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b33ee82102824f6ab9589067663cc57e'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:17.127879 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-1ce6e18b-c637-4490-b072-80ae915a5b94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b33ee82102824f6ab9589067663cc57e'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:17.129441 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-1ce6e18b-c637-4490-b072-80ae915a5b94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b33ee82102824f6ab9589067663cc57e'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:17.131015 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-1ce6e18b-c637-4490-b072-80ae915a5b94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b33ee82102824f6ab9589067663cc57e'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:17.163238 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-1ce6e18b-c637-4490-b072-80ae915a5b94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b33ee82102824f6ab9589067663cc57e'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:17.189751 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:17.193530 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 900/1764] 10.222.0.118 () {58 vars in 1228 bytes} [Thu Jul 14 15:37:16 2022] DELETE /identity/v3/users/b33ee82102824f6ab9589067663cc57e => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:37:17.194613 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce6e18b-c637-4490-b072-80ae915a5b94 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:17.197934 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-1ce6e18b-c637-4490-b072-80ae915a5b94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:17.239892 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea98927-cc2a-4000-b3b3-4153f8da6e19 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:17.244351 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea98927-cc2a-4000-b3b3-4153f8da6e19 service swift] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:17.274096 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 865/1765] 10.222.0.118 () {60 vars in 1389 bytes} [Thu Jul 14 15:37:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 571 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 15:37:17.277763 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad8a19b-7868-4a33-b659-5cb5349914d9 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:17.278211 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad8a19b-7868-4a33-b659-5cb5349914d9 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:17.278663 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad8a19b-7868-4a33-b659-5cb5349914d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:17.307958 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-0ad8a19b-7868-4a33-b659-5cb5349914d9 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:17.310802 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-0ad8a19b-7868-4a33-b659-5cb5349914d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:17.399408 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce6e18b-c637-4490-b072-80ae915a5b94 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:17.415220 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2a6d2e-6739-4b6f-a174-f16e1dcd146a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:17.416717 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2a6d2e-6739-4b6f-a174-f16e1dcd146a admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:17.417120 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2a6d2e-6739-4b6f-a174-f16e1dcd146a admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:17.417518 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2a6d2e-6739-4b6f-a174-f16e1dcd146a admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:17.418364 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2a6d2e-6739-4b6f-a174-f16e1dcd146a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:17.423067 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2a6d2e-6739-4b6f-a174-f16e1dcd146a admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:17.466228 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 901/1766] 10.222.0.118 () {60 vars in 1148 bytes} [Thu Jul 14 15:37:17 2022] POST /identity/v3/users => generated 299 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:37:17.472366 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2a6d2e-6739-4b6f-a174-f16e1dcd146a admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:17.502219 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2a6d2e-6739-4b6f-a174-f16e1dcd146a admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:17.515376 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 866/1767] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:37:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:37:17.516636 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9573edd-9a6d-4962-9b04-891387fbe965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:17.517427 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9573edd-9a6d-4962-9b04-891387fbe965 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:17.517830 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9573edd-9a6d-4962-9b04-891387fbe965 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:17.518237 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9573edd-9a6d-4962-9b04-891387fbe965 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:17.523272 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9573edd-9a6d-4962-9b04-891387fbe965 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:17.525252 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9573edd-9a6d-4962-9b04-891387fbe965 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:17.549624 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 902/1768] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:37:17 2022] GET /identity/v3/roles => generated 1427 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:37:17.554958 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad8a19b-7868-4a33-b659-5cb5349914d9 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:17.569173 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad8a19b-7868-4a33-b659-5cb5349914d9 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:17.580882 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bada49-605c-4f85-bee5-3446a99205c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:17.584280 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bada49-605c-4f85-bee5-3446a99205c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:17.584579 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bada49-605c-4f85-bee5-3446a99205c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:17.587409 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bada49-605c-4f85-bee5-3446a99205c6 admin admin] PATH_INFO: `/v3/projects/b6235a0ac1324e66a435b083aa1882e1/users/75a1230262694b989380d70262c71d0f/roles/3b880cef7dcf4baf87b50f8610c0c56e` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:17.625926 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bada49-605c-4f85-bee5-3446a99205c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6235a0ac1324e66a435b083aa1882e1, user_id=75a1230262694b989380d70262c71d0f, role_id=3b880cef7dcf4baf87b50f8610c0c56e)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:17.632444 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bada49-605c-4f85-bee5-3446a99205c6 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:17.671184 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 867/1769] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:37:17 2022] PUT /identity/v3/projects/b6235a0ac1324e66a435b083aa1882e1/users/75a1230262694b989380d70262c71d0f/roles/3b880cef7dcf4baf87b50f8610c0c56e => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:37:17.674820 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9573edd-9a6d-4962-9b04-891387fbe965 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:17.696357 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9573edd-9a6d-4962-9b04-891387fbe965 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:17.771406 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bada49-605c-4f85-bee5-3446a99205c6 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:17.774720 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-35bada49-605c-4f85-bee5-3446a99205c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:17.945439 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:17.981565 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bada49-605c-4f85-bee5-3446a99205c6 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:17.991217 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef0619f-fd75-4677-8a96-a1a34d0228c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b650be8114b64df0ac88441f1c50b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:17.992517 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3c1821-e932-4b91-b72c-24d67aa87821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:17.993375 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3c1821-e932-4b91-b72c-24d67aa87821 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:17.993841 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef0619f-fd75-4677-8a96-a1a34d0228c4 service neutron] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:17.994220 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef0619f-fd75-4677-8a96-a1a34d0228c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:17.994496 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef0619f-fd75-4677-8a96-a1a34d0228c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:17.995401 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3c1821-e932-4b91-b72c-24d67aa87821 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:17.995839 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3c1821-e932-4b91-b72c-24d67aa87821 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:17.996745 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3c1821-e932-4b91-b72c-24d67aa87821 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:18.001256 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3c1821-e932-4b91-b72c-24d67aa87821 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:18.019423 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef0619f-fd75-4677-8a96-a1a34d0228c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:18.020892 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef0619f-fd75-4677-8a96-a1a34d0228c4 service neutron] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:18.036129 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 903/1770] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:37:17 2022] GET /identity/v3/roles => generated 1427 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:37:18.040273 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3c1821-e932-4b91-b72c-24d67aa87821 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:18.055246 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 868/1771] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:37:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:37:18.061035 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3c1821-e932-4b91-b72c-24d67aa87821 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:18.069775 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cfc072-4044-409b-918b-bdf31383250c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:18.075429 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cfc072-4044-409b-918b-bdf31383250c admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:18.075869 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cfc072-4044-409b-918b-bdf31383250c admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:18.076261 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cfc072-4044-409b-918b-bdf31383250c admin admin] PATH_INFO: `/v3/projects/b6235a0ac1324e66a435b083aa1882e1/users/75a1230262694b989380d70262c71d0f/roles/3b880cef7dcf4baf87b50f8610c0c56e` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:18.079273 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cfc072-4044-409b-918b-bdf31383250c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6235a0ac1324e66a435b083aa1882e1, user_id=75a1230262694b989380d70262c71d0f, role_id=3b880cef7dcf4baf87b50f8610c0c56e)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:18.083350 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cfc072-4044-409b-918b-bdf31383250c admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:18.098261 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 904/1772] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:37:18 2022] PUT /identity/v3/projects/b6235a0ac1324e66a435b083aa1882e1/users/75a1230262694b989380d70262c71d0f/roles/3b880cef7dcf4baf87b50f8610c0c56e => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:37:18.109785 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df677302-c492-461e-93eb-dbf0ac8d06da None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:18.110465 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df677302-c492-461e-93eb-dbf0ac8d06da None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:18.110639 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df677302-c492-461e-93eb-dbf0ac8d06da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:18.162165 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-df677302-c492-461e-93eb-dbf0ac8d06da None None] MFA Rules not processed for user `75a1230262694b989380d70262c71d0f`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:18.163710 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-df677302-c492-461e-93eb-dbf0ac8d06da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:18.254940 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:18.333197 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cfc072-4044-409b-918b-bdf31383250c admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:18.335574 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-92cfc072-4044-409b-918b-bdf31383250c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:18.338397 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 869/1773] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:37:18 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:37:18.488985 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cfc072-4044-409b-918b-bdf31383250c admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:18.500516 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858b7322-3996-40c0-9164-3a8ca4abaca0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea647438ea1c438987f28cbe39c3ff2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:18.502471 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858b7322-3996-40c0-9164-3a8ca4abaca0 service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:18.503062 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858b7322-3996-40c0-9164-3a8ca4abaca0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:18.504569 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858b7322-3996-40c0-9164-3a8ca4abaca0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:18.517026 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df677302-c492-461e-93eb-dbf0ac8d06da None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:18.520326 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-df677302-c492-461e-93eb-dbf0ac8d06da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:18.527047 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858b7322-3996-40c0-9164-3a8ca4abaca0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:18.543540 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858b7322-3996-40c0-9164-3a8ca4abaca0 service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:18.592856 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 905/1774] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:37:18 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:37:18.860469 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df677302-c492-461e-93eb-dbf0ac8d06da None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:18.897552 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858b7322-3996-40c0-9164-3a8ca4abaca0 service cinder] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:18.902873 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcce0a3e-2a07-46b1-8405-314bcd7f211c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:18.904316 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcce0a3e-2a07-46b1-8405-314bcd7f211c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:18.904656 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcce0a3e-2a07-46b1-8405-314bcd7f211c admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:18.905018 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcce0a3e-2a07-46b1-8405-314bcd7f211c admin admin] PATH_INFO: `/v3/projects/e0b43df582c7474aac773f0b73f92f93` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:18.911573 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcce0a3e-2a07-46b1-8405-314bcd7f211c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0b43df582c7474aac773f0b73f92f93)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:18.918804 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858b7322-3996-40c0-9164-3a8ca4abaca0 service cinder] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:18.924385 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcce0a3e-2a07-46b1-8405-314bcd7f211c admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:18.945169 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86991250-6bcb-42d7-a53b-616b6591668e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea647438ea1c438987f28cbe39c3ff2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:18.948941 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86991250-6bcb-42d7-a53b-616b6591668e service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:18.954617 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86991250-6bcb-42d7-a53b-616b6591668e service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:18.956263 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86991250-6bcb-42d7-a53b-616b6591668e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:18.975572 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-86991250-6bcb-42d7-a53b-616b6591668e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:19.149666 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-fcce0a3e-2a07-46b1-8405-314bcd7f211c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0b43df582c7474aac773f0b73f92f93', 'request_id': 'req-fcce0a3e-2a07-46b1-8405-314bcd7f211c'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:19.184387 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-fcce0a3e-2a07-46b1-8405-314bcd7f211c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0b43df582c7474aac773f0b73f92f93', 'request_id': 'req-fcce0a3e-2a07-46b1-8405-314bcd7f211c'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:19.229803 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-fcce0a3e-2a07-46b1-8405-314bcd7f211c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0b43df582c7474aac773f0b73f92f93', 'request_id': 'req-fcce0a3e-2a07-46b1-8405-314bcd7f211c'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:19.270783 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-fcce0a3e-2a07-46b1-8405-314bcd7f211c admin admin] The token cache is being invalidate because project e0b43df582c7474aac773f0b73f92f93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:37:19.272964 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-fcce0a3e-2a07-46b1-8405-314bcd7f211c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:19.280201 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-fcce0a3e-2a07-46b1-8405-314bcd7f211c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:19.293231 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 870/1775] 10.222.0.118 () {58 vars in 1237 bytes} [Thu Jul 14 15:37:18 2022] DELETE /identity/v3/projects/e0b43df582c7474aac773f0b73f92f93 => generated 0 bytes in 774 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:37:19.293431 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7349e5-e825-407c-bba5-be88af07ffe9 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:19.300091 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7349e5-e825-407c-bba5-be88af07ffe9 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:19.300695 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7349e5-e825-407c-bba5-be88af07ffe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:19.332401 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86991250-6bcb-42d7-a53b-616b6591668e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:19.339208 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86991250-6bcb-42d7-a53b-616b6591668e service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:19.370406 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-4a7349e5-e825-407c-bba5-be88af07ffe9 None None] MFA Rules not processed for user `b650be8114b64df0ac88441f1c50b2cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:19.375639 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-4a7349e5-e825-407c-bba5-be88af07ffe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:19.380712 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 906/1776] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:37:18 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:37:19.383262 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86991250-6bcb-42d7-a53b-616b6591668e service cinder] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:19.417000 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86991250-6bcb-42d7-a53b-616b6591668e service cinder] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:19.606902 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a350b77e-f45f-438e-8cc1-bc99c7b6abd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:19.607903 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a350b77e-f45f-438e-8cc1-bc99c7b6abd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:19.608212 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a350b77e-f45f-438e-8cc1-bc99c7b6abd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:19.608547 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a350b77e-f45f-438e-8cc1-bc99c7b6abd2 admin admin] PATH_INFO: `/v3/users/9275b214a1f84862902ce10b4c093c75` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:19.612754 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a350b77e-f45f-438e-8cc1-bc99c7b6abd2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9275b214a1f84862902ce10b4c093c75)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:19.614772 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a350b77e-f45f-438e-8cc1-bc99c7b6abd2 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:19.626838 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 871/1777] 10.222.0.55 () {58 vars in 1019 bytes} [Thu Jul 14 15:37:19 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:37:19.655597 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:19.760995 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-a350b77e-f45f-438e-8cc1-bc99c7b6abd2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9275b214a1f84862902ce10b4c093c75'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:19.792815 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-a350b77e-f45f-438e-8cc1-bc99c7b6abd2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9275b214a1f84862902ce10b4c093c75'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:19.794224 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-a350b77e-f45f-438e-8cc1-bc99c7b6abd2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9275b214a1f84862902ce10b4c093c75'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:19.795362 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-a350b77e-f45f-438e-8cc1-bc99c7b6abd2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9275b214a1f84862902ce10b4c093c75'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:19.849215 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7349e5-e825-407c-bba5-be88af07ffe9 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:19.850436 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-a350b77e-f45f-438e-8cc1-bc99c7b6abd2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9275b214a1f84862902ce10b4c093c75'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:19.852242 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-4a7349e5-e825-407c-bba5-be88af07ffe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:19.886466 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7349e5-e825-407c-bba5-be88af07ffe9 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:19.897335 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 907/1778] 10.222.0.118 () {58 vars in 1228 bytes} [Thu Jul 14 15:37:19 2022] DELETE /identity/v3/users/9275b214a1f84862902ce10b4c093c75 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:37:19.906081 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2714c8-749e-4434-a283-1d21fd03e413 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b650be8114b64df0ac88441f1c50b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:19.910501 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2714c8-749e-4434-a283-1d21fd03e413 service neutron] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:19.911629 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2714c8-749e-4434-a283-1d21fd03e413 service neutron] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:19.913161 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2714c8-749e-4434-a283-1d21fd03e413 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:19.927040 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-ba2714c8-749e-4434-a283-1d21fd03e413 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:19.966899 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2714c8-749e-4434-a283-1d21fd03e413 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:19.968801 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2714c8-749e-4434-a283-1d21fd03e413 service neutron] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:20.009457 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 872/1779] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:37:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:37:21.170403 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a329a55f-a138-4c50-adad-330912fd17a6 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:21.171392 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a329a55f-a138-4c50-adad-330912fd17a6 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:21.171392 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a329a55f-a138-4c50-adad-330912fd17a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:21.207815 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-a329a55f-a138-4c50-adad-330912fd17a6 None None] MFA Rules not processed for user `bab083ba82d64af391d09c531b8647e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:21.209069 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-a329a55f-a138-4c50-adad-330912fd17a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:21.382091 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 908/1780] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:37:21 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:37:22.520776 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2714c8-749e-4434-a283-1d21fd03e413 service neutron] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:22.522342 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-ba2714c8-749e-4434-a283-1d21fd03e413 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:22.568236 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a329a55f-a138-4c50-adad-330912fd17a6 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:22.571768 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-a329a55f-a138-4c50-adad-330912fd17a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:22.581941 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2714c8-749e-4434-a283-1d21fd03e413 service neutron] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:22.602917 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:22.817269 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a329a55f-a138-4c50-adad-330912fd17a6 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:22.835510 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b5f556-33c7-4def-b6f9-60e964591470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:22.836421 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b5f556-33c7-4def-b6f9-60e964591470 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:22.836713 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b5f556-33c7-4def-b6f9-60e964591470 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:22.836975 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b5f556-33c7-4def-b6f9-60e964591470 admin admin] PATH_INFO: `/v3/projects/801356030a114ec89ccb46e4dbcd52df` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:22.845577 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b5f556-33c7-4def-b6f9-60e964591470 admin admin] RBAC: Authorizing `identity:delete_project(project_id=801356030a114ec89ccb46e4dbcd52df)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:22.851933 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b5f556-33c7-4def-b6f9-60e964591470 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:22.871664 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f6d121-c2ca-42fa-b1da-73d3d63b1e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:22.873847 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f6d121-c2ca-42fa-b1da-73d3d63b1e1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:22.874463 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f6d121-c2ca-42fa-b1da-73d3d63b1e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:22.879202 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f6d121-c2ca-42fa-b1da-73d3d63b1e1b admin admin] PATH_INFO: `/v3/projects/4f2401d9eacd4654a5645dcc76f5b89b` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:22.881243 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f6d121-c2ca-42fa-b1da-73d3d63b1e1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f2401d9eacd4654a5645dcc76f5b89b)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:22.887381 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f6d121-c2ca-42fa-b1da-73d3d63b1e1b admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:22.996227 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:23.026763 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-43b5f556-33c7-4def-b6f9-60e964591470 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '801356030a114ec89ccb46e4dbcd52df', 'request_id': 'req-43b5f556-33c7-4def-b6f9-60e964591470'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:23.036833 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-43b5f556-33c7-4def-b6f9-60e964591470 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '801356030a114ec89ccb46e4dbcd52df', 'request_id': 'req-43b5f556-33c7-4def-b6f9-60e964591470'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:23.057586 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-43b5f556-33c7-4def-b6f9-60e964591470 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '801356030a114ec89ccb46e4dbcd52df', 'request_id': 'req-43b5f556-33c7-4def-b6f9-60e964591470'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:23.099581 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-43b5f556-33c7-4def-b6f9-60e964591470 admin admin] The token cache is being invalidate because project 801356030a114ec89ccb46e4dbcd52df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:37:23.099802 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-43b5f556-33c7-4def-b6f9-60e964591470 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:23.100519 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-43b5f556-33c7-4def-b6f9-60e964591470 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:23.102686 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 909/1781] 10.222.0.118 () {58 vars in 1237 bytes} [Thu Jul 14 15:37:22 2022] DELETE /identity/v3/projects/801356030a114ec89ccb46e4dbcd52df => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:37:23.109535 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95b8de6-ea58-4dd8-9f61-445e5cb9957f None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:23.109800 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95b8de6-ea58-4dd8-9f61-445e5cb9957f None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:23.110113 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95b8de6-ea58-4dd8-9f61-445e5cb9957f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:23.164628 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-f0f6d121-c2ca-42fa-b1da-73d3d63b1e1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f2401d9eacd4654a5645dcc76f5b89b', 'request_id': 'req-f0f6d121-c2ca-42fa-b1da-73d3d63b1e1b'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:23.181885 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-f0f6d121-c2ca-42fa-b1da-73d3d63b1e1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f2401d9eacd4654a5645dcc76f5b89b', 'request_id': 'req-f0f6d121-c2ca-42fa-b1da-73d3d63b1e1b'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:23.189206 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-a95b8de6-ea58-4dd8-9f61-445e5cb9957f None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:23.196457 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-a95b8de6-ea58-4dd8-9f61-445e5cb9957f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:23.197612 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-f0f6d121-c2ca-42fa-b1da-73d3d63b1e1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f2401d9eacd4654a5645dcc76f5b89b', 'request_id': 'req-f0f6d121-c2ca-42fa-b1da-73d3d63b1e1b'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:23.228552 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-f0f6d121-c2ca-42fa-b1da-73d3d63b1e1b admin admin] The token cache is being invalidate because project 4f2401d9eacd4654a5645dcc76f5b89b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:37:23.229289 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-f0f6d121-c2ca-42fa-b1da-73d3d63b1e1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:23.230436 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-f0f6d121-c2ca-42fa-b1da-73d3d63b1e1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:23.234153 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 873/1782] 10.222.0.118 () {58 vars in 1237 bytes} [Thu Jul 14 15:37:22 2022] DELETE /identity/v3/projects/4f2401d9eacd4654a5645dcc76f5b89b => generated 0 bytes in 714 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:37:23.239344 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f6d121-c2ca-42fa-b1da-73d3d63b1e1b admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:23.241622 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-f0f6d121-c2ca-42fa-b1da-73d3d63b1e1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:23.444913 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 910/1783] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:37:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:37:23.444913 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95b8de6-ea58-4dd8-9f61-445e5cb9957f None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:23.445832 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-a95b8de6-ea58-4dd8-9f61-445e5cb9957f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:23.460940 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f6d121-c2ca-42fa-b1da-73d3d63b1e1b admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:23.472087 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc20bed0-d70d-48c7-851d-41b219c66f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:23.475656 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc20bed0-d70d-48c7-851d-41b219c66f7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:23.476236 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc20bed0-d70d-48c7-851d-41b219c66f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:23.476696 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc20bed0-d70d-48c7-851d-41b219c66f7e admin admin] PATH_INFO: `/v3/users/214ce715c31048f8b24ec1854ca79916` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:23.477876 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95b8de6-ea58-4dd8-9f61-445e5cb9957f None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:23.480880 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc20bed0-d70d-48c7-851d-41b219c66f7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=214ce715c31048f8b24ec1854ca79916)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:23.484038 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc20bed0-d70d-48c7-851d-41b219c66f7e admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:23.490622 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77ccf13-8e37-45dc-a870-3c2f1e7da224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:23.492456 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77ccf13-8e37-45dc-a870-3c2f1e7da224 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:23.492742 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77ccf13-8e37-45dc-a870-3c2f1e7da224 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:23.493000 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77ccf13-8e37-45dc-a870-3c2f1e7da224 admin admin] PATH_INFO: `/v3/users/4fa8444403ea4f59bcf020f3a4b9d532` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:23.494503 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77ccf13-8e37-45dc-a870-3c2f1e7da224 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fa8444403ea4f59bcf020f3a4b9d532)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:23.496990 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77ccf13-8e37-45dc-a870-3c2f1e7da224 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:23.610123 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:23.631016 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-cc20bed0-d70d-48c7-851d-41b219c66f7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '214ce715c31048f8b24ec1854ca79916'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:23.672960 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-cc20bed0-d70d-48c7-851d-41b219c66f7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '214ce715c31048f8b24ec1854ca79916'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:23.673912 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-cc20bed0-d70d-48c7-851d-41b219c66f7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '214ce715c31048f8b24ec1854ca79916'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:23.675426 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-c77ccf13-8e37-45dc-a870-3c2f1e7da224 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fa8444403ea4f59bcf020f3a4b9d532'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:23.677076 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-cc20bed0-d70d-48c7-851d-41b219c66f7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '214ce715c31048f8b24ec1854ca79916'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:23.696374 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-c77ccf13-8e37-45dc-a870-3c2f1e7da224 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fa8444403ea4f59bcf020f3a4b9d532'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:23.697417 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-c77ccf13-8e37-45dc-a870-3c2f1e7da224 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fa8444403ea4f59bcf020f3a4b9d532'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:23.698208 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-c77ccf13-8e37-45dc-a870-3c2f1e7da224 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fa8444403ea4f59bcf020f3a4b9d532'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:23.731886 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-cc20bed0-d70d-48c7-851d-41b219c66f7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '214ce715c31048f8b24ec1854ca79916'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:23.748336 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-c77ccf13-8e37-45dc-a870-3c2f1e7da224 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fa8444403ea4f59bcf020f3a4b9d532'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:23.791033 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 911/1784] 10.222.0.118 () {58 vars in 1228 bytes} [Thu Jul 14 15:37:23 2022] DELETE /identity/v3/users/4fa8444403ea4f59bcf020f3a4b9d532 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:37:23.794343 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 874/1785] 10.222.0.118 () {58 vars in 1228 bytes} [Thu Jul 14 15:37:23 2022] DELETE /identity/v3/users/214ce715c31048f8b24ec1854ca79916 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:37:23.795557 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b74d7d1-5535-4b33-9c0c-f3c55f241163 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:23.795851 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b74d7d1-5535-4b33-9c0c-f3c55f241163 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:23.796185 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b74d7d1-5535-4b33-9c0c-f3c55f241163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:23.796810 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d823da17-7e65-4159-ae6a-f87d50662a29 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:23.797253 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d823da17-7e65-4159-ae6a-f87d50662a29 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:23.800156 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d823da17-7e65-4159-ae6a-f87d50662a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:23.839890 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-d823da17-7e65-4159-ae6a-f87d50662a29 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:23.841715 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-d823da17-7e65-4159-ae6a-f87d50662a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:23.858596 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-1b74d7d1-5535-4b33-9c0c-f3c55f241163 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:23.859884 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-1b74d7d1-5535-4b33-9c0c-f3c55f241163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:23.958401 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:24.060142 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 875/1786] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:37:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:37:24.114943 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 912/1787] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:37:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:37:24.119844 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b74d7d1-5535-4b33-9c0c-f3c55f241163 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:24.142224 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b74d7d1-5535-4b33-9c0c-f3c55f241163 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:24.159731 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51735e8f-4c3c-4cc3-974d-783371ce05bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:24.165676 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51735e8f-4c3c-4cc3-974d-783371ce05bd admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:24.167566 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51735e8f-4c3c-4cc3-974d-783371ce05bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:24.168278 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51735e8f-4c3c-4cc3-974d-783371ce05bd admin admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:24.172295 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51735e8f-4c3c-4cc3-974d-783371ce05bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:37:24.172630 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51735e8f-4c3c-4cc3-974d-783371ce05bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:24.177825 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51735e8f-4c3c-4cc3-974d-783371ce05bd admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:24.219881 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 876/1788] 10.222.0.118 () {58 vars in 1157 bytes} [Thu Jul 14 15:37:24 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:37:24.224560 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d823da17-7e65-4159-ae6a-f87d50662a29 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:24.252030 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d823da17-7e65-4159-ae6a-f87d50662a29 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:24.287960 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991bebad-9f28-40cc-a663-92c964b5e564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:24.289397 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991bebad-9f28-40cc-a663-92c964b5e564 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:24.289892 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991bebad-9f28-40cc-a663-92c964b5e564 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:24.309481 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991bebad-9f28-40cc-a663-92c964b5e564 admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:24.311292 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991bebad-9f28-40cc-a663-92c964b5e564 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:24.320988 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51735e8f-4c3c-4cc3-974d-783371ce05bd admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:24.323000 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-51735e8f-4c3c-4cc3-974d-783371ce05bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:24.329463 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991bebad-9f28-40cc-a663-92c964b5e564 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:24.465056 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 913/1789] 10.222.0.118 () {60 vars in 1157 bytes} [Thu Jul 14 15:37:24 2022] POST /identity/v3/projects => generated 366 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:37:24.466703 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab480998-ab3f-46d7-98c1-78d4b4b4b972 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:24.467054 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab480998-ab3f-46d7-98c1-78d4b4b4b972 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:24.470993 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab480998-ab3f-46d7-98c1-78d4b4b4b972 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:24.480416 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 914/1790] 10.222.0.118 () {54 vars in 926 bytes} [Thu Jul 14 15:37:24 2022] GET /identity => generated 271 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:37:24.486183 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab480998-ab3f-46d7-98c1-78d4b4b4b972 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:24.578592 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51735e8f-4c3c-4cc3-974d-783371ce05bd admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:24.676244 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab480998-ab3f-46d7-98c1-78d4b4b4b972 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:24.685270 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19139cf-1eec-4eab-91d9-cd135b0e7f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:24.686053 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19139cf-1eec-4eab-91d9-cd135b0e7f51 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:24.686358 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19139cf-1eec-4eab-91d9-cd135b0e7f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:24.687749 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19139cf-1eec-4eab-91d9-cd135b0e7f51 admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:24.690942 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19139cf-1eec-4eab-91d9-cd135b0e7f51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:24.693055 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19139cf-1eec-4eab-91d9-cd135b0e7f51 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:24.757492 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d732605-bf74-453c-8ccd-47f13418d808 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b650be8114b64df0ac88441f1c50b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:24.758403 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d732605-bf74-453c-8ccd-47f13418d808 service neutron] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:24.758973 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d732605-bf74-453c-8ccd-47f13418d808 service neutron] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:24.759300 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d732605-bf74-453c-8ccd-47f13418d808 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:24.761425 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 915/1791] 10.222.0.118 () {60 vars in 1148 bytes} [Thu Jul 14 15:37:24 2022] POST /identity/v3/users => generated 284 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:37:24.763304 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96df79e-4d8e-4ce7-bb75-e964ff4cc7b3 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:24.763600 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96df79e-4d8e-4ce7-bb75-e964ff4cc7b3 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:24.763906 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96df79e-4d8e-4ce7-bb75-e964ff4cc7b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:24.787498 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d732605-bf74-453c-8ccd-47f13418d808 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:24.790169 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d732605-bf74-453c-8ccd-47f13418d808 service neutron] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:24.804493 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-f96df79e-4d8e-4ce7-bb75-e964ff4cc7b3 None None] MFA Rules not processed for user `f0177fc696ea40069902803da09f437c`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:24.805761 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-f96df79e-4d8e-4ce7-bb75-e964ff4cc7b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:24.809777 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 877/1792] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:37:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:37:24.810837 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d732605-bf74-453c-8ccd-47f13418d808 service neutron] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:24.820989 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:24.864108 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d732605-bf74-453c-8ccd-47f13418d808 service neutron] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:24.879260 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5caa770-9ae7-4458-a24d-4c8f92e41ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:24.879946 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5caa770-9ae7-4458-a24d-4c8f92e41ad9 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:24.880350 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5caa770-9ae7-4458-a24d-4c8f92e41ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:24.880638 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5caa770-9ae7-4458-a24d-4c8f92e41ad9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:24.883126 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5caa770-9ae7-4458-a24d-4c8f92e41ad9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:24.888679 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5caa770-9ae7-4458-a24d-4c8f92e41ad9 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:24.916369 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 878/1793] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:37:24 2022] GET /identity/v3/roles => generated 1427 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:37:24.920233 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5caa770-9ae7-4458-a24d-4c8f92e41ad9 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:24.980127 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5caa770-9ae7-4458-a24d-4c8f92e41ad9 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:24.981426 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 916/1794] 10.222.0.118 () {58 vars in 1023 bytes} [Thu Jul 14 15:37:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:37:25.010885 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7373b59-6d4b-4f58-bd96-6ced9ed87d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:25.012480 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7373b59-6d4b-4f58-bd96-6ced9ed87d93 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:25.012762 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7373b59-6d4b-4f58-bd96-6ced9ed87d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:25.013155 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7373b59-6d4b-4f58-bd96-6ced9ed87d93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:25.017863 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7373b59-6d4b-4f58-bd96-6ced9ed87d93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:25.022296 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7373b59-6d4b-4f58-bd96-6ced9ed87d93 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:25.054640 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 879/1795] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:37:24 2022] GET /identity/v3/roles => generated 1427 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:37:25.057052 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96df79e-4d8e-4ce7-bb75-e964ff4cc7b3 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:25.094723 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96df79e-4d8e-4ce7-bb75-e964ff4cc7b3 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:25.107048 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3ac08d-9e4f-48a7-a77d-ee1b284b6a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:25.109374 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3ac08d-9e4f-48a7-a77d-ee1b284b6a2d admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:25.111695 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3ac08d-9e4f-48a7-a77d-ee1b284b6a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:25.114848 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3ac08d-9e4f-48a7-a77d-ee1b284b6a2d admin admin] PATH_INFO: `/v3/projects/7655d6b503fc4e83bff56dbd17c98288/users/5466f2d034c746679f61097908a12072/roles/4abcf5e5e7cd4b53ae1828fec6550d53` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:25.198913 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3ac08d-9e4f-48a7-a77d-ee1b284b6a2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7655d6b503fc4e83bff56dbd17c98288, user_id=5466f2d034c746679f61097908a12072, role_id=4abcf5e5e7cd4b53ae1828fec6550d53)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:25.216767 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3ac08d-9e4f-48a7-a77d-ee1b284b6a2d admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:25.296709 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 917/1796] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:37:25 2022] PUT /identity/v3/projects/7655d6b503fc4e83bff56dbd17c98288/users/5466f2d034c746679f61097908a12072/roles/4abcf5e5e7cd4b53ae1828fec6550d53 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:37:25.301383 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd3ac47-88c0-4e87-ac15-3bf2830cc9bc None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:25.301780 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd3ac47-88c0-4e87-ac15-3bf2830cc9bc None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:25.302542 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd3ac47-88c0-4e87-ac15-3bf2830cc9bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:25.419273 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-edd3ac47-88c0-4e87-ac15-3bf2830cc9bc None None] MFA Rules not processed for user `5466f2d034c746679f61097908a12072`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:25.420947 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-edd3ac47-88c0-4e87-ac15-3bf2830cc9bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:25.659893 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 880/1797] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:37:25 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:37:25.664608 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3ac08d-9e4f-48a7-a77d-ee1b284b6a2d admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:25.704524 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:25.833862 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3ac08d-9e4f-48a7-a77d-ee1b284b6a2d admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:25.852033 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0822a50-b4fa-45fc-a5b3-ffeaf4fad960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:25.852956 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0822a50-b4fa-45fc-a5b3-ffeaf4fad960 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:25.853282 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0822a50-b4fa-45fc-a5b3-ffeaf4fad960 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:25.853667 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0822a50-b4fa-45fc-a5b3-ffeaf4fad960 admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:25.854563 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0822a50-b4fa-45fc-a5b3-ffeaf4fad960 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:25.857156 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0822a50-b4fa-45fc-a5b3-ffeaf4fad960 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:25.932104 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 918/1798] 10.222.0.118 () {60 vars in 1157 bytes} [Thu Jul 14 15:37:25 2022] POST /identity/v3/projects => generated 366 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:37:25.933752 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd3ac47-88c0-4e87-ac15-3bf2830cc9bc None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:25.950961 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd3ac47-88c0-4e87-ac15-3bf2830cc9bc None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:26.099688 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3d4754-058a-4b29-add4-5ade1a6f1556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:26.103565 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3d4754-058a-4b29-add4-5ade1a6f1556 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:26.110313 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3d4754-058a-4b29-add4-5ade1a6f1556 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:26.110903 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3d4754-058a-4b29-add4-5ade1a6f1556 admin admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:26.113217 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3d4754-058a-4b29-add4-5ade1a6f1556 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:26.117594 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3d4754-058a-4b29-add4-5ade1a6f1556 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:26.215620 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 881/1799] 10.222.0.118 () {60 vars in 1148 bytes} [Thu Jul 14 15:37:25 2022] POST /identity/v3/users => generated 290 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:37:26.216903 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0822a50-b4fa-45fc-a5b3-ffeaf4fad960 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:26.235150 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3d4754-058a-4b29-add4-5ade1a6f1556 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:26.238151 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0822a50-b4fa-45fc-a5b3-ffeaf4fad960 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:26.242612 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-bf3d4754-058a-4b29-add4-5ade1a6f1556 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:26.269838 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcfd14d-d732-44a0-8177-39dd44ad80bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:26.273994 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcfd14d-d732-44a0-8177-39dd44ad80bd admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:26.276348 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcfd14d-d732-44a0-8177-39dd44ad80bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:26.277794 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcfd14d-d732-44a0-8177-39dd44ad80bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:26.279436 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcfd14d-d732-44a0-8177-39dd44ad80bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:26.285170 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcfd14d-d732-44a0-8177-39dd44ad80bd admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:26.334629 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 919/1800] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:37:26 2022] GET /identity/v3/roles => generated 1427 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:37:26.335842 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcfd14d-d732-44a0-8177-39dd44ad80bd admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:26.367735 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcfd14d-d732-44a0-8177-39dd44ad80bd admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:26.388942 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc1ab59-47b6-44af-a8e2-1b1c798e4435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:26.391232 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc1ab59-47b6-44af-a8e2-1b1c798e4435 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:26.392963 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc1ab59-47b6-44af-a8e2-1b1c798e4435 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:26.394626 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc1ab59-47b6-44af-a8e2-1b1c798e4435 admin admin] PATH_INFO: `/v3/projects/6e5826f30ffa41b08991ad0fe9976eb5/users/851d63ca6b8e42978ef984ae0c1f05c3/roles/3b880cef7dcf4baf87b50f8610c0c56e` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:26.438809 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc1ab59-47b6-44af-a8e2-1b1c798e4435 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e5826f30ffa41b08991ad0fe9976eb5, user_id=851d63ca6b8e42978ef984ae0c1f05c3, role_id=3b880cef7dcf4baf87b50f8610c0c56e)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:26.443060 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc1ab59-47b6-44af-a8e2-1b1c798e4435 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:26.492834 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 920/1801] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:37:26 2022] PUT /identity/v3/projects/6e5826f30ffa41b08991ad0fe9976eb5/users/851d63ca6b8e42978ef984ae0c1f05c3/roles/3b880cef7dcf4baf87b50f8610c0c56e => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:37:26.494191 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc1ab59-47b6-44af-a8e2-1b1c798e4435 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:26.497997 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:26.536767 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3d4754-058a-4b29-add4-5ade1a6f1556 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:26.699076 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc1ab59-47b6-44af-a8e2-1b1c798e4435 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:26.717580 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dadf62f-856e-4fa0-a93f-f2bc99464d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:26.723273 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dadf62f-856e-4fa0-a93f-f2bc99464d2a admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:26.724373 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dadf62f-856e-4fa0-a93f-f2bc99464d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:26.726213 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dadf62f-856e-4fa0-a93f-f2bc99464d2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:26.730475 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dadf62f-856e-4fa0-a93f-f2bc99464d2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:26.730889 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aaa549-e860-4b71-b2d4-4f4467ae03ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0177fc696ea40069902803da09f437c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:26.734466 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aaa549-e860-4b71-b2d4-4f4467ae03ff service nova] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:26.735036 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aaa549-e860-4b71-b2d4-4f4467ae03ff service nova] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:26.735147 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dadf62f-856e-4fa0-a93f-f2bc99464d2a admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:26.736176 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aaa549-e860-4b71-b2d4-4f4467ae03ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:26.753619 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aaa549-e860-4b71-b2d4-4f4467ae03ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:26.754522 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 921/1802] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:37:26 2022] GET /identity/v3/roles => generated 1427 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:37:26.758979 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dadf62f-856e-4fa0-a93f-f2bc99464d2a admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:26.763771 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aaa549-e860-4b71-b2d4-4f4467ae03ff service nova] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:26.797177 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 882/1803] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:37:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 562 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:37:26.798902 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dadf62f-856e-4fa0-a93f-f2bc99464d2a admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:26.808443 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4e10c3-40ca-46c0-8353-4691a8572a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:26.809518 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4e10c3-40ca-46c0-8353-4691a8572a15 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:26.809848 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4e10c3-40ca-46c0-8353-4691a8572a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:26.810261 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4e10c3-40ca-46c0-8353-4691a8572a15 admin admin] PATH_INFO: `/v3/projects/6e5826f30ffa41b08991ad0fe9976eb5/users/851d63ca6b8e42978ef984ae0c1f05c3/roles/3b880cef7dcf4baf87b50f8610c0c56e` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:26.814471 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4e10c3-40ca-46c0-8353-4691a8572a15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e5826f30ffa41b08991ad0fe9976eb5, user_id=851d63ca6b8e42978ef984ae0c1f05c3, role_id=3b880cef7dcf4baf87b50f8610c0c56e)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:26.819587 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4e10c3-40ca-46c0-8353-4691a8572a15 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:26.843735 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 922/1804] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:37:26 2022] PUT /identity/v3/projects/6e5826f30ffa41b08991ad0fe9976eb5/users/851d63ca6b8e42978ef984ae0c1f05c3/roles/3b880cef7dcf4baf87b50f8610c0c56e => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:37:26.855378 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d182c14-6ab7-4bab-b18c-e04be36ac678 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:26.855806 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d182c14-6ab7-4bab-b18c-e04be36ac678 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:26.856003 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d182c14-6ab7-4bab-b18c-e04be36ac678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:26.894458 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-5d182c14-6ab7-4bab-b18c-e04be36ac678 None None] MFA Rules not processed for user `851d63ca6b8e42978ef984ae0c1f05c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:26.895865 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-5d182c14-6ab7-4bab-b18c-e04be36ac678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:27.028096 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 883/1805] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:37:26 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:37:27.046923 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4e10c3-40ca-46c0-8353-4691a8572a15 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:27.048956 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-3f4e10c3-40ca-46c0-8353-4691a8572a15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:27.315950 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:27.327087 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4e10c3-40ca-46c0-8353-4691a8572a15 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:27.351128 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57c0352-c317-4548-bb64-36307a650aab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea647438ea1c438987f28cbe39c3ff2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:27.351896 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c0352-c317-4548-bb64-36307a650aab service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:27.352184 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c0352-c317-4548-bb64-36307a650aab service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:27.352489 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c0352-c317-4548-bb64-36307a650aab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:27.382499 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57c0352-c317-4548-bb64-36307a650aab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:27.382499 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57c0352-c317-4548-bb64-36307a650aab service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:27.393374 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 923/1806] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:37:27 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:37:27.519009 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d182c14-6ab7-4bab-b18c-e04be36ac678 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:27.548903 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d182c14-6ab7-4bab-b18c-e04be36ac678 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:27.558507 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9319882-26be-4d5c-a454-d32ac6657dee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea647438ea1c438987f28cbe39c3ff2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:27.559188 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9319882-26be-4d5c-a454-d32ac6657dee service cinder] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:27.559470 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9319882-26be-4d5c-a454-d32ac6657dee service cinder] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:27.559746 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9319882-26be-4d5c-a454-d32ac6657dee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:27.657466 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9319882-26be-4d5c-a454-d32ac6657dee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:27.660586 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9319882-26be-4d5c-a454-d32ac6657dee service cinder] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:27.675423 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 884/1807] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:37:27 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:37:28.102248 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb18955-0110-438c-b48e-5756125aa652 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:28.102824 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb18955-0110-438c-b48e-5756125aa652 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:28.102824 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb18955-0110-438c-b48e-5756125aa652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:28.150651 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-4fb18955-0110-438c-b48e-5756125aa652 None None] MFA Rules not processed for user `34f09b2afbe54a6ab1ba27292bc5a964`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:28.151928 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-4fb18955-0110-438c-b48e-5756125aa652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:28.381023 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 924/1808] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:37:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:37:28.821822 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9319882-26be-4d5c-a454-d32ac6657dee service cinder] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:28.824411 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-f9319882-26be-4d5c-a454-d32ac6657dee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:28.864534 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:29.057306 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9319882-26be-4d5c-a454-d32ac6657dee service cinder] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:29.080628 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c84439a-aa51-45f2-9c50-cab92dd0ecec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:29.081564 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c84439a-aa51-45f2-9c50-cab92dd0ecec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:29.081850 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c84439a-aa51-45f2-9c50-cab92dd0ecec admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:29.082148 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c84439a-aa51-45f2-9c50-cab92dd0ecec admin admin] PATH_INFO: `/v3/projects/cf50ef78dd0c455db8de3becb98bb926` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:29.091217 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c84439a-aa51-45f2-9c50-cab92dd0ecec admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf50ef78dd0c455db8de3becb98bb926)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:29.093201 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c84439a-aa51-45f2-9c50-cab92dd0ecec admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:29.259625 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-3c84439a-aa51-45f2-9c50-cab92dd0ecec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf50ef78dd0c455db8de3becb98bb926', 'request_id': 'req-3c84439a-aa51-45f2-9c50-cab92dd0ecec'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:29.298594 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-3c84439a-aa51-45f2-9c50-cab92dd0ecec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf50ef78dd0c455db8de3becb98bb926', 'request_id': 'req-3c84439a-aa51-45f2-9c50-cab92dd0ecec'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:29.343861 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-3c84439a-aa51-45f2-9c50-cab92dd0ecec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf50ef78dd0c455db8de3becb98bb926', 'request_id': 'req-3c84439a-aa51-45f2-9c50-cab92dd0ecec'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:29.405416 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-3c84439a-aa51-45f2-9c50-cab92dd0ecec admin admin] The token cache is being invalidate because project cf50ef78dd0c455db8de3becb98bb926 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:37:29.418484 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-3c84439a-aa51-45f2-9c50-cab92dd0ecec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:29.419501 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-3c84439a-aa51-45f2-9c50-cab92dd0ecec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:29.427773 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 885/1809] 10.222.0.118 () {58 vars in 1237 bytes} [Thu Jul 14 15:37:28 2022] DELETE /identity/v3/projects/cf50ef78dd0c455db8de3becb98bb926 => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:37:29.431816 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb18955-0110-438c-b48e-5756125aa652 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:29.458921 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb18955-0110-438c-b48e-5756125aa652 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:29.816896 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c82521-d5f2-4cbc-b741-cce2abe68c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:29.819183 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c82521-d5f2-4cbc-b741-cce2abe68c2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:29.819976 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c82521-d5f2-4cbc-b741-cce2abe68c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:29.820513 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c82521-d5f2-4cbc-b741-cce2abe68c2b admin admin] PATH_INFO: `/v3/users/ff0087f20b7b43498f56a0c904e90627` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:29.842432 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c82521-d5f2-4cbc-b741-cce2abe68c2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff0087f20b7b43498f56a0c904e90627)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:29.844967 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c82521-d5f2-4cbc-b741-cce2abe68c2b admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:30.058551 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-44c82521-d5f2-4cbc-b741-cce2abe68c2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff0087f20b7b43498f56a0c904e90627'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:30.091599 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-44c82521-d5f2-4cbc-b741-cce2abe68c2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff0087f20b7b43498f56a0c904e90627'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:30.092383 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-44c82521-d5f2-4cbc-b741-cce2abe68c2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff0087f20b7b43498f56a0c904e90627'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:30.103501 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-44c82521-d5f2-4cbc-b741-cce2abe68c2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff0087f20b7b43498f56a0c904e90627'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:30.150770 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-44c82521-d5f2-4cbc-b741-cce2abe68c2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff0087f20b7b43498f56a0c904e90627'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:30.192716 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 925/1810] 10.222.0.118 () {58 vars in 1228 bytes} [Thu Jul 14 15:37:29 2022] DELETE /identity/v3/users/ff0087f20b7b43498f56a0c904e90627 => generated 0 bytes in 760 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:37:30.744816 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04621059-fddd-4415-8430-50c77456532b None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:30.745370 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04621059-fddd-4415-8430-50c77456532b None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:30.745370 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04621059-fddd-4415-8430-50c77456532b None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:30.746792 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 886/1811] 10.222.0.118 () {54 vars in 926 bytes} [Thu Jul 14 15:37:30 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:37:30.804094 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc6909-3ea1-47f2-9427-09634950d2e2 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:30.804987 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc6909-3ea1-47f2-9427-09634950d2e2 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:30.805394 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc6909-3ea1-47f2-9427-09634950d2e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:30.839682 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-d0fc6909-3ea1-47f2-9427-09634950d2e2 None None] MFA Rules not processed for user `f0177fc696ea40069902803da09f437c`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:30.848398 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-d0fc6909-3ea1-47f2-9427-09634950d2e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:30.881612 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:31.016823 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 926/1812] 10.222.0.118 () {58 vars in 1023 bytes} [Thu Jul 14 15:37:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:37:31.030097 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04621059-fddd-4415-8430-50c77456532b None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:31.032086 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-04621059-fddd-4415-8430-50c77456532b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:31.104172 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fc6909-3ea1-47f2-9427-09634950d2e2 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:31.106199 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-d0fc6909-3ea1-47f2-9427-09634950d2e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:31.306871 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fc6909-3ea1-47f2-9427-09634950d2e2 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:31.311621 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04621059-fddd-4415-8430-50c77456532b None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:31.315234 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a70464d-b808-4674-864c-420ce6b0a274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:31.316420 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a70464d-b808-4674-864c-420ce6b0a274 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:31.316756 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a70464d-b808-4674-864c-420ce6b0a274 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:31.317084 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a70464d-b808-4674-864c-420ce6b0a274 admin admin] PATH_INFO: `/v3/projects/ecd835230ca34bf4b7e7c538940427b1` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:31.318959 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a70464d-b808-4674-864c-420ce6b0a274 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecd835230ca34bf4b7e7c538940427b1)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:31.321732 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a70464d-b808-4674-864c-420ce6b0a274 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:31.329810 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05d1e0e-1455-40e8-8762-4d0fb686e545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:31.333885 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05d1e0e-1455-40e8-8762-4d0fb686e545 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:31.334286 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05d1e0e-1455-40e8-8762-4d0fb686e545 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:31.334622 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05d1e0e-1455-40e8-8762-4d0fb686e545 admin admin] PATH_INFO: `/v3/projects/03fba6cd7c2b42f9b4bce0dd1deeb532` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:31.338209 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05d1e0e-1455-40e8-8762-4d0fb686e545 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03fba6cd7c2b42f9b4bce0dd1deeb532)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:31.340151 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05d1e0e-1455-40e8-8762-4d0fb686e545 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:31.454233 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:31.459082 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-9a70464d-b808-4674-864c-420ce6b0a274 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecd835230ca34bf4b7e7c538940427b1', 'request_id': 'req-9a70464d-b808-4674-864c-420ce6b0a274'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:31.469444 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-c05d1e0e-1455-40e8-8762-4d0fb686e545 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03fba6cd7c2b42f9b4bce0dd1deeb532', 'request_id': 'req-c05d1e0e-1455-40e8-8762-4d0fb686e545'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:31.472015 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-9a70464d-b808-4674-864c-420ce6b0a274 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecd835230ca34bf4b7e7c538940427b1', 'request_id': 'req-9a70464d-b808-4674-864c-420ce6b0a274'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:31.490242 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-c05d1e0e-1455-40e8-8762-4d0fb686e545 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03fba6cd7c2b42f9b4bce0dd1deeb532', 'request_id': 'req-c05d1e0e-1455-40e8-8762-4d0fb686e545'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:31.492809 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-9a70464d-b808-4674-864c-420ce6b0a274 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecd835230ca34bf4b7e7c538940427b1', 'request_id': 'req-9a70464d-b808-4674-864c-420ce6b0a274'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:31.499910 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-c05d1e0e-1455-40e8-8762-4d0fb686e545 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03fba6cd7c2b42f9b4bce0dd1deeb532', 'request_id': 'req-c05d1e0e-1455-40e8-8762-4d0fb686e545'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:31.515905 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-9a70464d-b808-4674-864c-420ce6b0a274 admin admin] The token cache is being invalidate because project ecd835230ca34bf4b7e7c538940427b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:37:31.516515 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-9a70464d-b808-4674-864c-420ce6b0a274 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:31.517505 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-9a70464d-b808-4674-864c-420ce6b0a274 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:31.519954 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-c05d1e0e-1455-40e8-8762-4d0fb686e545 admin admin] The token cache is being invalidate because project 03fba6cd7c2b42f9b4bce0dd1deeb532 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:37:31.520341 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-c05d1e0e-1455-40e8-8762-4d0fb686e545 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:31.520741 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 927/1813] 10.222.0.118 () {58 vars in 1237 bytes} [Thu Jul 14 15:37:31 2022] DELETE /identity/v3/projects/ecd835230ca34bf4b7e7c538940427b1 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:37:31.521043 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-c05d1e0e-1455-40e8-8762-4d0fb686e545 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:31.522988 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 887/1814] 10.222.0.118 () {58 vars in 1237 bytes} [Thu Jul 14 15:37:31 2022] DELETE /identity/v3/projects/03fba6cd7c2b42f9b4bce0dd1deeb532 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:37:31.527642 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb74eb8-c0a3-439e-bd58-1f7a316687e6 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:31.528175 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb74eb8-c0a3-439e-bd58-1f7a316687e6 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:31.528633 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb74eb8-c0a3-439e-bd58-1f7a316687e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:31.528736 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05d1e0e-1455-40e8-8762-4d0fb686e545 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:31.531302 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-c05d1e0e-1455-40e8-8762-4d0fb686e545 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:31.592627 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-beb74eb8-c0a3-439e-bd58-1f7a316687e6 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:31.598464 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-beb74eb8-c0a3-439e-bd58-1f7a316687e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:31.681082 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05d1e0e-1455-40e8-8762-4d0fb686e545 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:31.687637 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008f2e18-1d51-403d-b715-9b3bd89dab2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:31.689365 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008f2e18-1d51-403d-b715-9b3bd89dab2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:31.690764 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008f2e18-1d51-403d-b715-9b3bd89dab2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:31.692171 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008f2e18-1d51-403d-b715-9b3bd89dab2b admin admin] PATH_INFO: `/v3/users/75a1230262694b989380d70262c71d0f` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:31.694770 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008f2e18-1d51-403d-b715-9b3bd89dab2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=75a1230262694b989380d70262c71d0f)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:31.698599 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008f2e18-1d51-403d-b715-9b3bd89dab2b admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:31.717114 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:31.805591 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 928/1815] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:37:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:37:31.806736 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb74eb8-c0a3-439e-bd58-1f7a316687e6 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:31.812867 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-beb74eb8-c0a3-439e-bd58-1f7a316687e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:31.855278 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-008f2e18-1d51-403d-b715-9b3bd89dab2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75a1230262694b989380d70262c71d0f'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:31.874147 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-008f2e18-1d51-403d-b715-9b3bd89dab2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75a1230262694b989380d70262c71d0f'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:31.878399 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-008f2e18-1d51-403d-b715-9b3bd89dab2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75a1230262694b989380d70262c71d0f'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:31.883679 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-008f2e18-1d51-403d-b715-9b3bd89dab2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75a1230262694b989380d70262c71d0f'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:31.905998 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-008f2e18-1d51-403d-b715-9b3bd89dab2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75a1230262694b989380d70262c71d0f'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:31.935862 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 888/1816] 10.222.0.118 () {58 vars in 1228 bytes} [Thu Jul 14 15:37:31 2022] DELETE /identity/v3/users/75a1230262694b989380d70262c71d0f => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:37:31.938640 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26acef7-8807-469b-b63a-2854c7816240 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:31.938808 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26acef7-8807-469b-b63a-2854c7816240 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:31.939353 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26acef7-8807-469b-b63a-2854c7816240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:31.977102 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-f26acef7-8807-469b-b63a-2854c7816240 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:31.980630 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-f26acef7-8807-469b-b63a-2854c7816240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:32.009868 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb74eb8-c0a3-439e-bd58-1f7a316687e6 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:32.117510 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:32.165631 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 889/1817] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:37:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:37:32.171185 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26acef7-8807-469b-b63a-2854c7816240 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:32.201036 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26acef7-8807-469b-b63a-2854c7816240 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:32.211836 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8e1709-868a-44dd-a182-d59d7e88ee98 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0177fc696ea40069902803da09f437c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:32.213241 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8e1709-868a-44dd-a182-d59d7e88ee98 service nova] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:32.213939 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8e1709-868a-44dd-a182-d59d7e88ee98 service nova] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:32.215059 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8e1709-868a-44dd-a182-d59d7e88ee98 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:32.217532 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0ce8cf-87dd-4963-a76f-4da6219caf67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:32.218713 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ce8cf-87dd-4963-a76f-4da6219caf67 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:32.218999 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ce8cf-87dd-4963-a76f-4da6219caf67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:32.219368 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ce8cf-87dd-4963-a76f-4da6219caf67 admin admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:32.220823 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0ce8cf-87dd-4963-a76f-4da6219caf67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:37:32.220957 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-8c8e1709-868a-44dd-a182-d59d7e88ee98 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:32.221170 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0ce8cf-87dd-4963-a76f-4da6219caf67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:32.222992 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0ce8cf-87dd-4963-a76f-4da6219caf67 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:32.241494 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 890/1818] 10.222.0.118 () {58 vars in 1157 bytes} [Thu Jul 14 15:37:32 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:37:32.246302 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0ce8cf-87dd-4963-a76f-4da6219caf67 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:32.271442 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0ce8cf-87dd-4963-a76f-4da6219caf67 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:32.281765 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8e1709-868a-44dd-a182-d59d7e88ee98 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:32.285304 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8e1709-868a-44dd-a182-d59d7e88ee98 service nova] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:32.288761 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b594f7-22c7-44ad-af00-b96e285d2418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:32.289222 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b594f7-22c7-44ad-af00-b96e285d2418 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:32.289508 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b594f7-22c7-44ad-af00-b96e285d2418 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:32.290242 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b594f7-22c7-44ad-af00-b96e285d2418 admin admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:32.291009 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b594f7-22c7-44ad-af00-b96e285d2418 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:32.300027 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b594f7-22c7-44ad-af00-b96e285d2418 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:32.317255 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 929/1819] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:37:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:37:32.375143 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 891/1820] 10.222.0.118 () {60 vars in 1157 bytes} [Thu Jul 14 15:37:32 2022] POST /identity/v3/projects => generated 388 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:37:32.379969 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8e1709-868a-44dd-a182-d59d7e88ee98 service nova] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:32.393576 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8e1709-868a-44dd-a182-d59d7e88ee98 service nova] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:32.548034 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0fc5e6-3501-4149-bb50-d9984ce1b8a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:32.548796 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0fc5e6-3501-4149-bb50-d9984ce1b8a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:32.549126 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0fc5e6-3501-4149-bb50-d9984ce1b8a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:32.549584 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0fc5e6-3501-4149-bb50-d9984ce1b8a4 admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:32.550344 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0fc5e6-3501-4149-bb50-d9984ce1b8a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:32.553788 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0fc5e6-3501-4149-bb50-d9984ce1b8a4 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:32.576685 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:32.608684 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 930/1821] 10.222.0.118 () {60 vars in 1148 bytes} [Thu Jul 14 15:37:32 2022] POST /identity/v3/users => generated 295 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:37:32.613290 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b594f7-22c7-44ad-af00-b96e285d2418 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:32.641315 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b594f7-22c7-44ad-af00-b96e285d2418 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:32.651264 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c167b2db-60d0-461e-9132-2fa4a30caa2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:32.652763 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c167b2db-60d0-461e-9132-2fa4a30caa2d admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:32.654218 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c167b2db-60d0-461e-9132-2fa4a30caa2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:32.654624 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c167b2db-60d0-461e-9132-2fa4a30caa2d admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:32.656202 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c167b2db-60d0-461e-9132-2fa4a30caa2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:32.658737 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c167b2db-60d0-461e-9132-2fa4a30caa2d admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:32.678022 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 892/1822] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:37:32 2022] GET /identity/v3/roles => generated 1427 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:37:32.683241 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0fc5e6-3501-4149-bb50-d9984ce1b8a4 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:32.700864 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0fc5e6-3501-4149-bb50-d9984ce1b8a4 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:32.707376 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc5c000-e51c-44a4-b35d-153220307fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:32.708176 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc5c000-e51c-44a4-b35d-153220307fbe admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:32.708546 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc5c000-e51c-44a4-b35d-153220307fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:32.708913 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc5c000-e51c-44a4-b35d-153220307fbe admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:32.709830 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc5c000-e51c-44a4-b35d-153220307fbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:32.713460 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc5c000-e51c-44a4-b35d-153220307fbe admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:32.728338 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 931/1823] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:37:32 2022] GET /identity/v3/roles => generated 1427 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:37:32.733419 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c167b2db-60d0-461e-9132-2fa4a30caa2d admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:32.746582 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c167b2db-60d0-461e-9132-2fa4a30caa2d admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:32.751994 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dbef28-a5f0-46b4-8713-fb45e65b2c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:32.753464 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dbef28-a5f0-46b4-8713-fb45e65b2c06 admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:32.753838 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dbef28-a5f0-46b4-8713-fb45e65b2c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:32.754065 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dbef28-a5f0-46b4-8713-fb45e65b2c06 admin admin] PATH_INFO: `/v3/projects/b9f8ca8cbe52409a9708b1382888c2f4/users/1154b9ce425e43948db118071b64db70/roles/4abcf5e5e7cd4b53ae1828fec6550d53` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:32.773463 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dbef28-a5f0-46b4-8713-fb45e65b2c06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9f8ca8cbe52409a9708b1382888c2f4, user_id=1154b9ce425e43948db118071b64db70, role_id=4abcf5e5e7cd4b53ae1828fec6550d53)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:32.777300 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dbef28-a5f0-46b4-8713-fb45e65b2c06 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:32.808587 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 893/1824] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:37:32 2022] PUT /identity/v3/projects/b9f8ca8cbe52409a9708b1382888c2f4/users/1154b9ce425e43948db118071b64db70/roles/4abcf5e5e7cd4b53ae1828fec6550d53 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:37:32.811357 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cac600-6998-4043-b94b-e0ede1a1bebf None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:32.811864 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cac600-6998-4043-b94b-e0ede1a1bebf None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:32.812040 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cac600-6998-4043-b94b-e0ede1a1bebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:32.821815 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dbef28-a5f0-46b4-8713-fb45e65b2c06 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:32.824177 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-74dbef28-a5f0-46b4-8713-fb45e65b2c06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:32.890809 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-24cac600-6998-4043-b94b-e0ede1a1bebf None None] MFA Rules not processed for user `1154b9ce425e43948db118071b64db70`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:32.892409 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-24cac600-6998-4043-b94b-e0ede1a1bebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:32.993030 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 932/1825] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:37:32 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:37:32.999065 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cac600-6998-4043-b94b-e0ede1a1bebf None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:33.005430 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dbef28-a5f0-46b4-8713-fb45e65b2c06 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:33.014558 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cac600-6998-4043-b94b-e0ede1a1bebf None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:33.022066 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a30f8c7-2099-4b8f-bc53-02a13527cb5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:33.022963 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a30f8c7-2099-4b8f-bc53-02a13527cb5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:33.023246 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a30f8c7-2099-4b8f-bc53-02a13527cb5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:33.023523 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a30f8c7-2099-4b8f-bc53-02a13527cb5b admin admin] PATH_INFO: `/v3/projects/b6235a0ac1324e66a435b083aa1882e1` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:33.027617 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a30f8c7-2099-4b8f-bc53-02a13527cb5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6235a0ac1324e66a435b083aa1882e1)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:33.029581 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a30f8c7-2099-4b8f-bc53-02a13527cb5b admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:33.034045 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9778ffc5-1092-456b-9eb7-caab352578d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:33.039433 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9778ffc5-1092-456b-9eb7-caab352578d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:33.039902 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9778ffc5-1092-456b-9eb7-caab352578d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:33.040126 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9778ffc5-1092-456b-9eb7-caab352578d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:33.043814 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9778ffc5-1092-456b-9eb7-caab352578d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:33.047469 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9778ffc5-1092-456b-9eb7-caab352578d6 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:33.124670 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 933/1826] 10.222.0.118 () {60 vars in 1157 bytes} [Thu Jul 14 15:37:32 2022] POST /identity/v3/projects => generated 386 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:37:33.127267 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9778ffc5-1092-456b-9eb7-caab352578d6 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:33.139671 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-7a30f8c7-2099-4b8f-bc53-02a13527cb5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6235a0ac1324e66a435b083aa1882e1', 'request_id': 'req-7a30f8c7-2099-4b8f-bc53-02a13527cb5b'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:33.156327 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-7a30f8c7-2099-4b8f-bc53-02a13527cb5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6235a0ac1324e66a435b083aa1882e1', 'request_id': 'req-7a30f8c7-2099-4b8f-bc53-02a13527cb5b'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:33.170322 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-7a30f8c7-2099-4b8f-bc53-02a13527cb5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6235a0ac1324e66a435b083aa1882e1', 'request_id': 'req-7a30f8c7-2099-4b8f-bc53-02a13527cb5b'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:33.201502 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-7a30f8c7-2099-4b8f-bc53-02a13527cb5b admin admin] The token cache is being invalidate because project b6235a0ac1324e66a435b083aa1882e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:37:33.201839 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-7a30f8c7-2099-4b8f-bc53-02a13527cb5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:33.204734 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-7a30f8c7-2099-4b8f-bc53-02a13527cb5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:33.210521 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 894/1827] 10.222.0.118 () {58 vars in 1237 bytes} [Thu Jul 14 15:37:32 2022] DELETE /identity/v3/projects/b6235a0ac1324e66a435b083aa1882e1 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:37:33.212490 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9137bd-e5a3-448d-ad23-e5e37451cace None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:33.212898 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9137bd-e5a3-448d-ad23-e5e37451cace None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:33.213247 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9137bd-e5a3-448d-ad23-e5e37451cace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:33.248156 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9778ffc5-1092-456b-9eb7-caab352578d6 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:33.248464 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0649a19-717a-4eed-a1aa-e125d8d8405e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:33.249163 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0649a19-717a-4eed-a1aa-e125d8d8405e admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:33.249440 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0649a19-717a-4eed-a1aa-e125d8d8405e admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:33.249714 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0649a19-717a-4eed-a1aa-e125d8d8405e admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:33.251309 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0649a19-717a-4eed-a1aa-e125d8d8405e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:33.253478 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0649a19-717a-4eed-a1aa-e125d8d8405e admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:33.284580 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 934/1828] 10.222.0.118 () {60 vars in 1148 bytes} [Thu Jul 14 15:37:33 2022] POST /identity/v3/users => generated 300 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:37:33.288794 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0649a19-717a-4eed-a1aa-e125d8d8405e admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:33.290875 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-a0649a19-717a-4eed-a1aa-e125d8d8405e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:33.291422 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-2e9137bd-e5a3-448d-ad23-e5e37451cace None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:33.294587 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-2e9137bd-e5a3-448d-ad23-e5e37451cace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:33.308053 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0649a19-717a-4eed-a1aa-e125d8d8405e admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:33.308447 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 895/1829] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:37:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:37:33.313246 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377bc47c-2305-446b-8b78-68d80becef05 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:33.313530 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377bc47c-2305-446b-8b78-68d80becef05 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:33.313807 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377bc47c-2305-446b-8b78-68d80becef05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:33.322162 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a25b3a-799a-4174-97e3-265db7c0ab39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:33.322965 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a25b3a-799a-4174-97e3-265db7c0ab39 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:33.323250 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a25b3a-799a-4174-97e3-265db7c0ab39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:33.323529 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a25b3a-799a-4174-97e3-265db7c0ab39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:33.324271 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a25b3a-799a-4174-97e3-265db7c0ab39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:33.325941 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a25b3a-799a-4174-97e3-265db7c0ab39 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:33.328498 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:33.345829 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 935/1830] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:37:33 2022] GET /identity/v3/roles => generated 1427 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:37:33.347690 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a25b3a-799a-4174-97e3-265db7c0ab39 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:33.359036 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-377bc47c-2305-446b-8b78-68d80becef05 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:33.361172 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-377bc47c-2305-446b-8b78-68d80becef05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:33.365264 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a25b3a-799a-4174-97e3-265db7c0ab39 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:33.370979 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfbd035-37be-4359-88c4-6369c8f8d220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:33.372353 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfbd035-37be-4359-88c4-6369c8f8d220 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:33.372858 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfbd035-37be-4359-88c4-6369c8f8d220 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:33.374237 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfbd035-37be-4359-88c4-6369c8f8d220 admin admin] PATH_INFO: `/v3/projects/4cdd08d239f34e568802d60e7ce6c23d/users/455be9a2aac544cf8a230bbde3c0f3b0/roles/3b880cef7dcf4baf87b50f8610c0c56e` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:33.379843 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 896/1831] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:37:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:37:33.384723 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377bc47c-2305-446b-8b78-68d80becef05 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:33.399261 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377bc47c-2305-446b-8b78-68d80becef05 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:33.402508 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfbd035-37be-4359-88c4-6369c8f8d220 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cdd08d239f34e568802d60e7ce6c23d, user_id=455be9a2aac544cf8a230bbde3c0f3b0, role_id=3b880cef7dcf4baf87b50f8610c0c56e)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:33.403971 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cba9b41-eb60-4323-b1fd-51fbb6547e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:33.404639 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cba9b41-eb60-4323-b1fd-51fbb6547e5b admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:33.404969 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cba9b41-eb60-4323-b1fd-51fbb6547e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:33.405246 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cba9b41-eb60-4323-b1fd-51fbb6547e5b admin admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:33.406002 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cba9b41-eb60-4323-b1fd-51fbb6547e5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:37:33.406312 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cba9b41-eb60-4323-b1fd-51fbb6547e5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:33.407921 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cba9b41-eb60-4323-b1fd-51fbb6547e5b admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:33.414488 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfbd035-37be-4359-88c4-6369c8f8d220 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:33.426133 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 897/1832] 10.222.0.118 () {58 vars in 1157 bytes} [Thu Jul 14 15:37:33 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:37:33.429170 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cba9b41-eb60-4323-b1fd-51fbb6547e5b admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:33.438089 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 936/1833] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:37:33 2022] PUT /identity/v3/projects/4cdd08d239f34e568802d60e7ce6c23d/users/455be9a2aac544cf8a230bbde3c0f3b0/roles/3b880cef7dcf4baf87b50f8610c0c56e => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:37:33.443104 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfbd035-37be-4359-88c4-6369c8f8d220 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:33.444411 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cba9b41-eb60-4323-b1fd-51fbb6547e5b admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:33.458971 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:33.546231 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c03a089-ee82-47ef-9fd6-ff7e665c2488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:33.546486 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfbd035-37be-4359-88c4-6369c8f8d220 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:33.546959 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c03a089-ee82-47ef-9fd6-ff7e665c2488 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:33.547186 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c03a089-ee82-47ef-9fd6-ff7e665c2488 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:33.547465 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c03a089-ee82-47ef-9fd6-ff7e665c2488 admin admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:33.548167 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c03a089-ee82-47ef-9fd6-ff7e665c2488 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:33.550283 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c03a089-ee82-47ef-9fd6-ff7e665c2488 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:33.553575 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a055a573-9742-4070-92dd-6df5c729063a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:33.554495 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a055a573-9742-4070-92dd-6df5c729063a admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:33.554777 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a055a573-9742-4070-92dd-6df5c729063a admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:33.555047 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a055a573-9742-4070-92dd-6df5c729063a admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:33.555786 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a055a573-9742-4070-92dd-6df5c729063a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:33.557701 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a055a573-9742-4070-92dd-6df5c729063a admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:33.576046 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 937/1834] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:37:33 2022] GET /identity/v3/roles => generated 1427 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:37:33.576839 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a055a573-9742-4070-92dd-6df5c729063a admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:33.585528 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 898/1835] 10.222.0.118 () {60 vars in 1157 bytes} [Thu Jul 14 15:37:33 2022] POST /identity/v3/projects => generated 382 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:37:33.592025 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c03a089-ee82-47ef-9fd6-ff7e665c2488 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:33.598161 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a055a573-9742-4070-92dd-6df5c729063a admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:33.742350 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c03a089-ee82-47ef-9fd6-ff7e665c2488 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:33.755766 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3e583c-1eae-4f14-b67e-36f1fa86f16a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:33.759982 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3e583c-1eae-4f14-b67e-36f1fa86f16a admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:33.762243 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3e583c-1eae-4f14-b67e-36f1fa86f16a admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:33.762877 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3e583c-1eae-4f14-b67e-36f1fa86f16a admin admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:33.763954 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3e583c-1eae-4f14-b67e-36f1fa86f16a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:33.768037 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3e583c-1eae-4f14-b67e-36f1fa86f16a admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:33.775821 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb9d54c-8233-4668-b8a6-633c858faa99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:33.776910 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb9d54c-8233-4668-b8a6-633c858faa99 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:33.778198 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb9d54c-8233-4668-b8a6-633c858faa99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:33.780142 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb9d54c-8233-4668-b8a6-633c858faa99 admin admin] PATH_INFO: `/v3/projects/4cdd08d239f34e568802d60e7ce6c23d/users/455be9a2aac544cf8a230bbde3c0f3b0/roles/3b880cef7dcf4baf87b50f8610c0c56e` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:33.786547 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb9d54c-8233-4668-b8a6-633c858faa99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cdd08d239f34e568802d60e7ce6c23d, user_id=455be9a2aac544cf8a230bbde3c0f3b0, role_id=3b880cef7dcf4baf87b50f8610c0c56e)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:33.793078 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb9d54c-8233-4668-b8a6-633c858faa99 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:33.797391 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 899/1836] 10.222.0.118 () {60 vars in 1148 bytes} [Thu Jul 14 15:37:33 2022] POST /identity/v3/users => generated 292 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:37:33.798846 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3e583c-1eae-4f14-b67e-36f1fa86f16a admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:33.811614 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3e583c-1eae-4f14-b67e-36f1fa86f16a admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:33.816914 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 938/1837] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:37:33 2022] PUT /identity/v3/projects/4cdd08d239f34e568802d60e7ce6c23d/users/455be9a2aac544cf8a230bbde3c0f3b0/roles/3b880cef7dcf4baf87b50f8610c0c56e => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:37:33.829749 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4409c10-6a87-4b20-b95f-920bf795c216 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:33.830092 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4409c10-6a87-4b20-b95f-920bf795c216 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:33.830869 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4409c10-6a87-4b20-b95f-920bf795c216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:33.881242 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-b4409c10-6a87-4b20-b95f-920bf795c216 None None] MFA Rules not processed for user `455be9a2aac544cf8a230bbde3c0f3b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:33.882938 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-b4409c10-6a87-4b20-b95f-920bf795c216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:33.906780 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:33.920788 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911890fe-5a72-4bf6-8593-f62aac3ff3e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:33.922480 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911890fe-5a72-4bf6-8593-f62aac3ff3e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:33.922976 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911890fe-5a72-4bf6-8593-f62aac3ff3e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:33.923449 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911890fe-5a72-4bf6-8593-f62aac3ff3e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:33.925791 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911890fe-5a72-4bf6-8593-f62aac3ff3e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:33.928250 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911890fe-5a72-4bf6-8593-f62aac3ff3e3 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:33.957549 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 900/1838] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:37:33 2022] GET /identity/v3/roles => generated 1427 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:37:33.963281 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911890fe-5a72-4bf6-8593-f62aac3ff3e3 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:33.983486 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911890fe-5a72-4bf6-8593-f62aac3ff3e3 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:33.999960 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b0eaf8-602a-4348-a5c6-e636644e35b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:34.001857 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b0eaf8-602a-4348-a5c6-e636644e35b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:34.002167 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b0eaf8-602a-4348-a5c6-e636644e35b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:34.002982 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b0eaf8-602a-4348-a5c6-e636644e35b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:34.003733 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b0eaf8-602a-4348-a5c6-e636644e35b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:34.005731 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b0eaf8-602a-4348-a5c6-e636644e35b6 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:34.028593 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 901/1839] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:37:33 2022] GET /identity/v3/roles => generated 1427 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:37:34.034594 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b0eaf8-602a-4348-a5c6-e636644e35b6 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:34.054527 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 939/1840] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:37:33 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:37:34.054743 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b0eaf8-602a-4348-a5c6-e636644e35b6 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:34.058707 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b3acf0-2787-4249-ba9f-a85c0d5aa4e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:34.059857 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b3acf0-2787-4249-ba9f-a85c0d5aa4e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:34.060349 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b3acf0-2787-4249-ba9f-a85c0d5aa4e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:34.060825 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b3acf0-2787-4249-ba9f-a85c0d5aa4e5 admin admin] PATH_INFO: `/v3/projects/d2e81581133743b48e346bf6caca16c3/users/97cd101b665c4b84a4152472d63dc866/roles/4abcf5e5e7cd4b53ae1828fec6550d53` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:34.062468 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4409c10-6a87-4b20-b95f-920bf795c216 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:34.064264 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-b4409c10-6a87-4b20-b95f-920bf795c216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:34.080767 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b3acf0-2787-4249-ba9f-a85c0d5aa4e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2e81581133743b48e346bf6caca16c3, user_id=97cd101b665c4b84a4152472d63dc866, role_id=4abcf5e5e7cd4b53ae1828fec6550d53)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:34.083991 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b3acf0-2787-4249-ba9f-a85c0d5aa4e5 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:34.088756 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:34.108765 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 902/1841] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:37:34 2022] PUT /identity/v3/projects/d2e81581133743b48e346bf6caca16c3/users/97cd101b665c4b84a4152472d63dc866/roles/4abcf5e5e7cd4b53ae1828fec6550d53 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:37:34.120005 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184588b0-e131-41bf-92b7-e3061f9e5876 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:34.120614 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184588b0-e131-41bf-92b7-e3061f9e5876 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:34.121096 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184588b0-e131-41bf-92b7-e3061f9e5876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:34.149251 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4409c10-6a87-4b20-b95f-920bf795c216 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:34.157879 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-184588b0-e131-41bf-92b7-e3061f9e5876 None None] MFA Rules not processed for user `97cd101b665c4b84a4152472d63dc866`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:34.160421 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-184588b0-e131-41bf-92b7-e3061f9e5876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:34.223796 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125eb361-24dd-4c56-b67b-5c30a1b1117f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea647438ea1c438987f28cbe39c3ff2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:34.224449 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125eb361-24dd-4c56-b67b-5c30a1b1117f service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:34.224732 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125eb361-24dd-4c56-b67b-5c30a1b1117f service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:34.225001 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125eb361-24dd-4c56-b67b-5c30a1b1117f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:34.257477 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 903/1842] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:37:34 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:37:34.261826 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184588b0-e131-41bf-92b7-e3061f9e5876 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:34.326514 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125eb361-24dd-4c56-b67b-5c30a1b1117f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:34.333273 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125eb361-24dd-4c56-b67b-5c30a1b1117f service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:34.354795 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 940/1843] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:37:34 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:37:34.433484 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184588b0-e131-41bf-92b7-e3061f9e5876 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:34.440233 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c34f714-c23b-44b3-be84-79692cd360aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:34.440925 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c34f714-c23b-44b3-be84-79692cd360aa admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:34.441204 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c34f714-c23b-44b3-be84-79692cd360aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:34.441943 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c34f714-c23b-44b3-be84-79692cd360aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:34.446669 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c34f714-c23b-44b3-be84-79692cd360aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:34.448820 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c34f714-c23b-44b3-be84-79692cd360aa admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:34.504492 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 904/1844] 10.222.0.118 () {60 vars in 1157 bytes} [Thu Jul 14 15:37:34 2022] POST /identity/v3/projects => generated 384 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:37:34.514041 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125eb361-24dd-4c56-b67b-5c30a1b1117f service cinder] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:34.548346 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125eb361-24dd-4c56-b67b-5c30a1b1117f service cinder] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:34.722423 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b28e95-595d-4467-8b88-59b5d88396f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:34.726079 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b28e95-595d-4467-8b88-59b5d88396f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:34.726616 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b28e95-595d-4467-8b88-59b5d88396f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:34.727099 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b28e95-595d-4467-8b88-59b5d88396f4 admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:34.728390 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b28e95-595d-4467-8b88-59b5d88396f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:34.731699 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b28e95-595d-4467-8b88-59b5d88396f4 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:34.774419 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 941/1845] 10.222.0.118 () {60 vars in 1148 bytes} [Thu Jul 14 15:37:34 2022] POST /identity/v3/users => generated 299 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:37:34.778187 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c34f714-c23b-44b3-be84-79692cd360aa admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:34.800128 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c34f714-c23b-44b3-be84-79692cd360aa admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:34.823165 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fb178b-f0d5-497c-9d06-078b5078cad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:34.824447 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fb178b-f0d5-497c-9d06-078b5078cad9 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:34.824735 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fb178b-f0d5-497c-9d06-078b5078cad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:34.825016 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fb178b-f0d5-497c-9d06-078b5078cad9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:34.830789 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fb178b-f0d5-497c-9d06-078b5078cad9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:34.833004 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fb178b-f0d5-497c-9d06-078b5078cad9 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:34.865421 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 905/1846] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:37:34 2022] GET /identity/v3/roles => generated 1427 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:37:34.869467 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b28e95-595d-4467-8b88-59b5d88396f4 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:34.882489 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b28e95-595d-4467-8b88-59b5d88396f4 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:34.889454 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923f39c8-7f3f-4e99-978d-c7862b6cae58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:34.891084 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923f39c8-7f3f-4e99-978d-c7862b6cae58 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:34.891573 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923f39c8-7f3f-4e99-978d-c7862b6cae58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:34.892042 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923f39c8-7f3f-4e99-978d-c7862b6cae58 admin admin] PATH_INFO: `/v3/projects/cc8eb49064364d63b32d28746f37d702/users/4fd9ae069d79411493b6aec80af83bc5/roles/3b880cef7dcf4baf87b50f8610c0c56e` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:34.922008 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:34.930214 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923f39c8-7f3f-4e99-978d-c7862b6cae58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc8eb49064364d63b32d28746f37d702, user_id=4fd9ae069d79411493b6aec80af83bc5, role_id=3b880cef7dcf4baf87b50f8610c0c56e)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:34.933947 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923f39c8-7f3f-4e99-978d-c7862b6cae58 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:34.962985 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 942/1847] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:37:34 2022] PUT /identity/v3/projects/cc8eb49064364d63b32d28746f37d702/users/4fd9ae069d79411493b6aec80af83bc5/roles/3b880cef7dcf4baf87b50f8610c0c56e => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:37:34.964935 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fb178b-f0d5-497c-9d06-078b5078cad9 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:34.979636 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fb178b-f0d5-497c-9d06-078b5078cad9 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:35.009273 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:35.103212 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b465e8e-4fff-4d25-8bcc-604866419caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:35.104074 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b465e8e-4fff-4d25-8bcc-604866419caf admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:35.107163 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b465e8e-4fff-4d25-8bcc-604866419caf admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:35.107565 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b465e8e-4fff-4d25-8bcc-604866419caf admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:35.108453 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b465e8e-4fff-4d25-8bcc-604866419caf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:35.112444 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b465e8e-4fff-4d25-8bcc-604866419caf admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:35.140915 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 906/1848] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:37:34 2022] GET /identity/v3/roles => generated 1427 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:37:35.144761 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923f39c8-7f3f-4e99-978d-c7862b6cae58 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:35.160448 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923f39c8-7f3f-4e99-978d-c7862b6cae58 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:35.175994 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f650664f-0a80-45b1-8f55-2c543def9635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:35.177667 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f650664f-0a80-45b1-8f55-2c543def9635 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:35.179703 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f650664f-0a80-45b1-8f55-2c543def9635 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:35.180710 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f650664f-0a80-45b1-8f55-2c543def9635 admin admin] PATH_INFO: `/v3/projects/cc8eb49064364d63b32d28746f37d702/users/4fd9ae069d79411493b6aec80af83bc5/roles/3b880cef7dcf4baf87b50f8610c0c56e` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:35.184714 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f650664f-0a80-45b1-8f55-2c543def9635 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc8eb49064364d63b32d28746f37d702, user_id=4fd9ae069d79411493b6aec80af83bc5, role_id=3b880cef7dcf4baf87b50f8610c0c56e)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:35.215786 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f650664f-0a80-45b1-8f55-2c543def9635 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:35.248914 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 943/1849] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:37:35 2022] PUT /identity/v3/projects/cc8eb49064364d63b32d28746f37d702/users/4fd9ae069d79411493b6aec80af83bc5/roles/3b880cef7dcf4baf87b50f8610c0c56e => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:37:35.258987 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766bc5c2-c10a-469e-87c9-15c2cf0d1a3b None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:35.258987 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766bc5c2-c10a-469e-87c9-15c2cf0d1a3b None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:35.258987 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766bc5c2-c10a-469e-87c9-15c2cf0d1a3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:35.311911 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-766bc5c2-c10a-469e-87c9-15c2cf0d1a3b None None] MFA Rules not processed for user `4fd9ae069d79411493b6aec80af83bc5`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:35.313308 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-766bc5c2-c10a-469e-87c9-15c2cf0d1a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:35.497431 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 907/1850] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:37:35 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:37:35.511245 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f650664f-0a80-45b1-8f55-2c543def9635 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:35.516483 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-f650664f-0a80-45b1-8f55-2c543def9635 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:35.520301 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766bc5c2-c10a-469e-87c9-15c2cf0d1a3b None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:35.591633 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f650664f-0a80-45b1-8f55-2c543def9635 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:35.594966 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766bc5c2-c10a-469e-87c9-15c2cf0d1a3b None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:35.595913 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614a807b-7b9f-4163-8f70-0933a54efa8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea647438ea1c438987f28cbe39c3ff2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:35.597569 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614a807b-7b9f-4163-8f70-0933a54efa8c service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:35.597569 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614a807b-7b9f-4163-8f70-0933a54efa8c service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:35.597914 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614a807b-7b9f-4163-8f70-0933a54efa8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:35.600569 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798f9839-f947-4a81-baff-45d1bedbdbde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:35.601458 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f9839-f947-4a81-baff-45d1bedbdbde admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:35.601743 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f9839-f947-4a81-baff-45d1bedbdbde admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:35.602048 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f9839-f947-4a81-baff-45d1bedbdbde admin admin] PATH_INFO: `/v3/users/1154b9ce425e43948db118071b64db70` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:35.603283 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798f9839-f947-4a81-baff-45d1bedbdbde admin admin] RBAC: Authorizing `identity:delete_user(user_id=1154b9ce425e43948db118071b64db70)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:35.606130 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798f9839-f947-4a81-baff-45d1bedbdbde admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:35.608003 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614a807b-7b9f-4163-8f70-0933a54efa8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:35.609471 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614a807b-7b9f-4163-8f70-0933a54efa8c service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:35.619904 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 944/1851] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:37:35 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:37:35.660219 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:35.663056 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-798f9839-f947-4a81-baff-45d1bedbdbde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1154b9ce425e43948db118071b64db70'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:35.672887 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-798f9839-f947-4a81-baff-45d1bedbdbde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1154b9ce425e43948db118071b64db70'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:35.673778 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-798f9839-f947-4a81-baff-45d1bedbdbde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1154b9ce425e43948db118071b64db70'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:35.674502 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-798f9839-f947-4a81-baff-45d1bedbdbde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1154b9ce425e43948db118071b64db70'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:35.687146 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-798f9839-f947-4a81-baff-45d1bedbdbde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1154b9ce425e43948db118071b64db70'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:35.703298 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 908/1852] 10.222.0.118 () {58 vars in 1228 bytes} [Thu Jul 14 15:37:35 2022] DELETE /identity/v3/users/1154b9ce425e43948db118071b64db70 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:37:35.712581 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2564c6bf-a9f4-478d-bafd-7d3302e4a744 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:35.712581 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2564c6bf-a9f4-478d-bafd-7d3302e4a744 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:35.712581 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2564c6bf-a9f4-478d-bafd-7d3302e4a744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:35.722683 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798f9839-f947-4a81-baff-45d1bedbdbde admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:35.726259 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-798f9839-f947-4a81-baff-45d1bedbdbde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:35.733728 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-2564c6bf-a9f4-478d-bafd-7d3302e4a744 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:35.735080 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-2564c6bf-a9f4-478d-bafd-7d3302e4a744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:35.794761 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798f9839-f947-4a81-baff-45d1bedbdbde admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:35.798691 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2931640-3b31-4983-8217-c3ea5ba9ad45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea647438ea1c438987f28cbe39c3ff2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:35.799523 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2931640-3b31-4983-8217-c3ea5ba9ad45 service cinder] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:35.799962 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2931640-3b31-4983-8217-c3ea5ba9ad45 service cinder] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:35.800261 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2931640-3b31-4983-8217-c3ea5ba9ad45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:35.802221 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-a2931640-3b31-4983-8217-c3ea5ba9ad45 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:35.807523 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 945/1853] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:37:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:37:35.823368 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2564c6bf-a9f4-478d-bafd-7d3302e4a744 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:35.824969 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-2564c6bf-a9f4-478d-bafd-7d3302e4a744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:35.894053 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2931640-3b31-4983-8217-c3ea5ba9ad45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:35.895697 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2931640-3b31-4983-8217-c3ea5ba9ad45 service cinder] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:35.901923 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2564c6bf-a9f4-478d-bafd-7d3302e4a744 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:35.907092 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b076c3-06a3-4726-af2e-b8970b65f2b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b650be8114b64df0ac88441f1c50b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:35.907753 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b076c3-06a3-4726-af2e-b8970b65f2b7 service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:35.908034 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b076c3-06a3-4726-af2e-b8970b65f2b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:35.908310 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b076c3-06a3-4726-af2e-b8970b65f2b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:35.914313 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 909/1854] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:37:35 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:37:35.919005 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b076c3-06a3-4726-af2e-b8970b65f2b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:35.921552 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b076c3-06a3-4726-af2e-b8970b65f2b7 service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:35.935049 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 946/1855] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:37:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:37:36.216847 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2931640-3b31-4983-8217-c3ea5ba9ad45 service cinder] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:36.218341 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-a2931640-3b31-4983-8217-c3ea5ba9ad45 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:36.232447 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2931640-3b31-4983-8217-c3ea5ba9ad45 service cinder] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:36.238266 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00439ce3-43c2-4c92-9306-c08a69af113a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:36.239487 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00439ce3-43c2-4c92-9306-c08a69af113a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:36.239969 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00439ce3-43c2-4c92-9306-c08a69af113a admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:36.240455 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00439ce3-43c2-4c92-9306-c08a69af113a admin admin] PATH_INFO: `/v3/users/97cd101b665c4b84a4152472d63dc866` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:36.243158 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00439ce3-43c2-4c92-9306-c08a69af113a admin admin] RBAC: Authorizing `identity:delete_user(user_id=97cd101b665c4b84a4152472d63dc866)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:36.251316 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00439ce3-43c2-4c92-9306-c08a69af113a admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:36.344487 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-00439ce3-43c2-4c92-9306-c08a69af113a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97cd101b665c4b84a4152472d63dc866'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:36.355848 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-00439ce3-43c2-4c92-9306-c08a69af113a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97cd101b665c4b84a4152472d63dc866'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:36.357428 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-00439ce3-43c2-4c92-9306-c08a69af113a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97cd101b665c4b84a4152472d63dc866'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:36.358886 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-00439ce3-43c2-4c92-9306-c08a69af113a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97cd101b665c4b84a4152472d63dc866'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:36.393439 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:36.396366 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-00439ce3-43c2-4c92-9306-c08a69af113a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97cd101b665c4b84a4152472d63dc866'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:36.426481 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 910/1856] 10.222.0.118 () {58 vars in 1228 bytes} [Thu Jul 14 15:37:36 2022] DELETE /identity/v3/users/97cd101b665c4b84a4152472d63dc866 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:37:36.430806 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c64dfc-f81f-42ee-acb0-fb8c5eda988d None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:36.431092 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c64dfc-f81f-42ee-acb0-fb8c5eda988d None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:36.431366 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c64dfc-f81f-42ee-acb0-fb8c5eda988d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:36.458824 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-19c64dfc-f81f-42ee-acb0-fb8c5eda988d None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:36.460047 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-19c64dfc-f81f-42ee-acb0-fb8c5eda988d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:36.497443 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:36.508482 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00439ce3-43c2-4c92-9306-c08a69af113a admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:36.511458 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-00439ce3-43c2-4c92-9306-c08a69af113a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:36.591102 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 947/1857] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:37:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:37:36.591977 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c64dfc-f81f-42ee-acb0-fb8c5eda988d None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:36.595754 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-19c64dfc-f81f-42ee-acb0-fb8c5eda988d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:36.611385 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c64dfc-f81f-42ee-acb0-fb8c5eda988d None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:36.618207 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5722bdb-524f-46b9-90f1-04229d4ec292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:36.618772 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5722bdb-524f-46b9-90f1-04229d4ec292 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:36.619051 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5722bdb-524f-46b9-90f1-04229d4ec292 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:36.619323 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5722bdb-524f-46b9-90f1-04229d4ec292 admin admin] PATH_INFO: `/v3/users/5466f2d034c746679f61097908a12072` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:36.620567 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5722bdb-524f-46b9-90f1-04229d4ec292 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5466f2d034c746679f61097908a12072)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:36.623310 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5722bdb-524f-46b9-90f1-04229d4ec292 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:36.700976 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00439ce3-43c2-4c92-9306-c08a69af113a admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:36.716952 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa5538e-a93e-4f5f-83ca-445cc00d266f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:36.720253 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa5538e-a93e-4f5f-83ca-445cc00d266f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:36.720568 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa5538e-a93e-4f5f-83ca-445cc00d266f admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:36.720833 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa5538e-a93e-4f5f-83ca-445cc00d266f admin admin] PATH_INFO: `/v3/projects/b9f8ca8cbe52409a9708b1382888c2f4` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:36.728181 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa5538e-a93e-4f5f-83ca-445cc00d266f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9f8ca8cbe52409a9708b1382888c2f4)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:36.728466 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-f5722bdb-524f-46b9-90f1-04229d4ec292 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5466f2d034c746679f61097908a12072'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:36.731291 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa5538e-a93e-4f5f-83ca-445cc00d266f admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:36.739397 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-f5722bdb-524f-46b9-90f1-04229d4ec292 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5466f2d034c746679f61097908a12072'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:36.740446 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-f5722bdb-524f-46b9-90f1-04229d4ec292 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5466f2d034c746679f61097908a12072'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:36.741290 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-f5722bdb-524f-46b9-90f1-04229d4ec292 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5466f2d034c746679f61097908a12072'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:36.756796 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-f5722bdb-524f-46b9-90f1-04229d4ec292 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5466f2d034c746679f61097908a12072'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:36.779814 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 948/1858] 10.222.0.118 () {58 vars in 1228 bytes} [Thu Jul 14 15:37:36 2022] DELETE /identity/v3/users/5466f2d034c746679f61097908a12072 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:37:36.785131 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5722bdb-524f-46b9-90f1-04229d4ec292 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:36.787261 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-f5722bdb-524f-46b9-90f1-04229d4ec292 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:36.836457 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-6aa5538e-a93e-4f5f-83ca-445cc00d266f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9f8ca8cbe52409a9708b1382888c2f4', 'request_id': 'req-6aa5538e-a93e-4f5f-83ca-445cc00d266f'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:36.847842 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-6aa5538e-a93e-4f5f-83ca-445cc00d266f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9f8ca8cbe52409a9708b1382888c2f4', 'request_id': 'req-6aa5538e-a93e-4f5f-83ca-445cc00d266f'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:36.854351 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-6aa5538e-a93e-4f5f-83ca-445cc00d266f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9f8ca8cbe52409a9708b1382888c2f4', 'request_id': 'req-6aa5538e-a93e-4f5f-83ca-445cc00d266f'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:36.895911 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-6aa5538e-a93e-4f5f-83ca-445cc00d266f admin admin] The token cache is being invalidate because project b9f8ca8cbe52409a9708b1382888c2f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:37:36.896213 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-6aa5538e-a93e-4f5f-83ca-445cc00d266f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:36.899384 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-6aa5538e-a93e-4f5f-83ca-445cc00d266f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:36.902745 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 911/1859] 10.222.0.118 () {58 vars in 1237 bytes} [Thu Jul 14 15:37:36 2022] DELETE /identity/v3/projects/b9f8ca8cbe52409a9708b1382888c2f4 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:37:36.907377 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2377e2e-2c0e-4bb8-b82c-fb1e84f3dca1 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:36.909469 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2377e2e-2c0e-4bb8-b82c-fb1e84f3dca1 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:36.909469 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2377e2e-2c0e-4bb8-b82c-fb1e84f3dca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:36.937865 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-c2377e2e-2c0e-4bb8-b82c-fb1e84f3dca1 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:36.939059 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-c2377e2e-2c0e-4bb8-b82c-fb1e84f3dca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:36.958578 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5722bdb-524f-46b9-90f1-04229d4ec292 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:37.040121 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 912/1860] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:37:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:37:37.040121 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2377e2e-2c0e-4bb8-b82c-fb1e84f3dca1 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:37.040121 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-c2377e2e-2c0e-4bb8-b82c-fb1e84f3dca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:37.059647 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2377e2e-2c0e-4bb8-b82c-fb1e84f3dca1 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:37.069610 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfc451f-ddbd-4b12-aa8f-600670426b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:37.070555 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfc451f-ddbd-4b12-aa8f-600670426b45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:37.070833 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfc451f-ddbd-4b12-aa8f-600670426b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:37.071105 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfc451f-ddbd-4b12-aa8f-600670426b45 admin admin] PATH_INFO: `/v3/users/455be9a2aac544cf8a230bbde3c0f3b0` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:37.073526 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfc451f-ddbd-4b12-aa8f-600670426b45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=455be9a2aac544cf8a230bbde3c0f3b0)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:37.076418 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfc451f-ddbd-4b12-aa8f-600670426b45 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:37.100432 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c5e8be-134b-4379-90cf-da3522178cd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b650be8114b64df0ac88441f1c50b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:37.101115 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c5e8be-134b-4379-90cf-da3522178cd6 service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:37.101396 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c5e8be-134b-4379-90cf-da3522178cd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:37.101668 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c5e8be-134b-4379-90cf-da3522178cd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:37.106840 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-82c5e8be-134b-4379-90cf-da3522178cd6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:37.140673 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:37.145827 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:37.157618 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c5e8be-134b-4379-90cf-da3522178cd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:37.159590 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c5e8be-134b-4379-90cf-da3522178cd6 service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:37.183485 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 949/1861] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:37:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:37:37.185511 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c5e8be-134b-4379-90cf-da3522178cd6 service neutron] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:37.188772 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-82c5e8be-134b-4379-90cf-da3522178cd6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:37.209124 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c5e8be-134b-4379-90cf-da3522178cd6 service neutron] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:37.213749 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4ec6c4-c393-488a-a0be-821a1d2e25d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b650be8114b64df0ac88441f1c50b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:37.214749 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ec6c4-c393-488a-a0be-821a1d2e25d2 service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:37.215244 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ec6c4-c393-488a-a0be-821a1d2e25d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:37.215799 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ec6c4-c393-488a-a0be-821a1d2e25d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:37.232292 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4ec6c4-c393-488a-a0be-821a1d2e25d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:37.235299 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4ec6c4-c393-488a-a0be-821a1d2e25d2 service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:37.237647 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-4cfc451f-ddbd-4b12-aa8f-600670426b45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '455be9a2aac544cf8a230bbde3c0f3b0'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:37.260994 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-4cfc451f-ddbd-4b12-aa8f-600670426b45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '455be9a2aac544cf8a230bbde3c0f3b0'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:37.263660 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-4cfc451f-ddbd-4b12-aa8f-600670426b45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '455be9a2aac544cf8a230bbde3c0f3b0'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:37.264662 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-4cfc451f-ddbd-4b12-aa8f-600670426b45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '455be9a2aac544cf8a230bbde3c0f3b0'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:37.276980 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 950/1862] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:37:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:37:37.292179 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-4cfc451f-ddbd-4b12-aa8f-600670426b45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '455be9a2aac544cf8a230bbde3c0f3b0'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:37.316274 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 913/1863] 10.222.0.118 () {58 vars in 1228 bytes} [Thu Jul 14 15:37:37 2022] DELETE /identity/v3/users/455be9a2aac544cf8a230bbde3c0f3b0 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:37:38.390267 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4ec6c4-c393-488a-a0be-821a1d2e25d2 service neutron] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:38.394608 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-3a4ec6c4-c393-488a-a0be-821a1d2e25d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:38.420440 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4ec6c4-c393-488a-a0be-821a1d2e25d2 service neutron] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:38.567759 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3356ae4b-e0e4-4212-bce1-ded4f4dd129a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:38.567759 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3356ae4b-e0e4-4212-bce1-ded4f4dd129a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:38.567759 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3356ae4b-e0e4-4212-bce1-ded4f4dd129a admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:38.567759 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3356ae4b-e0e4-4212-bce1-ded4f4dd129a admin admin] PATH_INFO: `/v3/projects/7655d6b503fc4e83bff56dbd17c98288` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:38.570206 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3356ae4b-e0e4-4212-bce1-ded4f4dd129a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7655d6b503fc4e83bff56dbd17c98288)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:38.572177 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3356ae4b-e0e4-4212-bce1-ded4f4dd129a admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:38.643336 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-3356ae4b-e0e4-4212-bce1-ded4f4dd129a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7655d6b503fc4e83bff56dbd17c98288', 'request_id': 'req-3356ae4b-e0e4-4212-bce1-ded4f4dd129a'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:38.650940 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-3356ae4b-e0e4-4212-bce1-ded4f4dd129a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7655d6b503fc4e83bff56dbd17c98288', 'request_id': 'req-3356ae4b-e0e4-4212-bce1-ded4f4dd129a'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:38.661101 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-3356ae4b-e0e4-4212-bce1-ded4f4dd129a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7655d6b503fc4e83bff56dbd17c98288', 'request_id': 'req-3356ae4b-e0e4-4212-bce1-ded4f4dd129a'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:38.682341 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-3356ae4b-e0e4-4212-bce1-ded4f4dd129a admin admin] The token cache is being invalidate because project 7655d6b503fc4e83bff56dbd17c98288 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:37:38.682756 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-3356ae4b-e0e4-4212-bce1-ded4f4dd129a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:38.683811 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-3356ae4b-e0e4-4212-bce1-ded4f4dd129a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:38.687040 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 951/1864] 10.222.0.118 () {58 vars in 1237 bytes} [Thu Jul 14 15:37:38 2022] DELETE /identity/v3/projects/7655d6b503fc4e83bff56dbd17c98288 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:37:38.691547 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfc451f-ddbd-4b12-aa8f-600670426b45 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:38.694296 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-4cfc451f-ddbd-4b12-aa8f-600670426b45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:38.733349 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfc451f-ddbd-4b12-aa8f-600670426b45 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:38.819742 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e118473-f1c4-4f34-8650-3d49a765576d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:38.820657 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e118473-f1c4-4f34-8650-3d49a765576d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:38.820934 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e118473-f1c4-4f34-8650-3d49a765576d admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:38.821207 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e118473-f1c4-4f34-8650-3d49a765576d admin admin] PATH_INFO: `/v3/users/851d63ca6b8e42978ef984ae0c1f05c3` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:38.822620 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e118473-f1c4-4f34-8650-3d49a765576d admin admin] RBAC: Authorizing `identity:delete_user(user_id=851d63ca6b8e42978ef984ae0c1f05c3)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:38.824602 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e118473-f1c4-4f34-8650-3d49a765576d admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:38.872984 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3356ae4b-e0e4-4212-bce1-ded4f4dd129a admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:38.875390 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-3356ae4b-e0e4-4212-bce1-ded4f4dd129a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:38.905806 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3356ae4b-e0e4-4212-bce1-ded4f4dd129a admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:38.922948 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4df11b3-9349-4d3a-9c14-29b830d1c575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:38.925325 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4df11b3-9349-4d3a-9c14-29b830d1c575 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:38.925621 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4df11b3-9349-4d3a-9c14-29b830d1c575 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:38.925955 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4df11b3-9349-4d3a-9c14-29b830d1c575 admin admin] PATH_INFO: `/v3/projects/d2e81581133743b48e346bf6caca16c3` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:38.928567 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4df11b3-9349-4d3a-9c14-29b830d1c575 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2e81581133743b48e346bf6caca16c3)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:38.932305 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4df11b3-9349-4d3a-9c14-29b830d1c575 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:38.933714 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-7e118473-f1c4-4f34-8650-3d49a765576d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '851d63ca6b8e42978ef984ae0c1f05c3'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:38.956371 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-7e118473-f1c4-4f34-8650-3d49a765576d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '851d63ca6b8e42978ef984ae0c1f05c3'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:38.957375 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-7e118473-f1c4-4f34-8650-3d49a765576d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '851d63ca6b8e42978ef984ae0c1f05c3'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:38.958168 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-7e118473-f1c4-4f34-8650-3d49a765576d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '851d63ca6b8e42978ef984ae0c1f05c3'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:38.998371 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-7e118473-f1c4-4f34-8650-3d49a765576d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '851d63ca6b8e42978ef984ae0c1f05c3'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:39.030394 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-c4df11b3-9349-4d3a-9c14-29b830d1c575 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2e81581133743b48e346bf6caca16c3', 'request_id': 'req-c4df11b3-9349-4d3a-9c14-29b830d1c575'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:39.030790 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 914/1865] 10.222.0.118 () {58 vars in 1228 bytes} [Thu Jul 14 15:37:38 2022] DELETE /identity/v3/users/851d63ca6b8e42978ef984ae0c1f05c3 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:37:39.034507 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fba78d-fcb1-480c-8891-0cef2cb2d92d None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:39.034966 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fba78d-fcb1-480c-8891-0cef2cb2d92d None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:39.035442 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fba78d-fcb1-480c-8891-0cef2cb2d92d None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:39.040062 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 915/1866] 10.222.0.118 () {54 vars in 926 bytes} [Thu Jul 14 15:37:39 2022] GET /identity => generated 271 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:37:39.047096 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-c4df11b3-9349-4d3a-9c14-29b830d1c575 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2e81581133743b48e346bf6caca16c3', 'request_id': 'req-c4df11b3-9349-4d3a-9c14-29b830d1c575'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:39.053941 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-c4df11b3-9349-4d3a-9c14-29b830d1c575 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2e81581133743b48e346bf6caca16c3', 'request_id': 'req-c4df11b3-9349-4d3a-9c14-29b830d1c575'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:39.055119 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a051dd-3eee-4f87-b05a-9a34108b24b0 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:39.056710 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:39.057218 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a051dd-3eee-4f87-b05a-9a34108b24b0 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:39.057510 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a051dd-3eee-4f87-b05a-9a34108b24b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:39.074058 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-c4df11b3-9349-4d3a-9c14-29b830d1c575 admin admin] The token cache is being invalidate because project d2e81581133743b48e346bf6caca16c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:37:39.074421 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-c4df11b3-9349-4d3a-9c14-29b830d1c575 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:39.075208 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-c4df11b3-9349-4d3a-9c14-29b830d1c575 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:39.076990 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 952/1867] 10.222.0.118 () {58 vars in 1237 bytes} [Thu Jul 14 15:37:38 2022] DELETE /identity/v3/projects/d2e81581133743b48e346bf6caca16c3 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:37:39.081745 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4df11b3-9349-4d3a-9c14-29b830d1c575 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:39.083278 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-c4df11b3-9349-4d3a-9c14-29b830d1c575 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:39.101125 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-d4a051dd-3eee-4f87-b05a-9a34108b24b0 None None] MFA Rules not processed for user `f0177fc696ea40069902803da09f437c`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:39.103901 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-d4a051dd-3eee-4f87-b05a-9a34108b24b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:39.122656 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:39.184596 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4df11b3-9349-4d3a-9c14-29b830d1c575 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:39.253570 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ea584b-d28b-438e-b43c-7d8852b9cfeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:39.254700 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ea584b-d28b-438e-b43c-7d8852b9cfeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:39.255081 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ea584b-d28b-438e-b43c-7d8852b9cfeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:39.255452 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ea584b-d28b-438e-b43c-7d8852b9cfeb admin admin] PATH_INFO: `/v3/users/4fd9ae069d79411493b6aec80af83bc5` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:39.256889 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ea584b-d28b-438e-b43c-7d8852b9cfeb admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fd9ae069d79411493b6aec80af83bc5)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:39.257146 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 916/1868] 10.222.0.118 () {58 vars in 1023 bytes} [Thu Jul 14 15:37:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:37:39.259530 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ea584b-d28b-438e-b43c-7d8852b9cfeb admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:39.337415 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a051dd-3eee-4f87-b05a-9a34108b24b0 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:39.339129 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-d4a051dd-3eee-4f87-b05a-9a34108b24b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:39.351288 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-88ea584b-d28b-438e-b43c-7d8852b9cfeb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fd9ae069d79411493b6aec80af83bc5'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:39.360848 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-88ea584b-d28b-438e-b43c-7d8852b9cfeb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fd9ae069d79411493b6aec80af83bc5'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:39.361798 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-88ea584b-d28b-438e-b43c-7d8852b9cfeb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fd9ae069d79411493b6aec80af83bc5'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:39.362508 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-88ea584b-d28b-438e-b43c-7d8852b9cfeb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fd9ae069d79411493b6aec80af83bc5'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:39.364112 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a051dd-3eee-4f87-b05a-9a34108b24b0 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:39.379450 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319161ad-a7af-41d3-8f6d-0119dda670f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:39.380505 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319161ad-a7af-41d3-8f6d-0119dda670f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:39.380892 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319161ad-a7af-41d3-8f6d-0119dda670f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:39.381357 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319161ad-a7af-41d3-8f6d-0119dda670f5 admin admin] PATH_INFO: `/v3/projects/4cdd08d239f34e568802d60e7ce6c23d` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:39.383096 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319161ad-a7af-41d3-8f6d-0119dda670f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cdd08d239f34e568802d60e7ce6c23d)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:39.385401 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319161ad-a7af-41d3-8f6d-0119dda670f5 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:39.411435 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-88ea584b-d28b-438e-b43c-7d8852b9cfeb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fd9ae069d79411493b6aec80af83bc5'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:39.448699 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 953/1869] 10.222.0.118 () {58 vars in 1228 bytes} [Thu Jul 14 15:37:39 2022] DELETE /identity/v3/users/4fd9ae069d79411493b6aec80af83bc5 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:37:39.449688 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ea584b-d28b-438e-b43c-7d8852b9cfeb admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:39.451907 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-88ea584b-d28b-438e-b43c-7d8852b9cfeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:39.485725 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:39.519097 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-319161ad-a7af-41d3-8f6d-0119dda670f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cdd08d239f34e568802d60e7ce6c23d', 'request_id': 'req-319161ad-a7af-41d3-8f6d-0119dda670f5'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:39.554464 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-319161ad-a7af-41d3-8f6d-0119dda670f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cdd08d239f34e568802d60e7ce6c23d', 'request_id': 'req-319161ad-a7af-41d3-8f6d-0119dda670f5'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:39.567174 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-319161ad-a7af-41d3-8f6d-0119dda670f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cdd08d239f34e568802d60e7ce6c23d', 'request_id': 'req-319161ad-a7af-41d3-8f6d-0119dda670f5'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:39.597320 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-319161ad-a7af-41d3-8f6d-0119dda670f5 admin admin] The token cache is being invalidate because project 4cdd08d239f34e568802d60e7ce6c23d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:37:39.598047 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-319161ad-a7af-41d3-8f6d-0119dda670f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:39.599295 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-319161ad-a7af-41d3-8f6d-0119dda670f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:39.609756 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 917/1870] 10.222.0.118 () {58 vars in 1237 bytes} [Thu Jul 14 15:37:39 2022] DELETE /identity/v3/projects/4cdd08d239f34e568802d60e7ce6c23d => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:37:39.612220 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944bddfc-53d0-4146-ae58-4ff14bd916f3 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:39.612220 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944bddfc-53d0-4146-ae58-4ff14bd916f3 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:39.612481 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944bddfc-53d0-4146-ae58-4ff14bd916f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:39.637094 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ea584b-d28b-438e-b43c-7d8852b9cfeb admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:39.658308 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-944bddfc-53d0-4146-ae58-4ff14bd916f3 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:39.659596 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-944bddfc-53d0-4146-ae58-4ff14bd916f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:39.734467 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff785a47-eb58-46af-8649-bb8c76119adb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0177fc696ea40069902803da09f437c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:39.735398 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff785a47-eb58-46af-8649-bb8c76119adb service nova] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:39.735680 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff785a47-eb58-46af-8649-bb8c76119adb service nova] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:39.735954 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff785a47-eb58-46af-8649-bb8c76119adb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:39.739067 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-ff785a47-eb58-46af-8649-bb8c76119adb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:39.769197 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff785a47-eb58-46af-8649-bb8c76119adb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:39.775077 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff785a47-eb58-46af-8649-bb8c76119adb service nova] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:39.785789 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 918/1871] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:37:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:37:39.793450 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7352d88-3ebc-4fbb-8f57-686ecb94e680 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:39.793834 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7352d88-3ebc-4fbb-8f57-686ecb94e680 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:39.794259 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7352d88-3ebc-4fbb-8f57-686ecb94e680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:39.806979 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 954/1872] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:37:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:37:39.848069 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-b7352d88-3ebc-4fbb-8f57-686ecb94e680 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:39.849578 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-b7352d88-3ebc-4fbb-8f57-686ecb94e680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:39.867548 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 919/1873] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:37:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:37:39.870175 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff785a47-eb58-46af-8649-bb8c76119adb service nova] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:39.898323 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff785a47-eb58-46af-8649-bb8c76119adb service nova] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:39.904437 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be82569-422d-45ac-a914-bce7794eb66b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:39.905829 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be82569-422d-45ac-a914-bce7794eb66b admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:39.905829 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be82569-422d-45ac-a914-bce7794eb66b admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:39.905829 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be82569-422d-45ac-a914-bce7794eb66b admin admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:39.906747 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be82569-422d-45ac-a914-bce7794eb66b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:37:39.907063 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be82569-422d-45ac-a914-bce7794eb66b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:39.909695 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be82569-422d-45ac-a914-bce7794eb66b admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:39.928137 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 955/1874] 10.222.0.118 () {58 vars in 1157 bytes} [Thu Jul 14 15:37:39 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:37:39.932634 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7352d88-3ebc-4fbb-8f57-686ecb94e680 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:39.965029 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7352d88-3ebc-4fbb-8f57-686ecb94e680 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:39.982499 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c211dc-101e-48e8-b6ab-8e5f068722da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:39.985481 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c211dc-101e-48e8-b6ab-8e5f068722da admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:39.986280 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c211dc-101e-48e8-b6ab-8e5f068722da admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:39.989195 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c211dc-101e-48e8-b6ab-8e5f068722da admin admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:39.990703 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c211dc-101e-48e8-b6ab-8e5f068722da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:39.993492 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c211dc-101e-48e8-b6ab-8e5f068722da admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:40.038446 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:40.052549 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 920/1875] 10.222.0.118 () {60 vars in 1157 bytes} [Thu Jul 14 15:37:39 2022] POST /identity/v3/projects => generated 384 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:37:40.056160 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be82569-422d-45ac-a914-bce7794eb66b admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:40.073302 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be82569-422d-45ac-a914-bce7794eb66b admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:40.154558 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27ea458-4997-414c-8173-0f299d7857fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:40.155537 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27ea458-4997-414c-8173-0f299d7857fe admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:40.156002 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27ea458-4997-414c-8173-0f299d7857fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:40.156424 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27ea458-4997-414c-8173-0f299d7857fe admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:40.157277 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27ea458-4997-414c-8173-0f299d7857fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:40.160155 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27ea458-4997-414c-8173-0f299d7857fe admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:40.192132 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 956/1876] 10.222.0.118 () {60 vars in 1148 bytes} [Thu Jul 14 15:37:40 2022] POST /identity/v3/users => generated 293 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:37:40.193370 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c211dc-101e-48e8-b6ab-8e5f068722da admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:40.208874 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c211dc-101e-48e8-b6ab-8e5f068722da admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:40.214845 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7880e5c6-7833-4cd1-9b47-8465b123bdff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:40.215599 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7880e5c6-7833-4cd1-9b47-8465b123bdff admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:40.216041 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7880e5c6-7833-4cd1-9b47-8465b123bdff admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:40.216370 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7880e5c6-7833-4cd1-9b47-8465b123bdff admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:40.217546 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7880e5c6-7833-4cd1-9b47-8465b123bdff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:40.218879 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7880e5c6-7833-4cd1-9b47-8465b123bdff admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:40.235364 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 921/1877] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:37:40 2022] GET /identity/v3/roles => generated 1427 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:37:40.236636 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27ea458-4997-414c-8173-0f299d7857fe admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:40.247453 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27ea458-4997-414c-8173-0f299d7857fe admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:40.252768 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe176b6-23d2-469c-b960-13dd9022bda4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:40.253505 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe176b6-23d2-469c-b960-13dd9022bda4 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:40.253908 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe176b6-23d2-469c-b960-13dd9022bda4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:40.254716 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe176b6-23d2-469c-b960-13dd9022bda4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:40.255451 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe176b6-23d2-469c-b960-13dd9022bda4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:40.257448 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe176b6-23d2-469c-b960-13dd9022bda4 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:40.273043 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 957/1878] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:37:40 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:37:40.275966 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7880e5c6-7833-4cd1-9b47-8465b123bdff admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:40.288404 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7880e5c6-7833-4cd1-9b47-8465b123bdff admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:40.294019 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bd2f73-0627-4393-bb2f-c9a8d93eb40f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:40.295712 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bd2f73-0627-4393-bb2f-c9a8d93eb40f admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:40.295840 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bd2f73-0627-4393-bb2f-c9a8d93eb40f admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:40.297030 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bd2f73-0627-4393-bb2f-c9a8d93eb40f admin admin] PATH_INFO: `/v3/projects/4e9cd5b6c30f48c2bebe1dc018cddfe9/users/a5d124435d2c43cb92fe90874c2c89b6/roles/4abcf5e5e7cd4b53ae1828fec6550d53` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:40.347001 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bd2f73-0627-4393-bb2f-c9a8d93eb40f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e9cd5b6c30f48c2bebe1dc018cddfe9, user_id=a5d124435d2c43cb92fe90874c2c89b6, role_id=4abcf5e5e7cd4b53ae1828fec6550d53)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:40.352868 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bd2f73-0627-4393-bb2f-c9a8d93eb40f admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:40.378047 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 922/1879] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:37:40 2022] PUT /identity/v3/projects/4e9cd5b6c30f48c2bebe1dc018cddfe9/users/a5d124435d2c43cb92fe90874c2c89b6/roles/4abcf5e5e7cd4b53ae1828fec6550d53 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:37:40.386008 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4074dc-ae97-43e3-9566-46d2fca50675 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:40.388468 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4074dc-ae97-43e3-9566-46d2fca50675 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:40.388976 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4074dc-ae97-43e3-9566-46d2fca50675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:40.396300 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bd2f73-0627-4393-bb2f-c9a8d93eb40f admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:40.401773 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-64bd2f73-0627-4393-bb2f-c9a8d93eb40f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:40.450336 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:40.467747 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-8b4074dc-ae97-43e3-9566-46d2fca50675 None None] MFA Rules not processed for user `a5d124435d2c43cb92fe90874c2c89b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:40.469408 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-8b4074dc-ae97-43e3-9566-46d2fca50675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:40.629050 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bd2f73-0627-4393-bb2f-c9a8d93eb40f admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:40.635244 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8182d175-8405-43ff-8790-161d4436d0c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:40.636723 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8182d175-8405-43ff-8790-161d4436d0c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:40.637152 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8182d175-8405-43ff-8790-161d4436d0c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:40.637567 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8182d175-8405-43ff-8790-161d4436d0c4 admin admin] PATH_INFO: `/v3/projects/6e5826f30ffa41b08991ad0fe9976eb5` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:40.640415 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8182d175-8405-43ff-8790-161d4436d0c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e5826f30ffa41b08991ad0fe9976eb5)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:40.644141 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8182d175-8405-43ff-8790-161d4436d0c4 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:40.679802 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 958/1880] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:37:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:37:40.695608 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4074dc-ae97-43e3-9566-46d2fca50675 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:40.698440 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-8b4074dc-ae97-43e3-9566-46d2fca50675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:40.794310 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-8182d175-8405-43ff-8790-161d4436d0c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e5826f30ffa41b08991ad0fe9976eb5', 'request_id': 'req-8182d175-8405-43ff-8790-161d4436d0c4'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:40.824558 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-8182d175-8405-43ff-8790-161d4436d0c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e5826f30ffa41b08991ad0fe9976eb5', 'request_id': 'req-8182d175-8405-43ff-8790-161d4436d0c4'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:40.851480 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4074dc-ae97-43e3-9566-46d2fca50675 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:40.866066 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-8182d175-8405-43ff-8790-161d4436d0c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e5826f30ffa41b08991ad0fe9976eb5', 'request_id': 'req-8182d175-8405-43ff-8790-161d4436d0c4'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:40.891400 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-8182d175-8405-43ff-8790-161d4436d0c4 admin admin] The token cache is being invalidate because project 6e5826f30ffa41b08991ad0fe9976eb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:37:40.891743 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-8182d175-8405-43ff-8790-161d4436d0c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:40.892481 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-8182d175-8405-43ff-8790-161d4436d0c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:40.897920 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 923/1881] 10.222.0.118 () {58 vars in 1237 bytes} [Thu Jul 14 15:37:40 2022] DELETE /identity/v3/projects/6e5826f30ffa41b08991ad0fe9976eb5 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:37:40.898984 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8182d175-8405-43ff-8790-161d4436d0c4 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:40.900758 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-8182d175-8405-43ff-8790-161d4436d0c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:40.926154 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe8970b-ecfd-4ab1-bbdb-9b2a4ed6b8db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea647438ea1c438987f28cbe39c3ff2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:40.927087 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe8970b-ecfd-4ab1-bbdb-9b2a4ed6b8db service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:40.927519 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe8970b-ecfd-4ab1-bbdb-9b2a4ed6b8db service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:40.928073 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe8970b-ecfd-4ab1-bbdb-9b2a4ed6b8db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:40.930658 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-4fe8970b-ecfd-4ab1-bbdb-9b2a4ed6b8db service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:40.964841 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:40.988906 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8182d175-8405-43ff-8790-161d4436d0c4 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:40.995090 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b95b9b-3156-4c83-94d9-1dd7688f893b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:40.996556 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b95b9b-3156-4c83-94d9-1dd7688f893b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:40.996843 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b95b9b-3156-4c83-94d9-1dd7688f893b admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:40.997375 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b95b9b-3156-4c83-94d9-1dd7688f893b admin admin] PATH_INFO: `/v3/projects/cc8eb49064364d63b32d28746f37d702` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:40.998814 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b95b9b-3156-4c83-94d9-1dd7688f893b admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc8eb49064364d63b32d28746f37d702)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:41.000767 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b95b9b-3156-4c83-94d9-1dd7688f893b admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:41.008048 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe8970b-ecfd-4ab1-bbdb-9b2a4ed6b8db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:41.009494 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe8970b-ecfd-4ab1-bbdb-9b2a4ed6b8db service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:41.025908 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 959/1882] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:37:40 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:37:41.037267 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e6b23e-d1e1-41d7-bb71-15bfc5586344 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:41.037778 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e6b23e-d1e1-41d7-bb71-15bfc5586344 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:41.039101 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e6b23e-d1e1-41d7-bb71-15bfc5586344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:41.063222 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-38b95b9b-3156-4c83-94d9-1dd7688f893b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc8eb49064364d63b32d28746f37d702', 'request_id': 'req-38b95b9b-3156-4c83-94d9-1dd7688f893b'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:41.072652 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-38b95b9b-3156-4c83-94d9-1dd7688f893b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc8eb49064364d63b32d28746f37d702', 'request_id': 'req-38b95b9b-3156-4c83-94d9-1dd7688f893b'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:41.079768 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-38b95b9b-3156-4c83-94d9-1dd7688f893b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc8eb49064364d63b32d28746f37d702', 'request_id': 'req-38b95b9b-3156-4c83-94d9-1dd7688f893b'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:41.089013 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-d3e6b23e-d1e1-41d7-bb71-15bfc5586344 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:41.090290 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-d3e6b23e-d1e1-41d7-bb71-15bfc5586344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:41.098927 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-38b95b9b-3156-4c83-94d9-1dd7688f893b admin admin] The token cache is being invalidate because project cc8eb49064364d63b32d28746f37d702 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:37:41.099781 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-38b95b9b-3156-4c83-94d9-1dd7688f893b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:41.100906 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-38b95b9b-3156-4c83-94d9-1dd7688f893b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:41.103133 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:41.103906 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 924/1883] 10.222.0.118 () {58 vars in 1237 bytes} [Thu Jul 14 15:37:40 2022] DELETE /identity/v3/projects/cc8eb49064364d63b32d28746f37d702 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:37:41.108783 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b95b9b-3156-4c83-94d9-1dd7688f893b admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:41.112663 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-38b95b9b-3156-4c83-94d9-1dd7688f893b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:41.253226 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b95b9b-3156-4c83-94d9-1dd7688f893b admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:41.259379 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e094f1a-8c3f-454d-8bc9-42546c7c0ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:41.260130 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e094f1a-8c3f-454d-8bc9-42546c7c0ea6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:41.260417 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e094f1a-8c3f-454d-8bc9-42546c7c0ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:41.260699 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e094f1a-8c3f-454d-8bc9-42546c7c0ea6 admin admin] PATH_INFO: `/v3/users/a5d124435d2c43cb92fe90874c2c89b6` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:41.262374 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e094f1a-8c3f-454d-8bc9-42546c7c0ea6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5d124435d2c43cb92fe90874c2c89b6)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:41.265136 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e094f1a-8c3f-454d-8bc9-42546c7c0ea6 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:41.266489 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 960/1884] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:37:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:37:41.272046 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633802d9-52a3-4da6-8026-3ad1a2d70af7 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:41.272464 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633802d9-52a3-4da6-8026-3ad1a2d70af7 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:41.272866 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633802d9-52a3-4da6-8026-3ad1a2d70af7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:41.315687 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-633802d9-52a3-4da6-8026-3ad1a2d70af7 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:41.317356 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-633802d9-52a3-4da6-8026-3ad1a2d70af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:41.331746 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-1e094f1a-8c3f-454d-8bc9-42546c7c0ea6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5d124435d2c43cb92fe90874c2c89b6'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:41.340386 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-1e094f1a-8c3f-454d-8bc9-42546c7c0ea6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5d124435d2c43cb92fe90874c2c89b6'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:41.341354 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-1e094f1a-8c3f-454d-8bc9-42546c7c0ea6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5d124435d2c43cb92fe90874c2c89b6'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:41.342258 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-1e094f1a-8c3f-454d-8bc9-42546c7c0ea6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5d124435d2c43cb92fe90874c2c89b6'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:41.342474 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 961/1885] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:37:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:37:41.348223 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71187461-6229-4bab-a0cc-997e0f3b638e None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:41.348660 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71187461-6229-4bab-a0cc-997e0f3b638e None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:41.349136 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71187461-6229-4bab-a0cc-997e0f3b638e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:41.361307 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-1e094f1a-8c3f-454d-8bc9-42546c7c0ea6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5d124435d2c43cb92fe90874c2c89b6'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:41.383968 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-71187461-6229-4bab-a0cc-997e0f3b638e None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:41.387830 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 925/1886] 10.222.0.118 () {58 vars in 1228 bytes} [Thu Jul 14 15:37:41 2022] DELETE /identity/v3/users/a5d124435d2c43cb92fe90874c2c89b6 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:37:41.390011 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-71187461-6229-4bab-a0cc-997e0f3b638e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:41.391300 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcf7066-d1b0-40cc-a206-afc597ecd1be None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:41.393162 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcf7066-d1b0-40cc-a206-afc597ecd1be None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:41.394229 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcf7066-d1b0-40cc-a206-afc597ecd1be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:41.413468 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:41.448230 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-9fcf7066-d1b0-40cc-a206-afc597ecd1be None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:41.451514 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-9fcf7066-d1b0-40cc-a206-afc597ecd1be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:41.545683 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 962/1887] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:37:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:37:41.545683 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca09d6c2-a138-43bb-abc2-5c1f7adb9787 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:41.547293 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca09d6c2-a138-43bb-abc2-5c1f7adb9787 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:41.547925 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca09d6c2-a138-43bb-abc2-5c1f7adb9787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:41.571146 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-ca09d6c2-a138-43bb-abc2-5c1f7adb9787 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:41.572742 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-ca09d6c2-a138-43bb-abc2-5c1f7adb9787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:41.578842 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 926/1888] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:37:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:37:41.585375 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcf7066-d1b0-40cc-a206-afc597ecd1be None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:41.590899 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 963/1889] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:37:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:37:41.594189 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca09d6c2-a138-43bb-abc2-5c1f7adb9787 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:41.607309 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca09d6c2-a138-43bb-abc2-5c1f7adb9787 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:41.611691 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcf7066-d1b0-40cc-a206-afc597ecd1be None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:41.617086 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91428ebe-5420-43f8-8205-01a77f777210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:41.618382 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91428ebe-5420-43f8-8205-01a77f777210 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:41.618834 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91428ebe-5420-43f8-8205-01a77f777210 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:41.619393 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91428ebe-5420-43f8-8205-01a77f777210 admin admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:41.620451 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91428ebe-5420-43f8-8205-01a77f777210 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:37:41.622775 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91428ebe-5420-43f8-8205-01a77f777210 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:41.625536 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91428ebe-5420-43f8-8205-01a77f777210 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:41.627782 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549832ee-b535-47ba-a741-9d9920b19c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:41.628470 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549832ee-b535-47ba-a741-9d9920b19c50 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:41.628756 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549832ee-b535-47ba-a741-9d9920b19c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:41.629094 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549832ee-b535-47ba-a741-9d9920b19c50 admin admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:41.632864 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549832ee-b535-47ba-a741-9d9920b19c50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:37:41.633216 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549832ee-b535-47ba-a741-9d9920b19c50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:41.635265 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549832ee-b535-47ba-a741-9d9920b19c50 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:41.665536 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 927/1890] 10.222.0.118 () {58 vars in 1157 bytes} [Thu Jul 14 15:37:41 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:37:41.665536 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549832ee-b535-47ba-a741-9d9920b19c50 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:41.667968 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-549832ee-b535-47ba-a741-9d9920b19c50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:41.676931 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 964/1891] 10.222.0.118 () {58 vars in 1157 bytes} [Thu Jul 14 15:37:41 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:37:41.678702 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91428ebe-5420-43f8-8205-01a77f777210 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:41.702256 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91428ebe-5420-43f8-8205-01a77f777210 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:41.710072 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e27fec-47fe-47ab-9a87-d95c0f941d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:41.710977 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e27fec-47fe-47ab-9a87-d95c0f941d60 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:41.712036 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e27fec-47fe-47ab-9a87-d95c0f941d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:41.712470 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e27fec-47fe-47ab-9a87-d95c0f941d60 admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:41.713919 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e27fec-47fe-47ab-9a87-d95c0f941d60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:41.716572 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e27fec-47fe-47ab-9a87-d95c0f941d60 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:41.755808 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549832ee-b535-47ba-a741-9d9920b19c50 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:41.760712 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51945004-fa36-4039-9a34-c728baedab44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b650be8114b64df0ac88441f1c50b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:41.761440 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51945004-fa36-4039-9a34-c728baedab44 service neutron] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:41.762043 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51945004-fa36-4039-9a34-c728baedab44 service neutron] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:41.762463 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51945004-fa36-4039-9a34-c728baedab44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:41.775999 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51945004-fa36-4039-9a34-c728baedab44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:41.778030 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51945004-fa36-4039-9a34-c728baedab44 service neutron] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:41.791587 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 928/1892] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:37:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:37:41.792630 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51945004-fa36-4039-9a34-c728baedab44 service neutron] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:41.806510 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51945004-fa36-4039-9a34-c728baedab44 service neutron] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:41.817144 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 965/1893] 10.222.0.118 () {60 vars in 1157 bytes} [Thu Jul 14 15:37:41 2022] POST /identity/v3/projects => generated 364 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:37:41.820332 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e27fec-47fe-47ab-9a87-d95c0f941d60 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:41.909998 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0492ef-9be8-4636-8086-1e6acc87672a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:41.910688 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0492ef-9be8-4636-8086-1e6acc87672a admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:41.911074 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0492ef-9be8-4636-8086-1e6acc87672a admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:41.911299 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0492ef-9be8-4636-8086-1e6acc87672a admin admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:41.912152 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0492ef-9be8-4636-8086-1e6acc87672a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:41.916083 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0492ef-9be8-4636-8086-1e6acc87672a admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:41.975061 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e27fec-47fe-47ab-9a87-d95c0f941d60 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:41.982005 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:41.982586 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 929/1894] 10.222.0.118 () {60 vars in 1157 bytes} [Thu Jul 14 15:37:41 2022] POST /identity/v3/projects => generated 374 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:37:41.989327 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0492ef-9be8-4636-8086-1e6acc87672a admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:42.058429 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:42.077570 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1375d55-1734-4dda-ab85-aaa9f816ce4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:42.078748 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1375d55-1734-4dda-ab85-aaa9f816ce4a admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:42.079100 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1375d55-1734-4dda-ab85-aaa9f816ce4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:42.079414 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1375d55-1734-4dda-ab85-aaa9f816ce4a admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:42.080193 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1375d55-1734-4dda-ab85-aaa9f816ce4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:42.082946 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1375d55-1734-4dda-ab85-aaa9f816ce4a admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:42.165591 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 966/1895] 10.222.0.118 () {60 vars in 1148 bytes} [Thu Jul 14 15:37:41 2022] POST /identity/v3/users => generated 283 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:37:42.167102 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1375d55-1734-4dda-ab85-aaa9f816ce4a admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:42.189530 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0492ef-9be8-4636-8086-1e6acc87672a admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:42.194273 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1375d55-1734-4dda-ab85-aaa9f816ce4a admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:42.197149 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d72ebc-ab9e-4f99-a152-f02cd67d567f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:42.198049 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d72ebc-ab9e-4f99-a152-f02cd67d567f admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:42.198460 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d72ebc-ab9e-4f99-a152-f02cd67d567f admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:42.198845 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d72ebc-ab9e-4f99-a152-f02cd67d567f admin admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:42.200177 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d72ebc-ab9e-4f99-a152-f02cd67d567f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:42.203321 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d72ebc-ab9e-4f99-a152-f02cd67d567f admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:42.204130 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3fbb6b-ccff-4793-95d1-07c8ed42a8a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:42.205044 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3fbb6b-ccff-4793-95d1-07c8ed42a8a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:42.205455 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3fbb6b-ccff-4793-95d1-07c8ed42a8a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:42.205865 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3fbb6b-ccff-4793-95d1-07c8ed42a8a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:42.206770 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3fbb6b-ccff-4793-95d1-07c8ed42a8a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:42.208543 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3fbb6b-ccff-4793-95d1-07c8ed42a8a8 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:42.232220 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 967/1896] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:37:42 2022] GET /identity/v3/roles => generated 1427 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:37:42.233160 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3fbb6b-ccff-4793-95d1-07c8ed42a8a8 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:42.234570 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 930/1897] 10.222.0.118 () {60 vars in 1148 bytes} [Thu Jul 14 15:37:41 2022] POST /identity/v3/users => generated 288 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:37:42.239947 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d72ebc-ab9e-4f99-a152-f02cd67d567f admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:42.248634 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3fbb6b-ccff-4793-95d1-07c8ed42a8a8 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:42.255375 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05e2a67-1514-4c9e-87b4-a4e4f9badfd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:42.256055 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05e2a67-1514-4c9e-87b4-a4e4f9badfd5 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:42.256422 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05e2a67-1514-4c9e-87b4-a4e4f9badfd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:42.256702 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05e2a67-1514-4c9e-87b4-a4e4f9badfd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:42.257455 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05e2a67-1514-4c9e-87b4-a4e4f9badfd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:42.259577 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05e2a67-1514-4c9e-87b4-a4e4f9badfd5 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:42.265319 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d72ebc-ab9e-4f99-a152-f02cd67d567f admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:42.272647 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c733ab7-d6bd-41f2-8770-7b7f480ecfa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:42.273653 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c733ab7-d6bd-41f2-8770-7b7f480ecfa1 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:42.274935 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c733ab7-d6bd-41f2-8770-7b7f480ecfa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:42.275325 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c733ab7-d6bd-41f2-8770-7b7f480ecfa1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:42.276239 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c733ab7-d6bd-41f2-8770-7b7f480ecfa1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:42.278299 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c733ab7-d6bd-41f2-8770-7b7f480ecfa1 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:42.280684 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 968/1898] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:37:42 2022] GET /identity/v3/roles => generated 1427 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:37:42.281614 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05e2a67-1514-4c9e-87b4-a4e4f9badfd5 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:42.293049 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05e2a67-1514-4c9e-87b4-a4e4f9badfd5 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:42.294481 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 931/1899] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:37:42 2022] GET /identity/v3/roles => generated 1427 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:37:42.297987 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c733ab7-d6bd-41f2-8770-7b7f480ecfa1 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:42.301734 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1da2ed2-8d71-4990-a030-8d9cfb662b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:42.302749 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1da2ed2-8d71-4990-a030-8d9cfb662b31 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:42.303342 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1da2ed2-8d71-4990-a030-8d9cfb662b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:42.303695 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1da2ed2-8d71-4990-a030-8d9cfb662b31 admin admin] PATH_INFO: `/v3/projects/b6dab63c0bc74ec4b1760cf6032e234a/users/221cb3a922b24df4a683cfdba7053c87/roles/4abcf5e5e7cd4b53ae1828fec6550d53` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:42.312078 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c733ab7-d6bd-41f2-8770-7b7f480ecfa1 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:42.318535 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe05016-aa9e-46f2-95c7-eb337a525531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:42.319642 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe05016-aa9e-46f2-95c7-eb337a525531 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:42.320119 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe05016-aa9e-46f2-95c7-eb337a525531 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:42.320652 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe05016-aa9e-46f2-95c7-eb337a525531 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:42.321860 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe05016-aa9e-46f2-95c7-eb337a525531 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:42.325160 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe05016-aa9e-46f2-95c7-eb337a525531 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:42.328041 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1da2ed2-8d71-4990-a030-8d9cfb662b31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6dab63c0bc74ec4b1760cf6032e234a, user_id=221cb3a922b24df4a683cfdba7053c87, role_id=4abcf5e5e7cd4b53ae1828fec6550d53)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:42.331054 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1da2ed2-8d71-4990-a030-8d9cfb662b31 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:42.352812 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 932/1900] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:37:42 2022] GET /identity/v3/roles => generated 1427 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:37:42.354194 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe05016-aa9e-46f2-95c7-eb337a525531 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:42.358402 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 969/1901] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:37:42 2022] PUT /identity/v3/projects/b6dab63c0bc74ec4b1760cf6032e234a/users/221cb3a922b24df4a683cfdba7053c87/roles/4abcf5e5e7cd4b53ae1828fec6550d53 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:37:42.375715 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff876f0-9549-4d3e-90b0-125f2842c411 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:42.376048 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff876f0-9549-4d3e-90b0-125f2842c411 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:42.376699 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff876f0-9549-4d3e-90b0-125f2842c411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:42.388064 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe05016-aa9e-46f2-95c7-eb337a525531 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:42.420507 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-fff876f0-9549-4d3e-90b0-125f2842c411 None None] MFA Rules not processed for user `221cb3a922b24df4a683cfdba7053c87`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:42.422430 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-fff876f0-9549-4d3e-90b0-125f2842c411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:42.510225 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a902cfc9-92d1-4c9d-937d-6f3b48b0713d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:42.512309 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a902cfc9-92d1-4c9d-937d-6f3b48b0713d admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:42.512842 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a902cfc9-92d1-4c9d-937d-6f3b48b0713d admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:42.513324 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a902cfc9-92d1-4c9d-937d-6f3b48b0713d admin admin] PATH_INFO: `/v3/projects/3bd24feb6f704e228b07e42a6ef647ab/users/97fb6324ba864fa0a3ea4cf9fe87f46d/roles/4abcf5e5e7cd4b53ae1828fec6550d53` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:42.535886 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a902cfc9-92d1-4c9d-937d-6f3b48b0713d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bd24feb6f704e228b07e42a6ef647ab, user_id=97fb6324ba864fa0a3ea4cf9fe87f46d, role_id=4abcf5e5e7cd4b53ae1828fec6550d53)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:42.539231 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 970/1902] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:37:42 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:37:42.540413 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a902cfc9-92d1-4c9d-937d-6f3b48b0713d admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:42.540551 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff876f0-9549-4d3e-90b0-125f2842c411 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:42.542480 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-fff876f0-9549-4d3e-90b0-125f2842c411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:42.557986 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 933/1903] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:37:42 2022] PUT /identity/v3/projects/3bd24feb6f704e228b07e42a6ef647ab/users/97fb6324ba864fa0a3ea4cf9fe87f46d/roles/4abcf5e5e7cd4b53ae1828fec6550d53 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:37:42.558984 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a902cfc9-92d1-4c9d-937d-6f3b48b0713d admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:42.571143 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff876f0-9549-4d3e-90b0-125f2842c411 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:42.628560 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:42.652295 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e28b26-ae26-47ac-b690-6b7be2ff33fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:42.653705 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e28b26-ae26-47ac-b690-6b7be2ff33fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:42.654061 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e28b26-ae26-47ac-b690-6b7be2ff33fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:42.654362 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e28b26-ae26-47ac-b690-6b7be2ff33fd admin admin] PATH_INFO: `/v3/projects/4e9cd5b6c30f48c2bebe1dc018cddfe9` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:42.655925 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a902cfc9-92d1-4c9d-937d-6f3b48b0713d admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:42.657807 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e28b26-ae26-47ac-b690-6b7be2ff33fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e9cd5b6c30f48c2bebe1dc018cddfe9)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:42.660454 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e28b26-ae26-47ac-b690-6b7be2ff33fd admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:42.662713 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822ec9c5-6231-4679-bd94-1516c7ec4385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:42.663784 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ec9c5-6231-4679-bd94-1516c7ec4385 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:42.664162 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ec9c5-6231-4679-bd94-1516c7ec4385 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:42.664534 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ec9c5-6231-4679-bd94-1516c7ec4385 admin admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:42.665334 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822ec9c5-6231-4679-bd94-1516c7ec4385 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:42.667377 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822ec9c5-6231-4679-bd94-1516c7ec4385 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:42.699358 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:42.716122 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 934/1904] 10.222.0.118 () {60 vars in 1157 bytes} [Thu Jul 14 15:37:42 2022] POST /identity/v3/projects => generated 366 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:37:42.717629 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905df66b-97f4-4f6e-967d-9716aa83cd77 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:42.717930 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905df66b-97f4-4f6e-967d-9716aa83cd77 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:42.718306 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905df66b-97f4-4f6e-967d-9716aa83cd77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:42.762710 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-905df66b-97f4-4f6e-967d-9716aa83cd77 None None] MFA Rules not processed for user `97fb6324ba864fa0a3ea4cf9fe87f46d`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:42.764395 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-905df66b-97f4-4f6e-967d-9716aa83cd77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:42.795772 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-40e28b26-ae26-47ac-b690-6b7be2ff33fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e9cd5b6c30f48c2bebe1dc018cddfe9', 'request_id': 'req-40e28b26-ae26-47ac-b690-6b7be2ff33fd'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:42.814417 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-40e28b26-ae26-47ac-b690-6b7be2ff33fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e9cd5b6c30f48c2bebe1dc018cddfe9', 'request_id': 'req-40e28b26-ae26-47ac-b690-6b7be2ff33fd'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:42.839628 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-40e28b26-ae26-47ac-b690-6b7be2ff33fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e9cd5b6c30f48c2bebe1dc018cddfe9', 'request_id': 'req-40e28b26-ae26-47ac-b690-6b7be2ff33fd'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:42.856791 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-40e28b26-ae26-47ac-b690-6b7be2ff33fd admin admin] The token cache is being invalidate because project 4e9cd5b6c30f48c2bebe1dc018cddfe9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:37:42.857084 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-40e28b26-ae26-47ac-b690-6b7be2ff33fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:42.858050 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-40e28b26-ae26-47ac-b690-6b7be2ff33fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:42.859658 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 971/1905] 10.222.0.118 () {58 vars in 1237 bytes} [Thu Jul 14 15:37:42 2022] DELETE /identity/v3/projects/4e9cd5b6c30f48c2bebe1dc018cddfe9 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:37:42.863798 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e28b26-ae26-47ac-b690-6b7be2ff33fd admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:42.865191 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-40e28b26-ae26-47ac-b690-6b7be2ff33fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:42.867234 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 935/1906] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:37:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:37:42.869437 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20726aad-3d68-4c69-b3df-8f7ff98e73ba None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:42.869888 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20726aad-3d68-4c69-b3df-8f7ff98e73ba None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:42.870381 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20726aad-3d68-4c69-b3df-8f7ff98e73ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:42.890674 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-20726aad-3d68-4c69-b3df-8f7ff98e73ba None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:42.892974 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-20726aad-3d68-4c69-b3df-8f7ff98e73ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:42.936736 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e28b26-ae26-47ac-b690-6b7be2ff33fd admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:42.942162 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10017819-16ed-42a8-9b71-5e568bcd9ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:42.943358 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10017819-16ed-42a8-9b71-5e568bcd9ac9 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:42.944348 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10017819-16ed-42a8-9b71-5e568bcd9ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:42.945198 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10017819-16ed-42a8-9b71-5e568bcd9ac9 admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:42.946441 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10017819-16ed-42a8-9b71-5e568bcd9ac9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:42.948651 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10017819-16ed-42a8-9b71-5e568bcd9ac9 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:42.960331 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 936/1907] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:37:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:37:42.961924 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20726aad-3d68-4c69-b3df-8f7ff98e73ba None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:42.968514 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-20726aad-3d68-4c69-b3df-8f7ff98e73ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:42.980370 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 972/1908] 10.222.0.118 () {60 vars in 1148 bytes} [Thu Jul 14 15:37:42 2022] POST /identity/v3/users => generated 290 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:37:42.982189 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdab263-e188-4cbf-9c32-eb4f094dbd8d None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:42.982680 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdab263-e188-4cbf-9c32-eb4f094dbd8d None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:42.982997 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdab263-e188-4cbf-9c32-eb4f094dbd8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:43.010256 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-4cdab263-e188-4cbf-9c32-eb4f094dbd8d None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:43.011903 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-4cdab263-e188-4cbf-9c32-eb4f094dbd8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:43.026479 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 973/1909] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:37:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:37:43.027585 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdab263-e188-4cbf-9c32-eb4f094dbd8d None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:43.040157 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdab263-e188-4cbf-9c32-eb4f094dbd8d None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:43.045397 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a052a0-fcc2-432a-affc-fb96fe6e70b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:43.046908 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a052a0-fcc2-432a-affc-fb96fe6e70b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:43.047649 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a052a0-fcc2-432a-affc-fb96fe6e70b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:43.048037 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a052a0-fcc2-432a-affc-fb96fe6e70b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:43.049054 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a052a0-fcc2-432a-affc-fb96fe6e70b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:43.051371 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a052a0-fcc2-432a-affc-fb96fe6e70b1 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:43.062424 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20726aad-3d68-4c69-b3df-8f7ff98e73ba None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:43.069035 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 974/1910] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:37:43 2022] GET /identity/v3/roles => generated 1427 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:37:43.069512 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb0b4ae-cac3-4835-a66b-f90d9bf181bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea647438ea1c438987f28cbe39c3ff2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:43.070031 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a052a0-fcc2-432a-affc-fb96fe6e70b1 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:43.071416 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb0b4ae-cac3-4835-a66b-f90d9bf181bd service cinder] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:43.072222 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb0b4ae-cac3-4835-a66b-f90d9bf181bd service cinder] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:43.072517 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb0b4ae-cac3-4835-a66b-f90d9bf181bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:43.074623 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-6bb0b4ae-cac3-4835-a66b-f90d9bf181bd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:43.089953 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb0b4ae-cac3-4835-a66b-f90d9bf181bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:43.090839 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a052a0-fcc2-432a-affc-fb96fe6e70b1 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:43.091265 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb0b4ae-cac3-4835-a66b-f90d9bf181bd service cinder] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:43.098980 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c09e0b-e845-418e-8054-bdc155664185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:43.099549 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c09e0b-e845-418e-8054-bdc155664185 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:43.099829 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c09e0b-e845-418e-8054-bdc155664185 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:43.100104 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c09e0b-e845-418e-8054-bdc155664185 admin admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:43.100837 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c09e0b-e845-418e-8054-bdc155664185 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:37:43.101145 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c09e0b-e845-418e-8054-bdc155664185 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:43.102783 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c09e0b-e845-418e-8054-bdc155664185 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:43.108332 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 937/1911] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:37:42 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:37:43.109209 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb0b4ae-cac3-4835-a66b-f90d9bf181bd service cinder] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:43.126447 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 975/1912] 10.222.0.118 () {58 vars in 1157 bytes} [Thu Jul 14 15:37:43 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:37:43.131448 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c09e0b-e845-418e-8054-bdc155664185 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:43.132901 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb0b4ae-cac3-4835-a66b-f90d9bf181bd service cinder] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:43.144691 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a573161-039c-48eb-ac39-4ef27dc780dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:43.145241 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c09e0b-e845-418e-8054-bdc155664185 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:43.146391 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a573161-039c-48eb-ac39-4ef27dc780dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:43.146870 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a573161-039c-48eb-ac39-4ef27dc780dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:43.147313 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a573161-039c-48eb-ac39-4ef27dc780dc admin admin] PATH_INFO: `/v3/projects/139aaed95b604c3db231e889e0dd4214/users/61f5a51d43c24c59954e1467363affc8/roles/3b880cef7dcf4baf87b50f8610c0c56e` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:43.149975 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a38cebc-acb3-40cb-bbef-a9c6fa234557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:43.150642 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a38cebc-acb3-40cb-bbef-a9c6fa234557 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:43.150925 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a38cebc-acb3-40cb-bbef-a9c6fa234557 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:43.151203 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a38cebc-acb3-40cb-bbef-a9c6fa234557 admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:43.151899 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a38cebc-acb3-40cb-bbef-a9c6fa234557 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:43.154060 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a38cebc-acb3-40cb-bbef-a9c6fa234557 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:43.180302 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a573161-039c-48eb-ac39-4ef27dc780dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=139aaed95b604c3db231e889e0dd4214, user_id=61f5a51d43c24c59954e1467363affc8, role_id=3b880cef7dcf4baf87b50f8610c0c56e)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:43.183566 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a573161-039c-48eb-ac39-4ef27dc780dc admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:43.198560 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 976/1913] 10.222.0.118 () {60 vars in 1157 bytes} [Thu Jul 14 15:37:43 2022] POST /identity/v3/projects => generated 376 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:37:43.202306 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a38cebc-acb3-40cb-bbef-a9c6fa234557 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:43.210202 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 938/1914] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:37:43 2022] PUT /identity/v3/projects/139aaed95b604c3db231e889e0dd4214/users/61f5a51d43c24c59954e1467363affc8/roles/3b880cef7dcf4baf87b50f8610c0c56e => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:37:43.211968 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a573161-039c-48eb-ac39-4ef27dc780dc admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:43.218012 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:43.218846 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:43.330642 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a38cebc-acb3-40cb-bbef-a9c6fa234557 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:43.333582 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a573161-039c-48eb-ac39-4ef27dc780dc admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:43.341839 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3260d0f4-8c2b-4ffb-950e-7647452b5be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:43.343840 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07032c1c-f772-4ce2-aaa3-2434f097067b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:43.344350 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3260d0f4-8c2b-4ffb-950e-7647452b5be2 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:43.344601 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07032c1c-f772-4ce2-aaa3-2434f097067b admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:43.344889 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07032c1c-f772-4ce2-aaa3-2434f097067b admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:43.345164 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07032c1c-f772-4ce2-aaa3-2434f097067b admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:43.345884 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3260d0f4-8c2b-4ffb-950e-7647452b5be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:43.346096 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07032c1c-f772-4ce2-aaa3-2434f097067b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:43.346563 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3260d0f4-8c2b-4ffb-950e-7647452b5be2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:43.347585 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3260d0f4-8c2b-4ffb-950e-7647452b5be2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:43.348045 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07032c1c-f772-4ce2-aaa3-2434f097067b admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:43.350172 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3260d0f4-8c2b-4ffb-950e-7647452b5be2 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:43.373736 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 939/1915] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:37:43 2022] GET /identity/v3/roles => generated 1427 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:37:43.375266 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3260d0f4-8c2b-4ffb-950e-7647452b5be2 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:43.389940 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3260d0f4-8c2b-4ffb-950e-7647452b5be2 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:43.391257 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 977/1916] 10.222.0.118 () {60 vars in 1148 bytes} [Thu Jul 14 15:37:43 2022] POST /identity/v3/users => generated 289 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:37:43.392164 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07032c1c-f772-4ce2-aaa3-2434f097067b admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:43.397555 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec38aa0-fbd1-4e35-a134-cbcc144a6c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:43.398610 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec38aa0-fbd1-4e35-a134-cbcc144a6c40 admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:43.398961 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec38aa0-fbd1-4e35-a134-cbcc144a6c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:43.399830 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec38aa0-fbd1-4e35-a134-cbcc144a6c40 admin admin] PATH_INFO: `/v3/projects/139aaed95b604c3db231e889e0dd4214/users/61f5a51d43c24c59954e1467363affc8/roles/3b880cef7dcf4baf87b50f8610c0c56e` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:43.401828 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec38aa0-fbd1-4e35-a134-cbcc144a6c40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=139aaed95b604c3db231e889e0dd4214, user_id=61f5a51d43c24c59954e1467363affc8, role_id=3b880cef7dcf4baf87b50f8610c0c56e)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:43.403897 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07032c1c-f772-4ce2-aaa3-2434f097067b admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:43.405262 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec38aa0-fbd1-4e35-a134-cbcc144a6c40 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:43.410102 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a27a84-257a-4335-98e4-3a8dff838934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:43.410882 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a27a84-257a-4335-98e4-3a8dff838934 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:43.426003 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 940/1917] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:37:43 2022] PUT /identity/v3/projects/139aaed95b604c3db231e889e0dd4214/users/61f5a51d43c24c59954e1467363affc8/roles/3b880cef7dcf4baf87b50f8610c0c56e => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:37:43.426207 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a27a84-257a-4335-98e4-3a8dff838934 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:43.426207 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a27a84-257a-4335-98e4-3a8dff838934 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:43.426207 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a27a84-257a-4335-98e4-3a8dff838934 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:43.427047 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a27a84-257a-4335-98e4-3a8dff838934 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:43.430998 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d3e1c0-d462-4aba-b5d9-25edc5f25cff None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:43.431282 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d3e1c0-d462-4aba-b5d9-25edc5f25cff None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:43.431583 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d3e1c0-d462-4aba-b5d9-25edc5f25cff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:43.450871 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 978/1918] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:37:43 2022] GET /identity/v3/roles => generated 1427 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:37:43.454757 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a27a84-257a-4335-98e4-3a8dff838934 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:43.470695 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a27a84-257a-4335-98e4-3a8dff838934 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:43.472271 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-e0d3e1c0-d462-4aba-b5d9-25edc5f25cff None None] MFA Rules not processed for user `61f5a51d43c24c59954e1467363affc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:43.473907 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-e0d3e1c0-d462-4aba-b5d9-25edc5f25cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:43.671484 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9908b725-36e1-4f27-8b8c-1ce96aedffd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:43.672782 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9908b725-36e1-4f27-8b8c-1ce96aedffd2 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:43.673285 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9908b725-36e1-4f27-8b8c-1ce96aedffd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:43.674364 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9908b725-36e1-4f27-8b8c-1ce96aedffd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:43.675425 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9908b725-36e1-4f27-8b8c-1ce96aedffd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:43.677412 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9908b725-36e1-4f27-8b8c-1ce96aedffd2 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:43.694082 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 979/1919] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:37:43 2022] GET /identity/v3/roles => generated 1427 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:37:43.695478 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9908b725-36e1-4f27-8b8c-1ce96aedffd2 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:43.701095 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 941/1920] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:37:43 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:37:43.711842 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d3e1c0-d462-4aba-b5d9-25edc5f25cff None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:43.715526 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9908b725-36e1-4f27-8b8c-1ce96aedffd2 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:43.726986 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8392fcc4-ac7f-450e-98ac-7a8e047797ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:43.727923 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8392fcc4-ac7f-450e-98ac-7a8e047797ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:43.728200 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8392fcc4-ac7f-450e-98ac-7a8e047797ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:43.728469 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8392fcc4-ac7f-450e-98ac-7a8e047797ed admin admin] PATH_INFO: `/v3/projects/ede99401953242ae92c905f6a93abe33/users/ebd3947cefcb48cabdb4bbc06a41752a/roles/4abcf5e5e7cd4b53ae1828fec6550d53` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:43.745834 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8392fcc4-ac7f-450e-98ac-7a8e047797ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=ede99401953242ae92c905f6a93abe33, user_id=ebd3947cefcb48cabdb4bbc06a41752a, role_id=4abcf5e5e7cd4b53ae1828fec6550d53)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:43.749810 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8392fcc4-ac7f-450e-98ac-7a8e047797ed admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:43.776169 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 980/1921] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:37:43 2022] PUT /identity/v3/projects/ede99401953242ae92c905f6a93abe33/users/ebd3947cefcb48cabdb4bbc06a41752a/roles/4abcf5e5e7cd4b53ae1828fec6550d53 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:37:43.786821 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b3c420-7731-444b-b5b5-b679d5f1d6f2 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:43.787271 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b3c420-7731-444b-b5b5-b679d5f1d6f2 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:43.787641 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b3c420-7731-444b-b5b5-b679d5f1d6f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:43.855167 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d3e1c0-d462-4aba-b5d9-25edc5f25cff None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:43.859265 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-c4b3c420-7731-444b-b5b5-b679d5f1d6f2 None None] MFA Rules not processed for user `ebd3947cefcb48cabdb4bbc06a41752a`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:43.860507 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-c4b3c420-7731-444b-b5b5-b679d5f1d6f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:43.899871 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:43.945238 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee910c03-ebe5-448f-ae45-2b534d86c2ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea647438ea1c438987f28cbe39c3ff2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:43.947081 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee910c03-ebe5-448f-ae45-2b534d86c2ee service cinder] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:43.947374 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee910c03-ebe5-448f-ae45-2b534d86c2ee service cinder] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:43.947655 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee910c03-ebe5-448f-ae45-2b534d86c2ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:43.959195 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:43.985569 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 981/1922] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:37:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:37:43.997602 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b3c420-7731-444b-b5b5-b679d5f1d6f2 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:44.000624 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-c4b3c420-7731-444b-b5b5-b679d5f1d6f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:44.055810 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee910c03-ebe5-448f-ae45-2b534d86c2ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:44.057135 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee910c03-ebe5-448f-ae45-2b534d86c2ee service cinder] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:44.069415 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 942/1923] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:37:43 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:37:44.111099 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b3c420-7731-444b-b5b5-b679d5f1d6f2 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:44.116157 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc1996b-c656-43f2-813f-1a11d5c043d2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4336c3d678a4d33b00885def42dfb1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:44.116946 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc1996b-c656-43f2-813f-1a11d5c043d2 service glance] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:44.117220 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc1996b-c656-43f2-813f-1a11d5c043d2 service glance] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:44.117494 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc1996b-c656-43f2-813f-1a11d5c043d2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:44.129097 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc1996b-c656-43f2-813f-1a11d5c043d2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:44.130776 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc1996b-c656-43f2-813f-1a11d5c043d2 service glance] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:44.140364 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 982/1924] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:37:43 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:37:44.148575 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee910c03-ebe5-448f-ae45-2b534d86c2ee service cinder] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:44.157641 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee910c03-ebe5-448f-ae45-2b534d86c2ee service cinder] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:44.161839 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec39ab6-135d-4010-8255-50dc07c83b0b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea647438ea1c438987f28cbe39c3ff2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:44.162588 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec39ab6-135d-4010-8255-50dc07c83b0b service cinder] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:44.163095 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec39ab6-135d-4010-8255-50dc07c83b0b service cinder] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:44.163374 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec39ab6-135d-4010-8255-50dc07c83b0b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:44.165199 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-bec39ab6-135d-4010-8255-50dc07c83b0b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:44.331283 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec39ab6-135d-4010-8255-50dc07c83b0b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:44.332754 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec39ab6-135d-4010-8255-50dc07c83b0b service cinder] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:44.359496 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 943/1925] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:37:44 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:37:46.585559 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc1996b-c656-43f2-813f-1a11d5c043d2 service glance] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:46.587007 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-5cc1996b-c656-43f2-813f-1a11d5c043d2 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:46.665275 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc1996b-c656-43f2-813f-1a11d5c043d2 service glance] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:46.670721 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994510af-199e-4073-9185-e66355a9f476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:46.671122 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994510af-199e-4073-9185-e66355a9f476 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:46.671395 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994510af-199e-4073-9185-e66355a9f476 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:46.671670 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994510af-199e-4073-9185-e66355a9f476 admin admin] PATH_INFO: `/v3/users/97fb6324ba864fa0a3ea4cf9fe87f46d` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:46.673042 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994510af-199e-4073-9185-e66355a9f476 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97fb6324ba864fa0a3ea4cf9fe87f46d)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:46.675599 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994510af-199e-4073-9185-e66355a9f476 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:46.750835 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-994510af-199e-4073-9185-e66355a9f476 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97fb6324ba864fa0a3ea4cf9fe87f46d'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:46.759757 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-994510af-199e-4073-9185-e66355a9f476 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97fb6324ba864fa0a3ea4cf9fe87f46d'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:46.760744 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-994510af-199e-4073-9185-e66355a9f476 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97fb6324ba864fa0a3ea4cf9fe87f46d'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:46.761552 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-994510af-199e-4073-9185-e66355a9f476 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97fb6324ba864fa0a3ea4cf9fe87f46d'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:46.775844 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-994510af-199e-4073-9185-e66355a9f476 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97fb6324ba864fa0a3ea4cf9fe87f46d'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:46.781603 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:46.800246 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 983/1926] 10.222.0.118 () {58 vars in 1228 bytes} [Thu Jul 14 15:37:46 2022] DELETE /identity/v3/users/97fb6324ba864fa0a3ea4cf9fe87f46d => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:37:46.806566 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2823e122-0a6f-48da-83a3-4a5f159765f1 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:46.807101 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2823e122-0a6f-48da-83a3-4a5f159765f1 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:46.807101 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2823e122-0a6f-48da-83a3-4a5f159765f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:46.831034 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-2823e122-0a6f-48da-83a3-4a5f159765f1 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:46.832910 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-2823e122-0a6f-48da-83a3-4a5f159765f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:46.981581 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 944/1927] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:37:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:37:47.045944 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994510af-199e-4073-9185-e66355a9f476 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:47.048151 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-994510af-199e-4073-9185-e66355a9f476 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:47.135513 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994510af-199e-4073-9185-e66355a9f476 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:47.139480 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f4619b-c6c0-4d05-8dc3-303471054cfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b650be8114b64df0ac88441f1c50b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:47.140156 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f4619b-c6c0-4d05-8dc3-303471054cfd service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:47.141036 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f4619b-c6c0-4d05-8dc3-303471054cfd service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:47.141621 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f4619b-c6c0-4d05-8dc3-303471054cfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:47.157497 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f4619b-c6c0-4d05-8dc3-303471054cfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:47.159697 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f4619b-c6c0-4d05-8dc3-303471054cfd service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:47.173482 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 984/1928] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:37:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:37:47.279587 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2823e122-0a6f-48da-83a3-4a5f159765f1 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:47.281177 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-2823e122-0a6f-48da-83a3-4a5f159765f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:47.293943 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2823e122-0a6f-48da-83a3-4a5f159765f1 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:47.299502 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cbbc43-a5a4-4d6a-88bb-fe6da5466f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:47.300460 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cbbc43-a5a4-4d6a-88bb-fe6da5466f0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:47.300741 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cbbc43-a5a4-4d6a-88bb-fe6da5466f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:47.301019 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cbbc43-a5a4-4d6a-88bb-fe6da5466f0f admin admin] PATH_INFO: `/v3/users/221cb3a922b24df4a683cfdba7053c87` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:47.302267 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cbbc43-a5a4-4d6a-88bb-fe6da5466f0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=221cb3a922b24df4a683cfdba7053c87)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:47.304202 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cbbc43-a5a4-4d6a-88bb-fe6da5466f0f admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:47.323559 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:47.375702 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-76cbbc43-a5a4-4d6a-88bb-fe6da5466f0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '221cb3a922b24df4a683cfdba7053c87'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:47.383897 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-76cbbc43-a5a4-4d6a-88bb-fe6da5466f0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '221cb3a922b24df4a683cfdba7053c87'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:47.384250 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-76cbbc43-a5a4-4d6a-88bb-fe6da5466f0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '221cb3a922b24df4a683cfdba7053c87'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:47.384831 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-76cbbc43-a5a4-4d6a-88bb-fe6da5466f0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '221cb3a922b24df4a683cfdba7053c87'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:47.403433 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-76cbbc43-a5a4-4d6a-88bb-fe6da5466f0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '221cb3a922b24df4a683cfdba7053c87'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:47.427334 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 945/1929] 10.222.0.118 () {58 vars in 1228 bytes} [Thu Jul 14 15:37:47 2022] DELETE /identity/v3/users/221cb3a922b24df4a683cfdba7053c87 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:37:47.431220 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aa9eec-b59d-4816-bf05-7def103b4e56 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:47.433015 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aa9eec-b59d-4816-bf05-7def103b4e56 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:47.433315 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aa9eec-b59d-4816-bf05-7def103b4e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:47.453443 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-b6aa9eec-b59d-4816-bf05-7def103b4e56 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:47.456191 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-b6aa9eec-b59d-4816-bf05-7def103b4e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:47.535752 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cbbc43-a5a4-4d6a-88bb-fe6da5466f0f admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:47.537612 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-76cbbc43-a5a4-4d6a-88bb-fe6da5466f0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:47.580311 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 985/1930] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:37:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:37:47.595212 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aa9eec-b59d-4816-bf05-7def103b4e56 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:47.598273 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-b6aa9eec-b59d-4816-bf05-7def103b4e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:47.707243 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cbbc43-a5a4-4d6a-88bb-fe6da5466f0f admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:47.742064 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1651444c-f5fa-4d94-a7e4-48a36224dcf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:47.743030 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1651444c-f5fa-4d94-a7e4-48a36224dcf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:47.744060 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1651444c-f5fa-4d94-a7e4-48a36224dcf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:47.744060 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1651444c-f5fa-4d94-a7e4-48a36224dcf7 admin admin] PATH_INFO: `/v3/projects/3bd24feb6f704e228b07e42a6ef647ab` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:47.746542 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1651444c-f5fa-4d94-a7e4-48a36224dcf7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bd24feb6f704e228b07e42a6ef647ab)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:47.749216 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1651444c-f5fa-4d94-a7e4-48a36224dcf7 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:47.769920 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aa9eec-b59d-4816-bf05-7def103b4e56 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:47.777349 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afb8383-7f94-44ad-8464-70ce424bf7b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b650be8114b64df0ac88441f1c50b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:47.780419 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb8383-7f94-44ad-8464-70ce424bf7b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:47.782052 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb8383-7f94-44ad-8464-70ce424bf7b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:47.784139 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb8383-7f94-44ad-8464-70ce424bf7b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:47.811572 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afb8383-7f94-44ad-8464-70ce424bf7b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:47.813616 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afb8383-7f94-44ad-8464-70ce424bf7b1 service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:47.829716 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 986/1931] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:37:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:37:47.889069 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-1651444c-f5fa-4d94-a7e4-48a36224dcf7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bd24feb6f704e228b07e42a6ef647ab', 'request_id': 'req-1651444c-f5fa-4d94-a7e4-48a36224dcf7'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:47.907250 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-1651444c-f5fa-4d94-a7e4-48a36224dcf7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bd24feb6f704e228b07e42a6ef647ab', 'request_id': 'req-1651444c-f5fa-4d94-a7e4-48a36224dcf7'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:47.913728 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-1651444c-f5fa-4d94-a7e4-48a36224dcf7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bd24feb6f704e228b07e42a6ef647ab', 'request_id': 'req-1651444c-f5fa-4d94-a7e4-48a36224dcf7'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:47.930303 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-1651444c-f5fa-4d94-a7e4-48a36224dcf7 admin admin] The token cache is being invalidate because project 3bd24feb6f704e228b07e42a6ef647ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:37:47.930603 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-1651444c-f5fa-4d94-a7e4-48a36224dcf7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:47.931404 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-1651444c-f5fa-4d94-a7e4-48a36224dcf7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:47.933533 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 946/1932] 10.222.0.118 () {58 vars in 1237 bytes} [Thu Jul 14 15:37:47 2022] DELETE /identity/v3/projects/3bd24feb6f704e228b07e42a6ef647ab => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:37:47.938990 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bf7054-0eb5-4185-81c8-018fdd6ede41 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:47.940094 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bf7054-0eb5-4185-81c8-018fdd6ede41 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:47.940222 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bf7054-0eb5-4185-81c8-018fdd6ede41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:47.994131 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-b0bf7054-0eb5-4185-81c8-018fdd6ede41 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:47.994881 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-b0bf7054-0eb5-4185-81c8-018fdd6ede41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:48.085414 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=98 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:48.140254 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 987/1933] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:37:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:37:48.142748 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a8104-53be-41a3-8f4f-ac006a3a80d3 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:48.143198 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a8104-53be-41a3-8f4f-ac006a3a80d3 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:48.144167 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a8104-53be-41a3-8f4f-ac006a3a80d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:48.174583 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-791a8104-53be-41a3-8f4f-ac006a3a80d3 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:48.176119 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-791a8104-53be-41a3-8f4f-ac006a3a80d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:48.185105 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 947/1934] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:37:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:37:48.190081 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bf7054-0eb5-4185-81c8-018fdd6ede41 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:48.202637 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bf7054-0eb5-4185-81c8-018fdd6ede41 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:48.207442 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b54b979-b4e7-46cb-a489-46baf1cb4af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:48.208119 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b54b979-b4e7-46cb-a489-46baf1cb4af0 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:48.208533 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b54b979-b4e7-46cb-a489-46baf1cb4af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:48.208817 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b54b979-b4e7-46cb-a489-46baf1cb4af0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:48.209618 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b54b979-b4e7-46cb-a489-46baf1cb4af0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:37:48.209866 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b54b979-b4e7-46cb-a489-46baf1cb4af0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:48.211530 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b54b979-b4e7-46cb-a489-46baf1cb4af0 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:48.229003 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 988/1935] 10.222.0.118 () {58 vars in 1157 bytes} [Thu Jul 14 15:37:48 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:37:48.230966 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791a8104-53be-41a3-8f4f-ac006a3a80d3 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:48.251034 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791a8104-53be-41a3-8f4f-ac006a3a80d3 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:48.257341 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414c3f68-d64f-4ed5-a416-656a0936f225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:48.258260 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414c3f68-d64f-4ed5-a416-656a0936f225 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:48.258742 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414c3f68-d64f-4ed5-a416-656a0936f225 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:48.259191 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414c3f68-d64f-4ed5-a416-656a0936f225 admin admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:48.260121 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414c3f68-d64f-4ed5-a416-656a0936f225 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:48.262671 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414c3f68-d64f-4ed5-a416-656a0936f225 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:48.272409 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:48.312744 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b54b979-b4e7-46cb-a489-46baf1cb4af0 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:48.314946 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 948/1936] 10.222.0.118 () {60 vars in 1157 bytes} [Thu Jul 14 15:37:48 2022] POST /identity/v3/projects => generated 372 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:37:48.315307 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-7b54b979-b4e7-46cb-a489-46baf1cb4af0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:48.316942 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414c3f68-d64f-4ed5-a416-656a0936f225 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:48.348810 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b54b979-b4e7-46cb-a489-46baf1cb4af0 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:48.539101 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414c3f68-d64f-4ed5-a416-656a0936f225 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:48.553065 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e23521a-5ea5-4e39-b766-c1f1dd2e5dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:48.554121 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e23521a-5ea5-4e39-b766-c1f1dd2e5dc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:48.554409 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e23521a-5ea5-4e39-b766-c1f1dd2e5dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:48.554683 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e23521a-5ea5-4e39-b766-c1f1dd2e5dc0 admin admin] PATH_INFO: `/v3/projects/b6dab63c0bc74ec4b1760cf6032e234a` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:48.556731 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e23521a-5ea5-4e39-b766-c1f1dd2e5dc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6dab63c0bc74ec4b1760cf6032e234a)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:48.558881 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e23521a-5ea5-4e39-b766-c1f1dd2e5dc0 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:48.559668 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fb49fc-822d-4b10-a029-93faf671264a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:48.560906 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fb49fc-822d-4b10-a029-93faf671264a admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:48.561340 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fb49fc-822d-4b10-a029-93faf671264a admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:48.561642 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fb49fc-822d-4b10-a029-93faf671264a admin admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:48.563296 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fb49fc-822d-4b10-a029-93faf671264a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:48.565355 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fb49fc-822d-4b10-a029-93faf671264a admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:48.596487 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 949/1937] 10.222.0.118 () {60 vars in 1148 bytes} [Thu Jul 14 15:37:48 2022] POST /identity/v3/users => generated 287 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:37:48.600813 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fb49fc-822d-4b10-a029-93faf671264a admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:48.633604 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fb49fc-822d-4b10-a029-93faf671264a admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:48.650426 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-6e23521a-5ea5-4e39-b766-c1f1dd2e5dc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6dab63c0bc74ec4b1760cf6032e234a', 'request_id': 'req-6e23521a-5ea5-4e39-b766-c1f1dd2e5dc0'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:48.663232 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-6e23521a-5ea5-4e39-b766-c1f1dd2e5dc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6dab63c0bc74ec4b1760cf6032e234a', 'request_id': 'req-6e23521a-5ea5-4e39-b766-c1f1dd2e5dc0'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:48.671287 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-6e23521a-5ea5-4e39-b766-c1f1dd2e5dc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6dab63c0bc74ec4b1760cf6032e234a', 'request_id': 'req-6e23521a-5ea5-4e39-b766-c1f1dd2e5dc0'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:48.694349 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-6e23521a-5ea5-4e39-b766-c1f1dd2e5dc0 admin admin] The token cache is being invalidate because project b6dab63c0bc74ec4b1760cf6032e234a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:37:48.694349 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-6e23521a-5ea5-4e39-b766-c1f1dd2e5dc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:48.695076 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-6e23521a-5ea5-4e39-b766-c1f1dd2e5dc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:48.710071 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 989/1938] 10.222.0.118 () {58 vars in 1237 bytes} [Thu Jul 14 15:37:48 2022] DELETE /identity/v3/projects/b6dab63c0bc74ec4b1760cf6032e234a => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:37:48.716097 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e23521a-5ea5-4e39-b766-c1f1dd2e5dc0 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:48.725290 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-6e23521a-5ea5-4e39-b766-c1f1dd2e5dc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:48.793870 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c68c42-8453-4cee-9d36-2e77a21f09be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:48.797376 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c68c42-8453-4cee-9d36-2e77a21f09be admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:48.797847 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c68c42-8453-4cee-9d36-2e77a21f09be admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:48.798612 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c68c42-8453-4cee-9d36-2e77a21f09be admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:48.800475 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c68c42-8453-4cee-9d36-2e77a21f09be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:48.804714 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c68c42-8453-4cee-9d36-2e77a21f09be admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:48.840985 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 950/1939] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:37:48 2022] GET /identity/v3/roles => generated 1427 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:37:48.843452 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c68c42-8453-4cee-9d36-2e77a21f09be admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:48.850097 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-00c68c42-8453-4cee-9d36-2e77a21f09be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:48.880955 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:48.883945 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c68c42-8453-4cee-9d36-2e77a21f09be admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:48.900194 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be21f9d8-e807-4afa-afb0-9a12c0311f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:48.900946 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be21f9d8-e807-4afa-afb0-9a12c0311f33 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:48.901299 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be21f9d8-e807-4afa-afb0-9a12c0311f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:48.901633 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be21f9d8-e807-4afa-afb0-9a12c0311f33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:48.902464 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be21f9d8-e807-4afa-afb0-9a12c0311f33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:48.903507 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e23521a-5ea5-4e39-b766-c1f1dd2e5dc0 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:48.905040 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be21f9d8-e807-4afa-afb0-9a12c0311f33 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:48.918852 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7580bb-921f-4828-9a7e-6992be4a1325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:48.921852 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7580bb-921f-4828-9a7e-6992be4a1325 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:48.922164 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7580bb-921f-4828-9a7e-6992be4a1325 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:48.924059 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7580bb-921f-4828-9a7e-6992be4a1325 admin admin] PATH_INFO: `/v3/users/61f5a51d43c24c59954e1467363affc8` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:48.925608 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7580bb-921f-4828-9a7e-6992be4a1325 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61f5a51d43c24c59954e1467363affc8)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:48.928300 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7580bb-921f-4828-9a7e-6992be4a1325 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:48.937183 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 951/1940] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:37:48 2022] GET /identity/v3/roles => generated 1427 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:37:48.939047 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be21f9d8-e807-4afa-afb0-9a12c0311f33 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:48.961662 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be21f9d8-e807-4afa-afb0-9a12c0311f33 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:48.974166 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bae42d7-bfd5-4b27-a20f-9d749ee8e461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:48.975086 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bae42d7-bfd5-4b27-a20f-9d749ee8e461 admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:48.975366 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bae42d7-bfd5-4b27-a20f-9d749ee8e461 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:48.975730 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bae42d7-bfd5-4b27-a20f-9d749ee8e461 admin admin] PATH_INFO: `/v3/projects/c0239ccc26a74cb7a8f52a4819e59856/users/094fc0a7b58448bba6fdc962d519d126/roles/4abcf5e5e7cd4b53ae1828fec6550d53` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:49.000360 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bae42d7-bfd5-4b27-a20f-9d749ee8e461 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0239ccc26a74cb7a8f52a4819e59856, user_id=094fc0a7b58448bba6fdc962d519d126, role_id=4abcf5e5e7cd4b53ae1828fec6550d53)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:49.003695 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bae42d7-bfd5-4b27-a20f-9d749ee8e461 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:49.041022 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 952/1941] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:37:48 2022] PUT /identity/v3/projects/c0239ccc26a74cb7a8f52a4819e59856/users/094fc0a7b58448bba6fdc962d519d126/roles/4abcf5e5e7cd4b53ae1828fec6550d53 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:37:49.044188 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4893bda-1b37-4bce-be79-151daa915a8d None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:49.044482 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4893bda-1b37-4bce-be79-151daa915a8d None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:49.046451 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4893bda-1b37-4bce-be79-151daa915a8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:49.051988 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-cd7580bb-921f-4828-9a7e-6992be4a1325 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61f5a51d43c24c59954e1467363affc8'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:49.073569 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-cd7580bb-921f-4828-9a7e-6992be4a1325 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61f5a51d43c24c59954e1467363affc8'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:49.075361 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-cd7580bb-921f-4828-9a7e-6992be4a1325 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61f5a51d43c24c59954e1467363affc8'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:49.082896 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-cd7580bb-921f-4828-9a7e-6992be4a1325 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61f5a51d43c24c59954e1467363affc8'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:49.100994 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-b4893bda-1b37-4bce-be79-151daa915a8d None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:49.105817 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-b4893bda-1b37-4bce-be79-151daa915a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:49.135203 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-cd7580bb-921f-4828-9a7e-6992be4a1325 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61f5a51d43c24c59954e1467363affc8'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:49.177343 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 990/1942] 10.222.0.118 () {58 vars in 1228 bytes} [Thu Jul 14 15:37:48 2022] DELETE /identity/v3/users/61f5a51d43c24c59954e1467363affc8 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:37:49.199537 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:49.243859 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 953/1943] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:37:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:37:49.290705 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7580bb-921f-4828-9a7e-6992be4a1325 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:49.295352 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-cd7580bb-921f-4828-9a7e-6992be4a1325 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:49.418297 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7580bb-921f-4828-9a7e-6992be4a1325 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:49.424235 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4551027f-73a1-4bdf-a947-6fee828a5b4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b650be8114b64df0ac88441f1c50b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:49.425266 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4551027f-73a1-4bdf-a947-6fee828a5b4c service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:49.425546 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4551027f-73a1-4bdf-a947-6fee828a5b4c service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:49.425813 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4551027f-73a1-4bdf-a947-6fee828a5b4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:49.627611 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4551027f-73a1-4bdf-a947-6fee828a5b4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:49.631181 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4551027f-73a1-4bdf-a947-6fee828a5b4c service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:49.651242 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 991/1944] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:37:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:37:50.183842 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4893bda-1b37-4bce-be79-151daa915a8d None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:50.189552 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-b4893bda-1b37-4bce-be79-151daa915a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:50.213620 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4893bda-1b37-4bce-be79-151daa915a8d None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:50.223101 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77387c13-8e8d-4007-bf31-10f4c66ca794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:50.224968 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77387c13-8e8d-4007-bf31-10f4c66ca794 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:50.225538 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77387c13-8e8d-4007-bf31-10f4c66ca794 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:50.227494 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77387c13-8e8d-4007-bf31-10f4c66ca794 admin admin] PATH_INFO: `/v3/projects/139aaed95b604c3db231e889e0dd4214` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:50.228803 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77387c13-8e8d-4007-bf31-10f4c66ca794 admin admin] RBAC: Authorizing `identity:delete_project(project_id=139aaed95b604c3db231e889e0dd4214)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:50.230955 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77387c13-8e8d-4007-bf31-10f4c66ca794 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:50.341776 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-77387c13-8e8d-4007-bf31-10f4c66ca794 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '139aaed95b604c3db231e889e0dd4214', 'request_id': 'req-77387c13-8e8d-4007-bf31-10f4c66ca794'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:50.349323 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-77387c13-8e8d-4007-bf31-10f4c66ca794 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '139aaed95b604c3db231e889e0dd4214', 'request_id': 'req-77387c13-8e8d-4007-bf31-10f4c66ca794'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:50.360377 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-77387c13-8e8d-4007-bf31-10f4c66ca794 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '139aaed95b604c3db231e889e0dd4214', 'request_id': 'req-77387c13-8e8d-4007-bf31-10f4c66ca794'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:50.378179 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-77387c13-8e8d-4007-bf31-10f4c66ca794 admin admin] The token cache is being invalidate because project 139aaed95b604c3db231e889e0dd4214 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:37:50.378464 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-77387c13-8e8d-4007-bf31-10f4c66ca794 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:50.379100 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-77387c13-8e8d-4007-bf31-10f4c66ca794 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:50.382000 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 954/1945] 10.222.0.118 () {58 vars in 1237 bytes} [Thu Jul 14 15:37:50 2022] DELETE /identity/v3/projects/139aaed95b604c3db231e889e0dd4214 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:37:50.385861 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5599099a-b50c-45ad-8f09-e09740fa1340 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:50.386285 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5599099a-b50c-45ad-8f09-e09740fa1340 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:50.386641 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5599099a-b50c-45ad-8f09-e09740fa1340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:50.409738 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-5599099a-b50c-45ad-8f09-e09740fa1340 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:50.411310 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-5599099a-b50c-45ad-8f09-e09740fa1340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:50.438657 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:50.493536 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 992/1946] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:37:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:37:50.504013 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0de060-2d3e-40ce-b3f5-75a51efe7414 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:50.504493 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0de060-2d3e-40ce-b3f5-75a51efe7414 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:50.504776 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0de060-2d3e-40ce-b3f5-75a51efe7414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:50.526972 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-ac0de060-2d3e-40ce-b3f5-75a51efe7414 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:50.528902 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-ac0de060-2d3e-40ce-b3f5-75a51efe7414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:50.538742 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 955/1947] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:37:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:37:50.545568 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5599099a-b50c-45ad-8f09-e09740fa1340 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:50.554416 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5599099a-b50c-45ad-8f09-e09740fa1340 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:50.586806 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a457c9de-af74-4f90-8b3c-975c4c66b227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:50.587506 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a457c9de-af74-4f90-8b3c-975c4c66b227 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:50.587787 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a457c9de-af74-4f90-8b3c-975c4c66b227 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:50.588488 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a457c9de-af74-4f90-8b3c-975c4c66b227 admin admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:50.588954 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a457c9de-af74-4f90-8b3c-975c4c66b227 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:37:50.589267 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a457c9de-af74-4f90-8b3c-975c4c66b227 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:50.590931 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a457c9de-af74-4f90-8b3c-975c4c66b227 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:50.610724 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 993/1948] 10.222.0.118 () {58 vars in 1157 bytes} [Thu Jul 14 15:37:50 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:37:50.611565 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0de060-2d3e-40ce-b3f5-75a51efe7414 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:50.622614 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0de060-2d3e-40ce-b3f5-75a51efe7414 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:50.641106 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac1848f-e865-46d8-ba74-c50cc2aa60db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:50.641787 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac1848f-e865-46d8-ba74-c50cc2aa60db admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:50.642238 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac1848f-e865-46d8-ba74-c50cc2aa60db admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:50.643154 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac1848f-e865-46d8-ba74-c50cc2aa60db admin admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:50.643998 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac1848f-e865-46d8-ba74-c50cc2aa60db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:50.654679 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac1848f-e865-46d8-ba74-c50cc2aa60db admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:50.699167 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 956/1949] 10.222.0.118 () {60 vars in 1157 bytes} [Thu Jul 14 15:37:50 2022] POST /identity/v3/projects => generated 382 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:37:50.701429 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a457c9de-af74-4f90-8b3c-975c4c66b227 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:50.713526 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a457c9de-af74-4f90-8b3c-975c4c66b227 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:50.792998 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6cb40f-272c-474b-b1a4-63f48bf3a4ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:50.793682 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6cb40f-272c-474b-b1a4-63f48bf3a4ab admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:50.793982 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6cb40f-272c-474b-b1a4-63f48bf3a4ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:50.794338 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6cb40f-272c-474b-b1a4-63f48bf3a4ab admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:50.795025 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6cb40f-272c-474b-b1a4-63f48bf3a4ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:50.797068 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6cb40f-272c-474b-b1a4-63f48bf3a4ab admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:50.823675 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 994/1950] 10.222.0.118 () {60 vars in 1148 bytes} [Thu Jul 14 15:37:50 2022] POST /identity/v3/users => generated 292 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:37:50.831818 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac1848f-e865-46d8-ba74-c50cc2aa60db admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:50.849240 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac1848f-e865-46d8-ba74-c50cc2aa60db admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:50.854542 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3ecf37-93d8-4214-9b29-da152c44180c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:50.855577 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3ecf37-93d8-4214-9b29-da152c44180c admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:50.855954 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3ecf37-93d8-4214-9b29-da152c44180c admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:50.856325 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3ecf37-93d8-4214-9b29-da152c44180c admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:50.857642 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3ecf37-93d8-4214-9b29-da152c44180c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:50.859481 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3ecf37-93d8-4214-9b29-da152c44180c admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:50.873623 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 957/1951] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:37:50 2022] GET /identity/v3/roles => generated 1427 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:37:50.877917 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6cb40f-272c-474b-b1a4-63f48bf3a4ab admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:50.891899 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6cb40f-272c-474b-b1a4-63f48bf3a4ab admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:50.898484 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3e57f9-0141-4dc5-b2e2-8cb9aded233c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:50.899279 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e57f9-0141-4dc5-b2e2-8cb9aded233c admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:50.899810 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e57f9-0141-4dc5-b2e2-8cb9aded233c admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:50.900325 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e57f9-0141-4dc5-b2e2-8cb9aded233c admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:50.901264 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3e57f9-0141-4dc5-b2e2-8cb9aded233c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:50.904534 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3e57f9-0141-4dc5-b2e2-8cb9aded233c admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:50.920635 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 995/1952] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:37:50 2022] GET /identity/v3/roles => generated 1427 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:37:50.923832 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3ecf37-93d8-4214-9b29-da152c44180c admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:50.936265 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3ecf37-93d8-4214-9b29-da152c44180c admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:50.942779 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a60b927-1048-4977-b349-1d1648a8f004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:50.944401 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a60b927-1048-4977-b349-1d1648a8f004 admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:50.945128 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a60b927-1048-4977-b349-1d1648a8f004 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:50.945581 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a60b927-1048-4977-b349-1d1648a8f004 admin admin] PATH_INFO: `/v3/projects/499d0efa1b1743b8a757a5ce473183e3/users/19c2a4601bfd4c12952d5421fd799b73/roles/4abcf5e5e7cd4b53ae1828fec6550d53` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:50.968834 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a60b927-1048-4977-b349-1d1648a8f004 admin admin] RBAC: Authorizing `identity:create_grant(project_id=499d0efa1b1743b8a757a5ce473183e3, user_id=19c2a4601bfd4c12952d5421fd799b73, role_id=4abcf5e5e7cd4b53ae1828fec6550d53)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:50.971935 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a60b927-1048-4977-b349-1d1648a8f004 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:50.989296 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 958/1953] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:37:50 2022] PUT /identity/v3/projects/499d0efa1b1743b8a757a5ce473183e3/users/19c2a4601bfd4c12952d5421fd799b73/roles/4abcf5e5e7cd4b53ae1828fec6550d53 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:37:51.000496 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb72748-035e-416d-88d1-12c38633a377 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:51.000856 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb72748-035e-416d-88d1-12c38633a377 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:51.001214 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb72748-035e-416d-88d1-12c38633a377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:51.041583 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-ddb72748-035e-416d-88d1-12c38633a377 None None] MFA Rules not processed for user `19c2a4601bfd4c12952d5421fd799b73`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:51.043084 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-ddb72748-035e-416d-88d1-12c38633a377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:51.062765 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e537efe3-f8ec-4e79-8dad-15112feb0b79 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:51.063262 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e537efe3-f8ec-4e79-8dad-15112feb0b79 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:51.063646 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e537efe3-f8ec-4e79-8dad-15112feb0b79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:51.091425 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-e537efe3-f8ec-4e79-8dad-15112feb0b79 None None] MFA Rules not processed for user `094fc0a7b58448bba6fdc962d519d126`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:51.092840 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-e537efe3-f8ec-4e79-8dad-15112feb0b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:51.139294 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 996/1954] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:37:50 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:37:51.143999 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb72748-035e-416d-88d1-12c38633a377 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:51.177889 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:51.190395 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:51.230397 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 959/1955] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:37:51 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:37:51.244004 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e537efe3-f8ec-4e79-8dad-15112feb0b79 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:51.247238 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-e537efe3-f8ec-4e79-8dad-15112feb0b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:51.283373 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb72748-035e-416d-88d1-12c38633a377 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:51.304885 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6004333-fb92-4864-b805-585033601c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:51.306050 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6004333-fb92-4864-b805-585033601c10 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:51.306050 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6004333-fb92-4864-b805-585033601c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:51.306238 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6004333-fb92-4864-b805-585033601c10 admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:51.306943 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6004333-fb92-4864-b805-585033601c10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:51.309562 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6004333-fb92-4864-b805-585033601c10 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:51.363168 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e537efe3-f8ec-4e79-8dad-15112feb0b79 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:51.373930 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 997/1956] 10.222.0.118 () {60 vars in 1157 bytes} [Thu Jul 14 15:37:51 2022] POST /identity/v3/projects => generated 382 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:37:51.375171 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6004333-fb92-4864-b805-585033601c10 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:51.447401 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7af27dd-967b-4b0d-ad4d-11780acf253c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea647438ea1c438987f28cbe39c3ff2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:51.448214 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7af27dd-967b-4b0d-ad4d-11780acf253c service cinder] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:51.448600 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7af27dd-967b-4b0d-ad4d-11780acf253c service cinder] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:51.448984 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7af27dd-967b-4b0d-ad4d-11780acf253c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:51.497649 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6004333-fb92-4864-b805-585033601c10 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:51.514587 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd697ae-25a8-45bb-9eaa-f8e28c5516af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:51.514587 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd697ae-25a8-45bb-9eaa-f8e28c5516af admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:51.514587 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd697ae-25a8-45bb-9eaa-f8e28c5516af admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:51.514587 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd697ae-25a8-45bb-9eaa-f8e28c5516af admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:51.515007 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd697ae-25a8-45bb-9eaa-f8e28c5516af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:51.515007 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd697ae-25a8-45bb-9eaa-f8e28c5516af admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:51.532224 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7af27dd-967b-4b0d-ad4d-11780acf253c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:51.534314 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7af27dd-967b-4b0d-ad4d-11780acf253c service cinder] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:51.535553 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 998/1957] 10.222.0.118 () {60 vars in 1148 bytes} [Thu Jul 14 15:37:51 2022] POST /identity/v3/users => generated 298 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:37:51.539302 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd697ae-25a8-45bb-9eaa-f8e28c5516af admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:51.544628 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 960/1958] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:37:51 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:37:51.551705 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd697ae-25a8-45bb-9eaa-f8e28c5516af admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:51.556699 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0314f68a-52e5-44fd-be01-be49ccfaa8c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:51.557622 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0314f68a-52e5-44fd-be01-be49ccfaa8c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:51.557622 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0314f68a-52e5-44fd-be01-be49ccfaa8c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:51.557894 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0314f68a-52e5-44fd-be01-be49ccfaa8c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:51.558648 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0314f68a-52e5-44fd-be01-be49ccfaa8c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:51.560227 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0314f68a-52e5-44fd-be01-be49ccfaa8c6 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:51.577919 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 999/1959] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:37:51 2022] GET /identity/v3/roles => generated 1427 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:37:51.584182 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7af27dd-967b-4b0d-ad4d-11780acf253c service cinder] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:51.595876 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7af27dd-967b-4b0d-ad4d-11780acf253c service cinder] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:51.604063 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2854ebcc-02d0-4e90-b0aa-5f19067cd11d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:51.604998 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2854ebcc-02d0-4e90-b0aa-5f19067cd11d admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:51.605271 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2854ebcc-02d0-4e90-b0aa-5f19067cd11d admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:51.605540 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2854ebcc-02d0-4e90-b0aa-5f19067cd11d admin admin] PATH_INFO: `/v3/projects/639b3b3e79474787b8393caf9a3bbffe/users/f02fa2c644d042b19763c0bad6727d35/roles/3b880cef7dcf4baf87b50f8610c0c56e` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:51.622326 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2854ebcc-02d0-4e90-b0aa-5f19067cd11d admin admin] RBAC: Authorizing `identity:create_grant(project_id=639b3b3e79474787b8393caf9a3bbffe, user_id=f02fa2c644d042b19763c0bad6727d35, role_id=3b880cef7dcf4baf87b50f8610c0c56e)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:51.625125 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2854ebcc-02d0-4e90-b0aa-5f19067cd11d admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:51.643994 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 961/1960] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:37:51 2022] PUT /identity/v3/projects/639b3b3e79474787b8393caf9a3bbffe/users/f02fa2c644d042b19763c0bad6727d35/roles/3b880cef7dcf4baf87b50f8610c0c56e => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:37:51.648862 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0314f68a-52e5-44fd-be01-be49ccfaa8c6 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:51.660536 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0314f68a-52e5-44fd-be01-be49ccfaa8c6 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:51.731514 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e33390-687c-465d-bf1c-c4f7c34c44db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:51.733003 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e33390-687c-465d-bf1c-c4f7c34c44db admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:51.733264 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e33390-687c-465d-bf1c-c4f7c34c44db admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:51.733545 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e33390-687c-465d-bf1c-c4f7c34c44db admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:51.734357 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e33390-687c-465d-bf1c-c4f7c34c44db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:51.737482 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e33390-687c-465d-bf1c-c4f7c34c44db admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:51.754888 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2854ebcc-02d0-4e90-b0aa-5f19067cd11d admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:51.755138 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1000/1961] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:37:51 2022] GET /identity/v3/roles => generated 1427 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:37:51.765996 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2854ebcc-02d0-4e90-b0aa-5f19067cd11d admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:51.772363 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0356a336-e805-44eb-8615-bc0adb8d0081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:51.773558 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0356a336-e805-44eb-8615-bc0adb8d0081 admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:51.773985 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0356a336-e805-44eb-8615-bc0adb8d0081 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:51.774397 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0356a336-e805-44eb-8615-bc0adb8d0081 admin admin] PATH_INFO: `/v3/projects/639b3b3e79474787b8393caf9a3bbffe/users/f02fa2c644d042b19763c0bad6727d35/roles/3b880cef7dcf4baf87b50f8610c0c56e` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:51.776704 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0356a336-e805-44eb-8615-bc0adb8d0081 admin admin] RBAC: Authorizing `identity:create_grant(project_id=639b3b3e79474787b8393caf9a3bbffe, user_id=f02fa2c644d042b19763c0bad6727d35, role_id=3b880cef7dcf4baf87b50f8610c0c56e)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:51.780153 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0356a336-e805-44eb-8615-bc0adb8d0081 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:51.803430 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 962/1962] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:37:51 2022] PUT /identity/v3/projects/639b3b3e79474787b8393caf9a3bbffe/users/f02fa2c644d042b19763c0bad6727d35/roles/3b880cef7dcf4baf87b50f8610c0c56e => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:37:51.807996 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59842d7b-10b6-46a2-b77e-2d107ae8077d None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:51.808482 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59842d7b-10b6-46a2-b77e-2d107ae8077d None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:51.808969 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59842d7b-10b6-46a2-b77e-2d107ae8077d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:51.861191 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-59842d7b-10b6-46a2-b77e-2d107ae8077d None None] MFA Rules not processed for user `f02fa2c644d042b19763c0bad6727d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:51.862689 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-59842d7b-10b6-46a2-b77e-2d107ae8077d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:51.888101 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:52.012947 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1001/1963] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:37:51 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:37:52.041242 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0356a336-e805-44eb-8615-bc0adb8d0081 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:52.078717 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:52.126242 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0356a336-e805-44eb-8615-bc0adb8d0081 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:52.132309 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4140e9fe-a922-450f-a61a-9725ef6cc0fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea647438ea1c438987f28cbe39c3ff2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:52.133391 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4140e9fe-a922-450f-a61a-9725ef6cc0fa service cinder] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:52.133391 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4140e9fe-a922-450f-a61a-9725ef6cc0fa service cinder] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:52.133558 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4140e9fe-a922-450f-a61a-9725ef6cc0fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:52.154501 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4140e9fe-a922-450f-a61a-9725ef6cc0fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:52.156081 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4140e9fe-a922-450f-a61a-9725ef6cc0fa service cinder] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:52.183111 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 963/1964] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:37:52 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:37:52.545180 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59842d7b-10b6-46a2-b77e-2d107ae8077d None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:52.558842 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59842d7b-10b6-46a2-b77e-2d107ae8077d None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:52.565488 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468e2bc8-5d97-4adb-b2c4-8b757a844b1e tempest-VolumeQuotaClassesTest-1861648231 tempest-VolumeQuotaClassesTest-1861648231-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f02fa2c644d042b19763c0bad6727d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639b3b3e79474787b8393caf9a3bbffe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:52.566608 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e2bc8-5d97-4adb-b2c4-8b757a844b1e tempest-VolumeQuotaClassesTest-1861648231 tempest-VolumeQuotaClassesTest-1861648231-project-admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:52.567024 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e2bc8-5d97-4adb-b2c4-8b757a844b1e tempest-VolumeQuotaClassesTest-1861648231 tempest-VolumeQuotaClassesTest-1861648231-project-admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:52.567588 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e2bc8-5d97-4adb-b2c4-8b757a844b1e tempest-VolumeQuotaClassesTest-1861648231 tempest-VolumeQuotaClassesTest-1861648231-project-admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:52.568334 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468e2bc8-5d97-4adb-b2c4-8b757a844b1e tempest-VolumeQuotaClassesTest-1861648231 tempest-VolumeQuotaClassesTest-1861648231-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:37:52.568861 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468e2bc8-5d97-4adb-b2c4-8b757a844b1e tempest-VolumeQuotaClassesTest-1861648231 tempest-VolumeQuotaClassesTest-1861648231-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:52.570782 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468e2bc8-5d97-4adb-b2c4-8b757a844b1e tempest-VolumeQuotaClassesTest-1861648231 tempest-VolumeQuotaClassesTest-1861648231-project-admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:52.585766 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1002/1965] 10.222.0.118 () {58 vars in 1157 bytes} [Thu Jul 14 15:37:52 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:37:52.589699 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4140e9fe-a922-450f-a61a-9725ef6cc0fa service cinder] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:52.607214 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4140e9fe-a922-450f-a61a-9725ef6cc0fa service cinder] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:52.613471 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d0650d-e959-43d8-bbe6-52171d0adbf1 tempest-VolumeQuotaClassesTest-1861648231 tempest-VolumeQuotaClassesTest-1861648231-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f02fa2c644d042b19763c0bad6727d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639b3b3e79474787b8393caf9a3bbffe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:52.614525 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d0650d-e959-43d8-bbe6-52171d0adbf1 tempest-VolumeQuotaClassesTest-1861648231 tempest-VolumeQuotaClassesTest-1861648231-project-admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:52.614829 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d0650d-e959-43d8-bbe6-52171d0adbf1 tempest-VolumeQuotaClassesTest-1861648231 tempest-VolumeQuotaClassesTest-1861648231-project-admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:52.615265 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d0650d-e959-43d8-bbe6-52171d0adbf1 tempest-VolumeQuotaClassesTest-1861648231 tempest-VolumeQuotaClassesTest-1861648231-project-admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:52.616057 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d0650d-e959-43d8-bbe6-52171d0adbf1 tempest-VolumeQuotaClassesTest-1861648231 tempest-VolumeQuotaClassesTest-1861648231-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:52.618177 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d0650d-e959-43d8-bbe6-52171d0adbf1 tempest-VolumeQuotaClassesTest-1861648231 tempest-VolumeQuotaClassesTest-1861648231-project-admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:52.655229 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 964/1966] 10.222.0.118 () {60 vars in 1157 bytes} [Thu Jul 14 15:37:52 2022] POST /identity/v3/projects => generated 355 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:37:52.660194 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468e2bc8-5d97-4adb-b2c4-8b757a844b1e tempest-VolumeQuotaClassesTest-1861648231 tempest-VolumeQuotaClassesTest-1861648231-project-admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:52.671085 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468e2bc8-5d97-4adb-b2c4-8b757a844b1e tempest-VolumeQuotaClassesTest-1861648231 tempest-VolumeQuotaClassesTest-1861648231-project-admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:52.737859 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9314d6d5-e7b2-4a3e-b226-fb8f4de2a939 tempest-VolumeQuotaClassesTest-1861648231 tempest-VolumeQuotaClassesTest-1861648231-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f02fa2c644d042b19763c0bad6727d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639b3b3e79474787b8393caf9a3bbffe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:52.738565 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9314d6d5-e7b2-4a3e-b226-fb8f4de2a939 tempest-VolumeQuotaClassesTest-1861648231 tempest-VolumeQuotaClassesTest-1861648231-project-admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:52.738787 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9314d6d5-e7b2-4a3e-b226-fb8f4de2a939 tempest-VolumeQuotaClassesTest-1861648231 tempest-VolumeQuotaClassesTest-1861648231-project-admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:52.739211 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9314d6d5-e7b2-4a3e-b226-fb8f4de2a939 tempest-VolumeQuotaClassesTest-1861648231 tempest-VolumeQuotaClassesTest-1861648231-project-admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:52.739962 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9314d6d5-e7b2-4a3e-b226-fb8f4de2a939 tempest-VolumeQuotaClassesTest-1861648231 tempest-VolumeQuotaClassesTest-1861648231-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:37:52.740275 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9314d6d5-e7b2-4a3e-b226-fb8f4de2a939 tempest-VolumeQuotaClassesTest-1861648231 tempest-VolumeQuotaClassesTest-1861648231-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:52.741901 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9314d6d5-e7b2-4a3e-b226-fb8f4de2a939 tempest-VolumeQuotaClassesTest-1861648231 tempest-VolumeQuotaClassesTest-1861648231-project-admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:52.758540 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1003/1967] 10.222.0.118 () {58 vars in 1157 bytes} [Thu Jul 14 15:37:52 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:37:52.793563 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d0650d-e959-43d8-bbe6-52171d0adbf1 tempest-VolumeQuotaClassesTest-1861648231 tempest-VolumeQuotaClassesTest-1861648231-project-admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:52.804726 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d0650d-e959-43d8-bbe6-52171d0adbf1 tempest-VolumeQuotaClassesTest-1861648231 tempest-VolumeQuotaClassesTest-1861648231-project-admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:52.809824 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e0c42a-8578-4e56-9592-5f720e3e6f71 tempest-VolumeQuotaClassesTest-1861648231 tempest-VolumeQuotaClassesTest-1861648231-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f02fa2c644d042b19763c0bad6727d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639b3b3e79474787b8393caf9a3bbffe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:52.810855 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e0c42a-8578-4e56-9592-5f720e3e6f71 tempest-VolumeQuotaClassesTest-1861648231 tempest-VolumeQuotaClassesTest-1861648231-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:52.811132 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e0c42a-8578-4e56-9592-5f720e3e6f71 tempest-VolumeQuotaClassesTest-1861648231 tempest-VolumeQuotaClassesTest-1861648231-project-admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:52.811399 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e0c42a-8578-4e56-9592-5f720e3e6f71 tempest-VolumeQuotaClassesTest-1861648231 tempest-VolumeQuotaClassesTest-1861648231-project-admin] PATH_INFO: `/v3/projects/5b5bac6771ca42d6951797b132f5682e` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:52.813053 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e0c42a-8578-4e56-9592-5f720e3e6f71 tempest-VolumeQuotaClassesTest-1861648231 tempest-VolumeQuotaClassesTest-1861648231-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5b5bac6771ca42d6951797b132f5682e)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:52.815515 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e0c42a-8578-4e56-9592-5f720e3e6f71 tempest-VolumeQuotaClassesTest-1861648231 tempest-VolumeQuotaClassesTest-1861648231-project-admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:52.863667 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-37e0c42a-8578-4e56-9592-5f720e3e6f71 tempest-VolumeQuotaClassesTest-1861648231 tempest-VolumeQuotaClassesTest-1861648231-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b5bac6771ca42d6951797b132f5682e', 'request_id': 'req-37e0c42a-8578-4e56-9592-5f720e3e6f71'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:52.869879 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-37e0c42a-8578-4e56-9592-5f720e3e6f71 tempest-VolumeQuotaClassesTest-1861648231 tempest-VolumeQuotaClassesTest-1861648231-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b5bac6771ca42d6951797b132f5682e', 'request_id': 'req-37e0c42a-8578-4e56-9592-5f720e3e6f71'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:52.875661 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-37e0c42a-8578-4e56-9592-5f720e3e6f71 tempest-VolumeQuotaClassesTest-1861648231 tempest-VolumeQuotaClassesTest-1861648231-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b5bac6771ca42d6951797b132f5682e', 'request_id': 'req-37e0c42a-8578-4e56-9592-5f720e3e6f71'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:52.888493 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-37e0c42a-8578-4e56-9592-5f720e3e6f71 tempest-VolumeQuotaClassesTest-1861648231 tempest-VolumeQuotaClassesTest-1861648231-project-admin] The token cache is being invalidate because project 5b5bac6771ca42d6951797b132f5682e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:37:52.888789 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-37e0c42a-8578-4e56-9592-5f720e3e6f71 tempest-VolumeQuotaClassesTest-1861648231 tempest-VolumeQuotaClassesTest-1861648231-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:52.889432 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-37e0c42a-8578-4e56-9592-5f720e3e6f71 tempest-VolumeQuotaClassesTest-1861648231 tempest-VolumeQuotaClassesTest-1861648231-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:52.891069 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 965/1968] 10.222.0.118 () {58 vars in 1237 bytes} [Thu Jul 14 15:37:52 2022] DELETE /identity/v3/projects/5b5bac6771ca42d6951797b132f5682e => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:37:53.098192 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53609ae5-e57d-4e37-936c-b069369e7f3b None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:53.098486 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53609ae5-e57d-4e37-936c-b069369e7f3b None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:53.098789 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53609ae5-e57d-4e37-936c-b069369e7f3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:53.106094 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e0c42a-8578-4e56-9592-5f720e3e6f71 tempest-VolumeQuotaClassesTest-1861648231 tempest-VolumeQuotaClassesTest-1861648231-project-admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:53.108167 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-37e0c42a-8578-4e56-9592-5f720e3e6f71 tempest-VolumeQuotaClassesTest-1861648231 tempest-VolumeQuotaClassesTest-1861648231-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:53.123043 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-53609ae5-e57d-4e37-936c-b069369e7f3b None None] MFA Rules not processed for user `094fc0a7b58448bba6fdc962d519d126`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:53.125524 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-53609ae5-e57d-4e37-936c-b069369e7f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:53.214532 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e0c42a-8578-4e56-9592-5f720e3e6f71 tempest-VolumeQuotaClassesTest-1861648231 tempest-VolumeQuotaClassesTest-1861648231-project-admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:53.230679 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab202b98-6cc2-46ea-aa70-a6ded75b8356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:53.231859 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab202b98-6cc2-46ea-aa70-a6ded75b8356 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:53.232378 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab202b98-6cc2-46ea-aa70-a6ded75b8356 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:53.232585 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab202b98-6cc2-46ea-aa70-a6ded75b8356 admin admin] PATH_INFO: `/v3/users/19c2a4601bfd4c12952d5421fd799b73` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:53.236128 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1004/1969] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:37:53 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:37:53.240404 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab202b98-6cc2-46ea-aa70-a6ded75b8356 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19c2a4601bfd4c12952d5421fd799b73)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:53.242724 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab202b98-6cc2-46ea-aa70-a6ded75b8356 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:53.294903 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:53.327735 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-ab202b98-6cc2-46ea-aa70-a6ded75b8356 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19c2a4601bfd4c12952d5421fd799b73'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:53.337896 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-ab202b98-6cc2-46ea-aa70-a6ded75b8356 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19c2a4601bfd4c12952d5421fd799b73'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:53.338782 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-ab202b98-6cc2-46ea-aa70-a6ded75b8356 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19c2a4601bfd4c12952d5421fd799b73'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:53.339601 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-ab202b98-6cc2-46ea-aa70-a6ded75b8356 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19c2a4601bfd4c12952d5421fd799b73'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:53.356373 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-ab202b98-6cc2-46ea-aa70-a6ded75b8356 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19c2a4601bfd4c12952d5421fd799b73'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:53.372795 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 966/1970] 10.222.0.118 () {58 vars in 1228 bytes} [Thu Jul 14 15:37:53 2022] DELETE /identity/v3/users/19c2a4601bfd4c12952d5421fd799b73 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:37:53.377433 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f6e2e5-64bc-4b7f-8817-53307876f306 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:53.378036 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f6e2e5-64bc-4b7f-8817-53307876f306 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:53.378036 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f6e2e5-64bc-4b7f-8817-53307876f306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:53.423911 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-56f6e2e5-64bc-4b7f-8817-53307876f306 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:53.425989 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-56f6e2e5-64bc-4b7f-8817-53307876f306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:53.472183 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:53.525161 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1005/1971] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:37:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:37:53.539504 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab202b98-6cc2-46ea-aa70-a6ded75b8356 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:53.540953 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-ab202b98-6cc2-46ea-aa70-a6ded75b8356 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:53.628975 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab202b98-6cc2-46ea-aa70-a6ded75b8356 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:53.640927 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e947ded-ae74-4b3e-95fd-f647c31557d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b650be8114b64df0ac88441f1c50b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:53.642676 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e947ded-ae74-4b3e-95fd-f647c31557d9 service neutron] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:53.643161 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e947ded-ae74-4b3e-95fd-f647c31557d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:53.643734 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e947ded-ae74-4b3e-95fd-f647c31557d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:53.657104 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e947ded-ae74-4b3e-95fd-f647c31557d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:53.659832 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e947ded-ae74-4b3e-95fd-f647c31557d9 service neutron] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:53.677583 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 967/1972] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:37:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:37:54.394845 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f6e2e5-64bc-4b7f-8817-53307876f306 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:54.396257 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-56f6e2e5-64bc-4b7f-8817-53307876f306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:54.429662 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f6e2e5-64bc-4b7f-8817-53307876f306 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:54.436350 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975544ba-7176-4736-9f26-49a4db8e0d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:54.437839 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975544ba-7176-4736-9f26-49a4db8e0d7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:54.439462 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975544ba-7176-4736-9f26-49a4db8e0d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:54.439462 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975544ba-7176-4736-9f26-49a4db8e0d7f admin admin] PATH_INFO: `/v3/projects/499d0efa1b1743b8a757a5ce473183e3` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:54.441571 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975544ba-7176-4736-9f26-49a4db8e0d7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=499d0efa1b1743b8a757a5ce473183e3)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:54.444317 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975544ba-7176-4736-9f26-49a4db8e0d7f admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:54.542374 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-975544ba-7176-4736-9f26-49a4db8e0d7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '499d0efa1b1743b8a757a5ce473183e3', 'request_id': 'req-975544ba-7176-4736-9f26-49a4db8e0d7f'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:54.548101 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-975544ba-7176-4736-9f26-49a4db8e0d7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '499d0efa1b1743b8a757a5ce473183e3', 'request_id': 'req-975544ba-7176-4736-9f26-49a4db8e0d7f'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:54.555559 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-975544ba-7176-4736-9f26-49a4db8e0d7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '499d0efa1b1743b8a757a5ce473183e3', 'request_id': 'req-975544ba-7176-4736-9f26-49a4db8e0d7f'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:54.577265 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-975544ba-7176-4736-9f26-49a4db8e0d7f admin admin] The token cache is being invalidate because project 499d0efa1b1743b8a757a5ce473183e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:37:54.578358 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-975544ba-7176-4736-9f26-49a4db8e0d7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:54.580324 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-975544ba-7176-4736-9f26-49a4db8e0d7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:54.586986 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1006/1973] 10.222.0.118 () {58 vars in 1237 bytes} [Thu Jul 14 15:37:54 2022] DELETE /identity/v3/projects/499d0efa1b1743b8a757a5ce473183e3 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:37:54.590899 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e947ded-ae74-4b3e-95fd-f647c31557d9 service neutron] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:54.603829 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e947ded-ae74-4b3e-95fd-f647c31557d9 service neutron] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:54.718574 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477a8392-7f32-49cf-9e2b-7b13330bb5dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:54.719590 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a8392-7f32-49cf-9e2b-7b13330bb5dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:54.719948 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a8392-7f32-49cf-9e2b-7b13330bb5dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:54.721017 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a8392-7f32-49cf-9e2b-7b13330bb5dd admin admin] PATH_INFO: `/v3/users/f02fa2c644d042b19763c0bad6727d35` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:54.723071 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477a8392-7f32-49cf-9e2b-7b13330bb5dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=f02fa2c644d042b19763c0bad6727d35)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:54.728775 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477a8392-7f32-49cf-9e2b-7b13330bb5dd admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:54.839861 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-477a8392-7f32-49cf-9e2b-7b13330bb5dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f02fa2c644d042b19763c0bad6727d35'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:54.843130 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:54.856543 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-477a8392-7f32-49cf-9e2b-7b13330bb5dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f02fa2c644d042b19763c0bad6727d35'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:54.857456 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-477a8392-7f32-49cf-9e2b-7b13330bb5dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f02fa2c644d042b19763c0bad6727d35'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:54.858629 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-477a8392-7f32-49cf-9e2b-7b13330bb5dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f02fa2c644d042b19763c0bad6727d35'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:54.890592 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-477a8392-7f32-49cf-9e2b-7b13330bb5dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f02fa2c644d042b19763c0bad6727d35'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:54.909201 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 968/1974] 10.222.0.118 () {58 vars in 1228 bytes} [Thu Jul 14 15:37:54 2022] DELETE /identity/v3/users/f02fa2c644d042b19763c0bad6727d35 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:37:55.297010 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975544ba-7176-4736-9f26-49a4db8e0d7f admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:55.299047 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-975544ba-7176-4736-9f26-49a4db8e0d7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:55.319813 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975544ba-7176-4736-9f26-49a4db8e0d7f admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:55.419478 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768388c3-8fe6-4268-a373-eb338d2af1b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:55.420350 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768388c3-8fe6-4268-a373-eb338d2af1b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:55.420624 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768388c3-8fe6-4268-a373-eb338d2af1b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:55.420894 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768388c3-8fe6-4268-a373-eb338d2af1b8 admin admin] PATH_INFO: `/v3/projects/639b3b3e79474787b8393caf9a3bbffe` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:55.423017 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768388c3-8fe6-4268-a373-eb338d2af1b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=639b3b3e79474787b8393caf9a3bbffe)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:55.424206 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768388c3-8fe6-4268-a373-eb338d2af1b8 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:55.491222 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-768388c3-8fe6-4268-a373-eb338d2af1b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '639b3b3e79474787b8393caf9a3bbffe', 'request_id': 'req-768388c3-8fe6-4268-a373-eb338d2af1b8'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:55.491222 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:55.491222 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-768388c3-8fe6-4268-a373-eb338d2af1b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '639b3b3e79474787b8393caf9a3bbffe', 'request_id': 'req-768388c3-8fe6-4268-a373-eb338d2af1b8'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:55.501277 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-768388c3-8fe6-4268-a373-eb338d2af1b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '639b3b3e79474787b8393caf9a3bbffe', 'request_id': 'req-768388c3-8fe6-4268-a373-eb338d2af1b8'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:55.522919 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-768388c3-8fe6-4268-a373-eb338d2af1b8 admin admin] The token cache is being invalidate because project 639b3b3e79474787b8393caf9a3bbffe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:37:55.523259 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-768388c3-8fe6-4268-a373-eb338d2af1b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:55.524120 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-768388c3-8fe6-4268-a373-eb338d2af1b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:55.529181 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1007/1975] 10.222.0.118 () {58 vars in 1237 bytes} [Thu Jul 14 15:37:55 2022] DELETE /identity/v3/projects/639b3b3e79474787b8393caf9a3bbffe => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:37:55.530865 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a5041a-5412-48f0-a4be-5b883cc956f4 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:55.531390 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a5041a-5412-48f0-a4be-5b883cc956f4 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:55.531680 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a5041a-5412-48f0-a4be-5b883cc956f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:55.584047 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-d8a5041a-5412-48f0-a4be-5b883cc956f4 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:55.585690 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-d8a5041a-5412-48f0-a4be-5b883cc956f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:55.708716 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 969/1976] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:37:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:37:55.717869 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07515a88-ae3c-4798-9fa7-3f108a2d7d1a None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:55.718308 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07515a88-ae3c-4798-9fa7-3f108a2d7d1a None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:55.718797 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07515a88-ae3c-4798-9fa7-3f108a2d7d1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:55.779961 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-07515a88-ae3c-4798-9fa7-3f108a2d7d1a None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:55.787423 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-07515a88-ae3c-4798-9fa7-3f108a2d7d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:55.805941 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1008/1977] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:37:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:37:55.812481 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a5041a-5412-48f0-a4be-5b883cc956f4 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:55.836010 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a5041a-5412-48f0-a4be-5b883cc956f4 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:55.857459 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d6e616-6d2f-4696-b9cb-505090af3c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:55.858331 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d6e616-6d2f-4696-b9cb-505090af3c95 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:55.858722 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d6e616-6d2f-4696-b9cb-505090af3c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:55.859103 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d6e616-6d2f-4696-b9cb-505090af3c95 admin admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:55.859955 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d6e616-6d2f-4696-b9cb-505090af3c95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:37:55.860388 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d6e616-6d2f-4696-b9cb-505090af3c95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:55.862840 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d6e616-6d2f-4696-b9cb-505090af3c95 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:55.884636 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07515a88-ae3c-4798-9fa7-3f108a2d7d1a None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:55.886320 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 970/1978] 10.222.0.118 () {58 vars in 1157 bytes} [Thu Jul 14 15:37:55 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:37:55.909103 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07515a88-ae3c-4798-9fa7-3f108a2d7d1a None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:55.919597 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7677da0-b890-4fde-ae4a-9939457658f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:55.920443 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7677da0-b890-4fde-ae4a-9939457658f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:55.920827 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7677da0-b890-4fde-ae4a-9939457658f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:55.921203 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7677da0-b890-4fde-ae4a-9939457658f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:55.923934 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7677da0-b890-4fde-ae4a-9939457658f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:55.927080 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7677da0-b890-4fde-ae4a-9939457658f6 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:55.962940 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1009/1979] 10.222.0.118 () {60 vars in 1157 bytes} [Thu Jul 14 15:37:55 2022] POST /identity/v3/projects => generated 384 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:37:55.966523 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d6e616-6d2f-4696-b9cb-505090af3c95 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:55.977201 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d6e616-6d2f-4696-b9cb-505090af3c95 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:56.050358 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35b7e7b-7343-48e3-9afe-16023f7be506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:56.051776 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35b7e7b-7343-48e3-9afe-16023f7be506 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:56.051776 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35b7e7b-7343-48e3-9afe-16023f7be506 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:56.052102 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35b7e7b-7343-48e3-9afe-16023f7be506 admin admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:56.052839 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35b7e7b-7343-48e3-9afe-16023f7be506 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:56.055422 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35b7e7b-7343-48e3-9afe-16023f7be506 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:56.081437 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 971/1980] 10.222.0.118 () {60 vars in 1148 bytes} [Thu Jul 14 15:37:55 2022] POST /identity/v3/users => generated 293 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:37:56.082954 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7677da0-b890-4fde-ae4a-9939457658f6 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:56.096379 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7677da0-b890-4fde-ae4a-9939457658f6 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:56.101177 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70e3d41-2101-4529-ab4f-d06cb37a96d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:56.101863 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e3d41-2101-4529-ab4f-d06cb37a96d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:56.102173 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e3d41-2101-4529-ab4f-d06cb37a96d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:56.102462 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e3d41-2101-4529-ab4f-d06cb37a96d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:56.103214 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70e3d41-2101-4529-ab4f-d06cb37a96d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:56.104850 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70e3d41-2101-4529-ab4f-d06cb37a96d6 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:56.117437 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1010/1981] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:37:56 2022] GET /identity/v3/roles => generated 1427 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:37:56.121511 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35b7e7b-7343-48e3-9afe-16023f7be506 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:56.134758 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35b7e7b-7343-48e3-9afe-16023f7be506 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:56.142382 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382153fc-b2ba-4d2f-9176-bcf97016e774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:56.143571 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382153fc-b2ba-4d2f-9176-bcf97016e774 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:56.144132 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382153fc-b2ba-4d2f-9176-bcf97016e774 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:56.144603 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382153fc-b2ba-4d2f-9176-bcf97016e774 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:56.146009 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382153fc-b2ba-4d2f-9176-bcf97016e774 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:56.149137 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382153fc-b2ba-4d2f-9176-bcf97016e774 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:56.169310 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 972/1982] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:37:56 2022] GET /identity/v3/roles => generated 1427 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:37:56.172116 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70e3d41-2101-4529-ab4f-d06cb37a96d6 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:56.183136 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70e3d41-2101-4529-ab4f-d06cb37a96d6 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:56.187917 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6151331c-9378-4b6d-aac9-92963f0a2f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:56.188862 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6151331c-9378-4b6d-aac9-92963f0a2f90 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:56.189139 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6151331c-9378-4b6d-aac9-92963f0a2f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:56.189412 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6151331c-9378-4b6d-aac9-92963f0a2f90 admin admin] PATH_INFO: `/v3/projects/44aefecec1dd4be9b395aa1ac7941857/users/9d4e72d4bfb143ef8ff5345f4c98897d/roles/4abcf5e5e7cd4b53ae1828fec6550d53` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:56.205606 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6151331c-9378-4b6d-aac9-92963f0a2f90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44aefecec1dd4be9b395aa1ac7941857, user_id=9d4e72d4bfb143ef8ff5345f4c98897d, role_id=4abcf5e5e7cd4b53ae1828fec6550d53)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:56.209101 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6151331c-9378-4b6d-aac9-92963f0a2f90 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:56.238078 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1011/1983] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:37:56 2022] PUT /identity/v3/projects/44aefecec1dd4be9b395aa1ac7941857/users/9d4e72d4bfb143ef8ff5345f4c98897d/roles/4abcf5e5e7cd4b53ae1828fec6550d53 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:37:56.248491 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454f13d5-8b24-40b1-8163-7c850795cd5c None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:56.248783 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454f13d5-8b24-40b1-8163-7c850795cd5c None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:56.249064 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454f13d5-8b24-40b1-8163-7c850795cd5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:56.283435 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-454f13d5-8b24-40b1-8163-7c850795cd5c None None] MFA Rules not processed for user `9d4e72d4bfb143ef8ff5345f4c98897d`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:56.285146 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-454f13d5-8b24-40b1-8163-7c850795cd5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:56.331924 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:56.493687 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6151331c-9378-4b6d-aac9-92963f0a2f90 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:56.494263 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 973/1984] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:37:56 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:37:56.648883 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6151331c-9378-4b6d-aac9-92963f0a2f90 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:56.668489 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c64998-4cd5-4ac7-bbc9-ad00e184b239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:56.669168 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c64998-4cd5-4ac7-bbc9-ad00e184b239 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:56.669461 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c64998-4cd5-4ac7-bbc9-ad00e184b239 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:56.669711 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c64998-4cd5-4ac7-bbc9-ad00e184b239 admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:56.670453 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c64998-4cd5-4ac7-bbc9-ad00e184b239 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:56.672363 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c64998-4cd5-4ac7-bbc9-ad00e184b239 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:56.744339 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1012/1985] 10.222.0.118 () {60 vars in 1157 bytes} [Thu Jul 14 15:37:56 2022] POST /identity/v3/projects => generated 386 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:37:56.751773 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454f13d5-8b24-40b1-8163-7c850795cd5c None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:56.764181 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454f13d5-8b24-40b1-8163-7c850795cd5c None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:56.847863 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a754c6f-78d8-4a07-b7c7-7f2df99e384e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:56.848558 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a754c6f-78d8-4a07-b7c7-7f2df99e384e admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:56.848917 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a754c6f-78d8-4a07-b7c7-7f2df99e384e admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:56.849194 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a754c6f-78d8-4a07-b7c7-7f2df99e384e admin admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:56.850152 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a754c6f-78d8-4a07-b7c7-7f2df99e384e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:56.852347 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a754c6f-78d8-4a07-b7c7-7f2df99e384e admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:56.882955 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 974/1986] 10.222.0.118 () {60 vars in 1148 bytes} [Thu Jul 14 15:37:56 2022] POST /identity/v3/users => generated 294 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:37:56.886778 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c64998-4cd5-4ac7-bbc9-ad00e184b239 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:56.907098 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c64998-4cd5-4ac7-bbc9-ad00e184b239 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:56.924464 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233d1b0d-e674-4eaf-95b5-b2a181484ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:56.926144 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d1b0d-e674-4eaf-95b5-b2a181484ddc admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:56.926144 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d1b0d-e674-4eaf-95b5-b2a181484ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:56.926144 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d1b0d-e674-4eaf-95b5-b2a181484ddc admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:56.927076 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233d1b0d-e674-4eaf-95b5-b2a181484ddc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:56.928979 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233d1b0d-e674-4eaf-95b5-b2a181484ddc admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:56.949152 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1013/1987] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:37:56 2022] GET /identity/v3/roles => generated 1427 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:37:56.950583 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a754c6f-78d8-4a07-b7c7-7f2df99e384e admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:56.968211 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a754c6f-78d8-4a07-b7c7-7f2df99e384e admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:56.974860 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f8a687-1889-4742-b7ec-160a9623b7e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:56.975907 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f8a687-1889-4742-b7ec-160a9623b7e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:56.976199 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f8a687-1889-4742-b7ec-160a9623b7e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:56.976591 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f8a687-1889-4742-b7ec-160a9623b7e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:56.977361 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f8a687-1889-4742-b7ec-160a9623b7e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:56.980385 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f8a687-1889-4742-b7ec-160a9623b7e4 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:56.996549 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 975/1988] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:37:56 2022] GET /identity/v3/roles => generated 1427 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:37:56.998350 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233d1b0d-e674-4eaf-95b5-b2a181484ddc admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:57.010386 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233d1b0d-e674-4eaf-95b5-b2a181484ddc admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:57.018958 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211805db-5b51-456d-8fd2-588009395a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:57.020520 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211805db-5b51-456d-8fd2-588009395a96 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:57.020900 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211805db-5b51-456d-8fd2-588009395a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:57.021864 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211805db-5b51-456d-8fd2-588009395a96 admin admin] PATH_INFO: `/v3/projects/2cb85ddfe54541a98f526aa34205ee3c/users/cee6e8a5d57442aea2cf2e6559af2300/roles/4abcf5e5e7cd4b53ae1828fec6550d53` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:57.044677 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211805db-5b51-456d-8fd2-588009395a96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cb85ddfe54541a98f526aa34205ee3c, user_id=cee6e8a5d57442aea2cf2e6559af2300, role_id=4abcf5e5e7cd4b53ae1828fec6550d53)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:57.047727 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211805db-5b51-456d-8fd2-588009395a96 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:57.073879 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1014/1989] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:37:56 2022] PUT /identity/v3/projects/2cb85ddfe54541a98f526aa34205ee3c/users/cee6e8a5d57442aea2cf2e6559af2300/roles/4abcf5e5e7cd4b53ae1828fec6550d53 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:37:57.077496 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85b67a3-012e-4e57-874e-0fa1af088efa None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:57.077496 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85b67a3-012e-4e57-874e-0fa1af088efa None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:57.077496 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85b67a3-012e-4e57-874e-0fa1af088efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:57.120755 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-d85b67a3-012e-4e57-874e-0fa1af088efa None None] MFA Rules not processed for user `cee6e8a5d57442aea2cf2e6559af2300`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:57.122570 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-d85b67a3-012e-4e57-874e-0fa1af088efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:57.229501 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 976/1990] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:37:57 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:37:57.232496 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211805db-5b51-456d-8fd2-588009395a96 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:57.275835 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:57.322939 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211805db-5b51-456d-8fd2-588009395a96 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:57.331320 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5b44fc-1adc-4e8b-bdd7-8cb3f79f6d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:57.332230 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5b44fc-1adc-4e8b-bdd7-8cb3f79f6d26 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:57.332510 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5b44fc-1adc-4e8b-bdd7-8cb3f79f6d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:57.332781 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5b44fc-1adc-4e8b-bdd7-8cb3f79f6d26 admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:57.333488 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5b44fc-1adc-4e8b-bdd7-8cb3f79f6d26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:57.335581 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5b44fc-1adc-4e8b-bdd7-8cb3f79f6d26 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:57.368152 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1015/1991] 10.222.0.118 () {60 vars in 1157 bytes} [Thu Jul 14 15:37:57 2022] POST /identity/v3/projects => generated 388 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:37:57.372823 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85b67a3-012e-4e57-874e-0fa1af088efa None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:57.387377 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85b67a3-012e-4e57-874e-0fa1af088efa None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:57.422267 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:57.459971 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac77f56-7a57-42b0-805c-4a5b7e7f36d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:57.460580 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac77f56-7a57-42b0-805c-4a5b7e7f36d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:57.460866 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac77f56-7a57-42b0-805c-4a5b7e7f36d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:57.461147 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac77f56-7a57-42b0-805c-4a5b7e7f36d1 admin admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:57.462112 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac77f56-7a57-42b0-805c-4a5b7e7f36d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:57.464797 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac77f56-7a57-42b0-805c-4a5b7e7f36d1 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:57.493563 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 977/1992] 10.222.0.118 () {60 vars in 1148 bytes} [Thu Jul 14 15:37:57 2022] POST /identity/v3/users => generated 301 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:37:57.497802 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5b44fc-1adc-4e8b-bdd7-8cb3f79f6d26 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:57.509200 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5b44fc-1adc-4e8b-bdd7-8cb3f79f6d26 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:57.514093 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daea6c6-7e6a-4823-bbe4-c742bfa77270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:57.514776 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daea6c6-7e6a-4823-bbe4-c742bfa77270 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:57.515052 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daea6c6-7e6a-4823-bbe4-c742bfa77270 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:57.515343 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daea6c6-7e6a-4823-bbe4-c742bfa77270 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:57.516061 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daea6c6-7e6a-4823-bbe4-c742bfa77270 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:57.518353 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daea6c6-7e6a-4823-bbe4-c742bfa77270 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:57.529327 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1016/1993] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:37:57 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:37:57.533665 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac77f56-7a57-42b0-805c-4a5b7e7f36d1 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:57.543866 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac77f56-7a57-42b0-805c-4a5b7e7f36d1 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:57.548792 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96322d29-9f48-42d1-9448-ca3a86e7eddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:57.549683 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96322d29-9f48-42d1-9448-ca3a86e7eddc admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:57.549985 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96322d29-9f48-42d1-9448-ca3a86e7eddc admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:57.550258 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96322d29-9f48-42d1-9448-ca3a86e7eddc admin admin] PATH_INFO: `/v3/projects/2e7230ee761a48e6ad1338cc0212fc4b/users/bd19d874bdc14ece8fa94647046dd674/roles/3b880cef7dcf4baf87b50f8610c0c56e` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:57.565946 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96322d29-9f48-42d1-9448-ca3a86e7eddc admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e7230ee761a48e6ad1338cc0212fc4b, user_id=bd19d874bdc14ece8fa94647046dd674, role_id=3b880cef7dcf4baf87b50f8610c0c56e)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:57.568672 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96322d29-9f48-42d1-9448-ca3a86e7eddc admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:57.582618 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 978/1994] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:37:57 2022] PUT /identity/v3/projects/2e7230ee761a48e6ad1338cc0212fc4b/users/bd19d874bdc14ece8fa94647046dd674/roles/3b880cef7dcf4baf87b50f8610c0c56e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:37:57.586856 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daea6c6-7e6a-4823-bbe4-c742bfa77270 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:57.597629 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daea6c6-7e6a-4823-bbe4-c742bfa77270 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:57.655952 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b777ac14-1b02-43ed-b847-a9272939cc8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:57.656637 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b777ac14-1b02-43ed-b847-a9272939cc8d admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:57.656918 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b777ac14-1b02-43ed-b847-a9272939cc8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:57.657192 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b777ac14-1b02-43ed-b847-a9272939cc8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:57.658010 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b777ac14-1b02-43ed-b847-a9272939cc8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:57.659624 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b777ac14-1b02-43ed-b847-a9272939cc8d admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:57.670018 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1017/1995] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:37:57 2022] GET /identity/v3/roles => generated 1427 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:37:57.674495 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96322d29-9f48-42d1-9448-ca3a86e7eddc admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:57.684699 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96322d29-9f48-42d1-9448-ca3a86e7eddc admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:57.689757 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b76dc78-6056-445d-a184-286a422ee06b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:57.690672 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b76dc78-6056-445d-a184-286a422ee06b admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:57.690950 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b76dc78-6056-445d-a184-286a422ee06b admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:57.691223 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b76dc78-6056-445d-a184-286a422ee06b admin admin] PATH_INFO: `/v3/projects/2e7230ee761a48e6ad1338cc0212fc4b/users/bd19d874bdc14ece8fa94647046dd674/roles/3b880cef7dcf4baf87b50f8610c0c56e` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:57.693209 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b76dc78-6056-445d-a184-286a422ee06b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e7230ee761a48e6ad1338cc0212fc4b, user_id=bd19d874bdc14ece8fa94647046dd674, role_id=3b880cef7dcf4baf87b50f8610c0c56e)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:57.695931 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b76dc78-6056-445d-a184-286a422ee06b admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:57.707023 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 979/1996] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:37:57 2022] PUT /identity/v3/projects/2e7230ee761a48e6ad1338cc0212fc4b/users/bd19d874bdc14ece8fa94647046dd674/roles/3b880cef7dcf4baf87b50f8610c0c56e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:37:57.717586 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93c40b6-0fd8-4f77-ba51-9827e89a50f5 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:57.717832 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93c40b6-0fd8-4f77-ba51-9827e89a50f5 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:57.718149 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93c40b6-0fd8-4f77-ba51-9827e89a50f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:57.744707 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-c93c40b6-0fd8-4f77-ba51-9827e89a50f5 None None] MFA Rules not processed for user `bd19d874bdc14ece8fa94647046dd674`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:57.746347 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-c93c40b6-0fd8-4f77-ba51-9827e89a50f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:57.820465 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1018/1997] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:37:57 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:37:57.831390 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b76dc78-6056-445d-a184-286a422ee06b admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:57.833202 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-7b76dc78-6056-445d-a184-286a422ee06b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:57.891065 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b76dc78-6056-445d-a184-286a422ee06b admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:57.894791 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fad97d0-b2f8-4bce-9f13-4b6e3401d11d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea647438ea1c438987f28cbe39c3ff2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:57.895448 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fad97d0-b2f8-4bce-9f13-4b6e3401d11d service cinder] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:57.895730 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fad97d0-b2f8-4bce-9f13-4b6e3401d11d service cinder] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:57.896006 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fad97d0-b2f8-4bce-9f13-4b6e3401d11d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:57.905281 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fad97d0-b2f8-4bce-9f13-4b6e3401d11d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:57.906749 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fad97d0-b2f8-4bce-9f13-4b6e3401d11d service cinder] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:57.916215 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 980/1998] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:37:57 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:37:58.427254 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93c40b6-0fd8-4f77-ba51-9827e89a50f5 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:58.428828 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-c93c40b6-0fd8-4f77-ba51-9827e89a50f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:58.441459 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93c40b6-0fd8-4f77-ba51-9827e89a50f5 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:58.444741 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a04cfcd-f960-43d9-ad74-bf771713fa81 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea647438ea1c438987f28cbe39c3ff2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:58.445398 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a04cfcd-f960-43d9-ad74-bf771713fa81 service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:58.445679 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a04cfcd-f960-43d9-ad74-bf771713fa81 service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:58.445954 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a04cfcd-f960-43d9-ad74-bf771713fa81 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:58.479311 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:58.521899 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a04cfcd-f960-43d9-ad74-bf771713fa81 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:58.523500 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a04cfcd-f960-43d9-ad74-bf771713fa81 service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:58.533420 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1019/1999] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:37:58 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:38:02.626441 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fad97d0-b2f8-4bce-9f13-4b6e3401d11d service cinder] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:02.634868 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fad97d0-b2f8-4bce-9f13-4b6e3401d11d service cinder] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:02.638515 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aea5ab5-22e8-4df1-bc9f-cabcbfda0cd9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea647438ea1c438987f28cbe39c3ff2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:02.639146 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aea5ab5-22e8-4df1-bc9f-cabcbfda0cd9 service cinder] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:02.639430 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aea5ab5-22e8-4df1-bc9f-cabcbfda0cd9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:02.639704 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aea5ab5-22e8-4df1-bc9f-cabcbfda0cd9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:02.696587 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aea5ab5-22e8-4df1-bc9f-cabcbfda0cd9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:02.697937 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aea5ab5-22e8-4df1-bc9f-cabcbfda0cd9 service cinder] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:02.708675 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 981/2000] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:38:02 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:38:04.696489 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a04cfcd-f960-43d9-ad74-bf771713fa81 service cinder] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:04.698275 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-3a04cfcd-f960-43d9-ad74-bf771713fa81 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:04.779902 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a04cfcd-f960-43d9-ad74-bf771713fa81 service cinder] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:04.786108 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8368285-d512-4f28-9451-3f92f0e76a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:04.787052 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8368285-d512-4f28-9451-3f92f0e76a8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:04.788034 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8368285-d512-4f28-9451-3f92f0e76a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:04.788321 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8368285-d512-4f28-9451-3f92f0e76a8c admin admin] PATH_INFO: `/v3/users/ebd3947cefcb48cabdb4bbc06a41752a` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:04.789569 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8368285-d512-4f28-9451-3f92f0e76a8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebd3947cefcb48cabdb4bbc06a41752a)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:04.792154 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8368285-d512-4f28-9451-3f92f0e76a8c admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:04.854187 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-f8368285-d512-4f28-9451-3f92f0e76a8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebd3947cefcb48cabdb4bbc06a41752a'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:04.861560 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-f8368285-d512-4f28-9451-3f92f0e76a8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebd3947cefcb48cabdb4bbc06a41752a'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:04.862300 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-f8368285-d512-4f28-9451-3f92f0e76a8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebd3947cefcb48cabdb4bbc06a41752a'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:04.862914 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-f8368285-d512-4f28-9451-3f92f0e76a8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebd3947cefcb48cabdb4bbc06a41752a'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:04.888658 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-f8368285-d512-4f28-9451-3f92f0e76a8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebd3947cefcb48cabdb4bbc06a41752a'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:04.905889 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1020/2001] 10.222.0.118 () {58 vars in 1228 bytes} [Thu Jul 14 15:38:04 2022] DELETE /identity/v3/users/ebd3947cefcb48cabdb4bbc06a41752a => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:38:04.911409 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879c347d-e5fd-4287-9543-f895b56e95d8 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:04.912009 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879c347d-e5fd-4287-9543-f895b56e95d8 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:04.912009 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879c347d-e5fd-4287-9543-f895b56e95d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:04.940555 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-879c347d-e5fd-4287-9543-f895b56e95d8 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:38:04.943531 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-879c347d-e5fd-4287-9543-f895b56e95d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:04.979783 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:05.045602 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8368285-d512-4f28-9451-3f92f0e76a8c admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:05.046979 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-f8368285-d512-4f28-9451-3f92f0e76a8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:05.048116 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 982/2002] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:38:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:38:05.059025 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879c347d-e5fd-4287-9543-f895b56e95d8 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:05.060761 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-879c347d-e5fd-4287-9543-f895b56e95d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:05.089006 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8368285-d512-4f28-9451-3f92f0e76a8c admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:05.112057 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c60f1e-97be-43c2-9ae3-c828cbb62acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:05.114042 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c60f1e-97be-43c2-9ae3-c828cbb62acc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:05.114314 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c60f1e-97be-43c2-9ae3-c828cbb62acc admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:05.114590 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c60f1e-97be-43c2-9ae3-c828cbb62acc admin admin] PATH_INFO: `/v3/users/9d4e72d4bfb143ef8ff5345f4c98897d` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:05.119223 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c60f1e-97be-43c2-9ae3-c828cbb62acc admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d4e72d4bfb143ef8ff5345f4c98897d)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:05.123133 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c60f1e-97be-43c2-9ae3-c828cbb62acc admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:05.175183 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879c347d-e5fd-4287-9543-f895b56e95d8 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:05.181531 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7a71e7-d74a-4000-ac18-539be7126111 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b650be8114b64df0ac88441f1c50b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:05.182349 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a71e7-d74a-4000-ac18-539be7126111 service neutron] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:05.182673 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a71e7-d74a-4000-ac18-539be7126111 service neutron] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:05.183036 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a71e7-d74a-4000-ac18-539be7126111 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:05.197376 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7a71e7-d74a-4000-ac18-539be7126111 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:05.199321 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7a71e7-d74a-4000-ac18-539be7126111 service neutron] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:05.208814 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:05.215434 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 983/2003] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:38:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:38:05.215996 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-d8c60f1e-97be-43c2-9ae3-c828cbb62acc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d4e72d4bfb143ef8ff5345f4c98897d'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:05.230083 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-d8c60f1e-97be-43c2-9ae3-c828cbb62acc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d4e72d4bfb143ef8ff5345f4c98897d'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:05.231109 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-d8c60f1e-97be-43c2-9ae3-c828cbb62acc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d4e72d4bfb143ef8ff5345f4c98897d'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:05.232076 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-d8c60f1e-97be-43c2-9ae3-c828cbb62acc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d4e72d4bfb143ef8ff5345f4c98897d'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:05.250647 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-d8c60f1e-97be-43c2-9ae3-c828cbb62acc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d4e72d4bfb143ef8ff5345f4c98897d'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:05.268057 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1021/2004] 10.222.0.118 () {58 vars in 1228 bytes} [Thu Jul 14 15:38:05 2022] DELETE /identity/v3/users/9d4e72d4bfb143ef8ff5345f4c98897d => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:38:05.271975 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef120521-ebec-49e4-ae01-307ca1889b09 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:05.272263 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef120521-ebec-49e4-ae01-307ca1889b09 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:05.272558 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef120521-ebec-49e4-ae01-307ca1889b09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:05.295884 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-ef120521-ebec-49e4-ae01-307ca1889b09 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:38:05.297221 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-ef120521-ebec-49e4-ae01-307ca1889b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:05.370549 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 984/2005] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:38:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:38:05.390706 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c60f1e-97be-43c2-9ae3-c828cbb62acc admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:05.392465 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-d8c60f1e-97be-43c2-9ae3-c828cbb62acc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:05.471416 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c60f1e-97be-43c2-9ae3-c828cbb62acc admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:05.477041 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ea15a1-74f1-4fae-adcd-1eff338a3c7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b650be8114b64df0ac88441f1c50b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:05.478160 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ea15a1-74f1-4fae-adcd-1eff338a3c7c service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:05.478447 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ea15a1-74f1-4fae-adcd-1eff338a3c7c service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:05.478816 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ea15a1-74f1-4fae-adcd-1eff338a3c7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:05.493925 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ea15a1-74f1-4fae-adcd-1eff338a3c7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:05.496421 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ea15a1-74f1-4fae-adcd-1eff338a3c7c service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:05.508799 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1022/2006] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:38:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:38:06.229791 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef120521-ebec-49e4-ae01-307ca1889b09 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:06.231677 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-ef120521-ebec-49e4-ae01-307ca1889b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:06.261714 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef120521-ebec-49e4-ae01-307ca1889b09 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:06.271570 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000eb6bd-3642-4e21-8425-9f67ca5d3659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:06.272490 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000eb6bd-3642-4e21-8425-9f67ca5d3659 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:06.272773 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000eb6bd-3642-4e21-8425-9f67ca5d3659 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:06.273053 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000eb6bd-3642-4e21-8425-9f67ca5d3659 admin admin] PATH_INFO: `/v3/projects/ede99401953242ae92c905f6a93abe33` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:06.275125 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000eb6bd-3642-4e21-8425-9f67ca5d3659 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ede99401953242ae92c905f6a93abe33)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:06.277651 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000eb6bd-3642-4e21-8425-9f67ca5d3659 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:06.357995 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-000eb6bd-3642-4e21-8425-9f67ca5d3659 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ede99401953242ae92c905f6a93abe33', 'request_id': 'req-000eb6bd-3642-4e21-8425-9f67ca5d3659'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:06.374287 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ea15a1-74f1-4fae-adcd-1eff338a3c7c service neutron] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:06.377270 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-25ea15a1-74f1-4fae-adcd-1eff338a3c7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:06.377414 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-000eb6bd-3642-4e21-8425-9f67ca5d3659 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ede99401953242ae92c905f6a93abe33', 'request_id': 'req-000eb6bd-3642-4e21-8425-9f67ca5d3659'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:06.395333 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-000eb6bd-3642-4e21-8425-9f67ca5d3659 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ede99401953242ae92c905f6a93abe33', 'request_id': 'req-000eb6bd-3642-4e21-8425-9f67ca5d3659'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:06.397389 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:06.424409 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ea15a1-74f1-4fae-adcd-1eff338a3c7c service neutron] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:06.426818 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-000eb6bd-3642-4e21-8425-9f67ca5d3659 admin admin] The token cache is being invalidate because project ede99401953242ae92c905f6a93abe33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:38:06.427116 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-000eb6bd-3642-4e21-8425-9f67ca5d3659 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:06.427791 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-000eb6bd-3642-4e21-8425-9f67ca5d3659 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:06.434516 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 985/2007] 10.222.0.118 () {58 vars in 1237 bytes} [Thu Jul 14 15:38:06 2022] DELETE /identity/v3/projects/ede99401953242ae92c905f6a93abe33 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:38:06.436671 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5b4b4c-b025-487f-9155-9703e90ed7f5 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:06.436802 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5b4b4c-b025-487f-9155-9703e90ed7f5 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:06.437110 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5b4b4c-b025-487f-9155-9703e90ed7f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:06.463123 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-eb5b4b4c-b025-487f-9155-9703e90ed7f5 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:38:06.464382 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-eb5b4b4c-b025-487f-9155-9703e90ed7f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:06.545397 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 986/2008] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:38:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:38:06.554788 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217f99cb-d4a5-4914-a31e-df068527202f None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:06.554788 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217f99cb-d4a5-4914-a31e-df068527202f None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:06.555053 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217f99cb-d4a5-4914-a31e-df068527202f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:06.561760 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74311c0-1c77-4833-8a62-a9f154446b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:06.562678 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74311c0-1c77-4833-8a62-a9f154446b65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:06.564421 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74311c0-1c77-4833-8a62-a9f154446b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:06.564649 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74311c0-1c77-4833-8a62-a9f154446b65 admin admin] PATH_INFO: `/v3/projects/44aefecec1dd4be9b395aa1ac7941857` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:06.566674 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74311c0-1c77-4833-8a62-a9f154446b65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44aefecec1dd4be9b395aa1ac7941857)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:06.569998 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74311c0-1c77-4833-8a62-a9f154446b65 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:06.595221 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-217f99cb-d4a5-4914-a31e-df068527202f None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:38:06.597517 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-217f99cb-d4a5-4914-a31e-df068527202f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:06.612350 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 987/2009] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:38:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:38:06.616931 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217f99cb-d4a5-4914-a31e-df068527202f None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:06.632672 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217f99cb-d4a5-4914-a31e-df068527202f None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:06.653178 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-c74311c0-1c77-4833-8a62-a9f154446b65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44aefecec1dd4be9b395aa1ac7941857', 'request_id': 'req-c74311c0-1c77-4833-8a62-a9f154446b65'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:06.663635 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-c74311c0-1c77-4833-8a62-a9f154446b65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44aefecec1dd4be9b395aa1ac7941857', 'request_id': 'req-c74311c0-1c77-4833-8a62-a9f154446b65'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:06.668332 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:06.676854 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-c74311c0-1c77-4833-8a62-a9f154446b65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44aefecec1dd4be9b395aa1ac7941857', 'request_id': 'req-c74311c0-1c77-4833-8a62-a9f154446b65'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:06.701762 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-c74311c0-1c77-4833-8a62-a9f154446b65 admin admin] The token cache is being invalidate because project 44aefecec1dd4be9b395aa1ac7941857 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:38:06.702081 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-c74311c0-1c77-4833-8a62-a9f154446b65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:06.702795 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-c74311c0-1c77-4833-8a62-a9f154446b65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:06.708216 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1023/2010] 10.222.0.118 () {58 vars in 1237 bytes} [Thu Jul 14 15:38:06 2022] DELETE /identity/v3/projects/44aefecec1dd4be9b395aa1ac7941857 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:38:06.712307 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74311c0-1c77-4833-8a62-a9f154446b65 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:06.713749 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-c74311c0-1c77-4833-8a62-a9f154446b65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:06.720231 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd8d5f8-bb70-4396-93b8-2cf613ccc16b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:06.721510 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd8d5f8-bb70-4396-93b8-2cf613ccc16b admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:06.722006 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd8d5f8-bb70-4396-93b8-2cf613ccc16b admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:06.722584 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd8d5f8-bb70-4396-93b8-2cf613ccc16b admin admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:06.723908 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd8d5f8-bb70-4396-93b8-2cf613ccc16b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:38:06.724227 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd8d5f8-bb70-4396-93b8-2cf613ccc16b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:06.725891 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd8d5f8-bb70-4396-93b8-2cf613ccc16b admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:06.736027 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74311c0-1c77-4833-8a62-a9f154446b65 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:06.741388 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 988/2011] 10.222.0.118 () {58 vars in 1157 bytes} [Thu Jul 14 15:38:06 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:38:06.742039 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c41b274-8080-42cf-98f7-8e203b618b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:06.742989 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c41b274-8080-42cf-98f7-8e203b618b99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:06.743363 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c41b274-8080-42cf-98f7-8e203b618b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:06.743695 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c41b274-8080-42cf-98f7-8e203b618b99 admin admin] PATH_INFO: `/v3/users/cee6e8a5d57442aea2cf2e6559af2300` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:06.744997 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c41b274-8080-42cf-98f7-8e203b618b99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cee6e8a5d57442aea2cf2e6559af2300)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:06.747292 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c41b274-8080-42cf-98f7-8e203b618b99 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:06.748395 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd8d5f8-bb70-4396-93b8-2cf613ccc16b admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:06.752499 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-1dd8d5f8-bb70-4396-93b8-2cf613ccc16b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:06.769196 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd8d5f8-bb70-4396-93b8-2cf613ccc16b admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:06.777530 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efae9eb-2749-4160-928a-170b735a1709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:06.778342 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efae9eb-2749-4160-928a-170b735a1709 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:06.778706 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efae9eb-2749-4160-928a-170b735a1709 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:06.781171 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efae9eb-2749-4160-928a-170b735a1709 admin admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:06.781171 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efae9eb-2749-4160-928a-170b735a1709 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:06.781934 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efae9eb-2749-4160-928a-170b735a1709 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:06.812251 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 989/2012] 10.222.0.118 () {60 vars in 1157 bytes} [Thu Jul 14 15:38:06 2022] POST /identity/v3/projects => generated 362 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:38:06.814529 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-0c41b274-8080-42cf-98f7-8e203b618b99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cee6e8a5d57442aea2cf2e6559af2300'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:06.817115 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efae9eb-2749-4160-928a-170b735a1709 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:06.822903 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-0c41b274-8080-42cf-98f7-8e203b618b99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cee6e8a5d57442aea2cf2e6559af2300'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:06.823638 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-0c41b274-8080-42cf-98f7-8e203b618b99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cee6e8a5d57442aea2cf2e6559af2300'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:06.824240 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-0c41b274-8080-42cf-98f7-8e203b618b99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cee6e8a5d57442aea2cf2e6559af2300'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:06.838257 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-0c41b274-8080-42cf-98f7-8e203b618b99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cee6e8a5d57442aea2cf2e6559af2300'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:06.858175 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1024/2013] 10.222.0.118 () {58 vars in 1228 bytes} [Thu Jul 14 15:38:06 2022] DELETE /identity/v3/users/cee6e8a5d57442aea2cf2e6559af2300 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:38:06.886883 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:INSERT=2,keystone:DELETE=1,keystone:SELECT=97 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:06.891284 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efae9eb-2749-4160-928a-170b735a1709 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:06.958366 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7662156-c53b-40f5-9e3f-b10c79ec577c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:06.959183 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7662156-c53b-40f5-9e3f-b10c79ec577c admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:06.959465 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7662156-c53b-40f5-9e3f-b10c79ec577c admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:06.959739 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7662156-c53b-40f5-9e3f-b10c79ec577c admin admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:06.960438 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7662156-c53b-40f5-9e3f-b10c79ec577c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:06.962402 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7662156-c53b-40f5-9e3f-b10c79ec577c admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:06.984152 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 990/2014] 10.222.0.118 () {60 vars in 1148 bytes} [Thu Jul 14 15:38:06 2022] POST /identity/v3/users => generated 282 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:38:06.988473 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c41b274-8080-42cf-98f7-8e203b618b99 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:06.989978 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-0c41b274-8080-42cf-98f7-8e203b618b99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:07.006301 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c41b274-8080-42cf-98f7-8e203b618b99 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:07.011836 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7284697d-b3ce-4704-925b-f346cd79392e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:07.012527 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7284697d-b3ce-4704-925b-f346cd79392e admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:07.012933 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7284697d-b3ce-4704-925b-f346cd79392e admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:07.013217 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7284697d-b3ce-4704-925b-f346cd79392e admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:07.013990 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7284697d-b3ce-4704-925b-f346cd79392e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:07.015612 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7284697d-b3ce-4704-925b-f346cd79392e admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:07.027433 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1025/2015] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:38:06 2022] GET /identity/v3/roles => generated 1427 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:38:07.031647 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7662156-c53b-40f5-9e3f-b10c79ec577c admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:07.043401 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7662156-c53b-40f5-9e3f-b10c79ec577c admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:07.049458 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1c934f-5871-43b7-a2ac-3b4dd7c7ede0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:07.050721 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1c934f-5871-43b7-a2ac-3b4dd7c7ede0 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:07.050721 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1c934f-5871-43b7-a2ac-3b4dd7c7ede0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:07.051105 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1c934f-5871-43b7-a2ac-3b4dd7c7ede0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:07.051848 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1c934f-5871-43b7-a2ac-3b4dd7c7ede0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:07.053639 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1c934f-5871-43b7-a2ac-3b4dd7c7ede0 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:07.069388 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 991/2016] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:38:07 2022] GET /identity/v3/roles => generated 1427 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:38:07.070583 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7284697d-b3ce-4704-925b-f346cd79392e admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:07.083605 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7284697d-b3ce-4704-925b-f346cd79392e admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:07.090364 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b977992-f4fc-4e27-940f-ca3db23a434a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:07.090919 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b977992-f4fc-4e27-940f-ca3db23a434a admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:07.091135 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b977992-f4fc-4e27-940f-ca3db23a434a admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:07.091392 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b977992-f4fc-4e27-940f-ca3db23a434a admin admin] PATH_INFO: `/v3/projects/afbb1bb6c1e943cbb4db6b09203ca4f9/users/90a331690af444029a900db6d8fc5465/roles/4abcf5e5e7cd4b53ae1828fec6550d53` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:07.111301 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b977992-f4fc-4e27-940f-ca3db23a434a admin admin] RBAC: Authorizing `identity:create_grant(project_id=afbb1bb6c1e943cbb4db6b09203ca4f9, user_id=90a331690af444029a900db6d8fc5465, role_id=4abcf5e5e7cd4b53ae1828fec6550d53)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:07.114240 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b977992-f4fc-4e27-940f-ca3db23a434a admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:07.132313 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1026/2017] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:38:07 2022] PUT /identity/v3/projects/afbb1bb6c1e943cbb4db6b09203ca4f9/users/90a331690af444029a900db6d8fc5465/roles/4abcf5e5e7cd4b53ae1828fec6550d53 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:38:07.145131 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c440d3-7d58-4643-b1f4-cbf98b1b894a None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:07.146095 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c440d3-7d58-4643-b1f4-cbf98b1b894a None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:07.146657 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c440d3-7d58-4643-b1f4-cbf98b1b894a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:07.233584 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-b0c440d3-7d58-4643-b1f4-cbf98b1b894a None None] MFA Rules not processed for user `90a331690af444029a900db6d8fc5465`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:38:07.239292 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-b0c440d3-7d58-4643-b1f4-cbf98b1b894a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:07.361524 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 992/2018] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:38:07 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:38:07.398575 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b977992-f4fc-4e27-940f-ca3db23a434a admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:07.400397 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-5b977992-f4fc-4e27-940f-ca3db23a434a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:07.525957 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b977992-f4fc-4e27-940f-ca3db23a434a admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:07.537290 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f7fb7d-d328-4b51-bfda-7a3bf744f495 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea647438ea1c438987f28cbe39c3ff2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:07.537746 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c440d3-7d58-4643-b1f4-cbf98b1b894a None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:07.538193 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f7fb7d-d328-4b51-bfda-7a3bf744f495 service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:07.538606 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f7fb7d-d328-4b51-bfda-7a3bf744f495 service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:07.538953 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f7fb7d-d328-4b51-bfda-7a3bf744f495 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:07.541170 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-b0c440d3-7d58-4643-b1f4-cbf98b1b894a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:07.553947 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f7fb7d-d328-4b51-bfda-7a3bf744f495 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:07.576171 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f7fb7d-d328-4b51-bfda-7a3bf744f495 service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:07.592854 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1027/2019] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:38:07 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:38:07.610707 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f7fb7d-d328-4b51-bfda-7a3bf744f495 service cinder] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:07.644607 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c440d3-7d58-4643-b1f4-cbf98b1b894a None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:07.656774 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9834e54-4b74-4121-8b9b-0f55e1e46dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:07.658270 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9834e54-4b74-4121-8b9b-0f55e1e46dc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:07.658964 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9834e54-4b74-4121-8b9b-0f55e1e46dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:07.659251 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9834e54-4b74-4121-8b9b-0f55e1e46dc0 admin admin] PATH_INFO: `/v3/projects/2cb85ddfe54541a98f526aa34205ee3c` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:07.660834 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9834e54-4b74-4121-8b9b-0f55e1e46dc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cb85ddfe54541a98f526aa34205ee3c)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:07.662573 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9834e54-4b74-4121-8b9b-0f55e1e46dc0 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:07.672052 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=86,keystone:INSERT=3,keystone:DELETE=11 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:07.691668 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:07.717341 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f7fb7d-d328-4b51-bfda-7a3bf744f495 service cinder] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:07.738195 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-d9834e54-4b74-4121-8b9b-0f55e1e46dc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cb85ddfe54541a98f526aa34205ee3c', 'request_id': 'req-d9834e54-4b74-4121-8b9b-0f55e1e46dc0'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:07.751472 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-d9834e54-4b74-4121-8b9b-0f55e1e46dc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cb85ddfe54541a98f526aa34205ee3c', 'request_id': 'req-d9834e54-4b74-4121-8b9b-0f55e1e46dc0'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:07.759691 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-d9834e54-4b74-4121-8b9b-0f55e1e46dc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cb85ddfe54541a98f526aa34205ee3c', 'request_id': 'req-d9834e54-4b74-4121-8b9b-0f55e1e46dc0'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:07.785057 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-d9834e54-4b74-4121-8b9b-0f55e1e46dc0 admin admin] The token cache is being invalidate because project 2cb85ddfe54541a98f526aa34205ee3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:38:07.787546 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-d9834e54-4b74-4121-8b9b-0f55e1e46dc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:07.789501 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-d9834e54-4b74-4121-8b9b-0f55e1e46dc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:07.792375 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 993/2020] 10.222.0.118 () {58 vars in 1237 bytes} [Thu Jul 14 15:38:07 2022] DELETE /identity/v3/projects/2cb85ddfe54541a98f526aa34205ee3c => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:38:07.796160 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9834e54-4b74-4121-8b9b-0f55e1e46dc0 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:07.798895 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-d9834e54-4b74-4121-8b9b-0f55e1e46dc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:07.816216 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa05aa8-1fe4-4184-81d1-5907d76f5cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:07.817463 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa05aa8-1fe4-4184-81d1-5907d76f5cab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:07.817935 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa05aa8-1fe4-4184-81d1-5907d76f5cab admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:07.818458 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa05aa8-1fe4-4184-81d1-5907d76f5cab admin admin] PATH_INFO: `/v3/users/90a331690af444029a900db6d8fc5465` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:07.819891 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa05aa8-1fe4-4184-81d1-5907d76f5cab admin admin] RBAC: Authorizing `identity:delete_user(user_id=90a331690af444029a900db6d8fc5465)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:07.822176 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa05aa8-1fe4-4184-81d1-5907d76f5cab admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:07.876625 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9834e54-4b74-4121-8b9b-0f55e1e46dc0 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:07.882125 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06bcfc8-a87b-4221-a883-e4af3c78921a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:07.883027 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06bcfc8-a87b-4221-a883-e4af3c78921a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:07.883308 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06bcfc8-a87b-4221-a883-e4af3c78921a admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:07.883496 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-bfa05aa8-1fe4-4184-81d1-5907d76f5cab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90a331690af444029a900db6d8fc5465'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:07.883623 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06bcfc8-a87b-4221-a883-e4af3c78921a admin admin] PATH_INFO: `/v3/users/bd19d874bdc14ece8fa94647046dd674` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:07.884940 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06bcfc8-a87b-4221-a883-e4af3c78921a admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd19d874bdc14ece8fa94647046dd674)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:07.886836 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06bcfc8-a87b-4221-a883-e4af3c78921a admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:07.894546 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-bfa05aa8-1fe4-4184-81d1-5907d76f5cab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90a331690af444029a900db6d8fc5465'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:07.895319 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-bfa05aa8-1fe4-4184-81d1-5907d76f5cab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90a331690af444029a900db6d8fc5465'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:07.895954 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-bfa05aa8-1fe4-4184-81d1-5907d76f5cab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90a331690af444029a900db6d8fc5465'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:07.912355 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-bfa05aa8-1fe4-4184-81d1-5907d76f5cab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90a331690af444029a900db6d8fc5465'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:07.934259 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1028/2021] 10.222.0.118 () {58 vars in 1228 bytes} [Thu Jul 14 15:38:07 2022] DELETE /identity/v3/users/90a331690af444029a900db6d8fc5465 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:38:07.937426 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b499d80-fb9c-40bd-a4ec-0d72d3e874cf None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:07.937714 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b499d80-fb9c-40bd-a4ec-0d72d3e874cf None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:07.938011 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b499d80-fb9c-40bd-a4ec-0d72d3e874cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:07.960778 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-7b499d80-fb9c-40bd-a4ec-0d72d3e874cf None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:38:07.961663 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-e06bcfc8-a87b-4221-a883-e4af3c78921a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd19d874bdc14ece8fa94647046dd674'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:07.962074 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-7b499d80-fb9c-40bd-a4ec-0d72d3e874cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:07.972555 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-e06bcfc8-a87b-4221-a883-e4af3c78921a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd19d874bdc14ece8fa94647046dd674'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:07.974255 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-e06bcfc8-a87b-4221-a883-e4af3c78921a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd19d874bdc14ece8fa94647046dd674'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:07.975202 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-e06bcfc8-a87b-4221-a883-e4af3c78921a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd19d874bdc14ece8fa94647046dd674'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:08.001421 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-e06bcfc8-a87b-4221-a883-e4af3c78921a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd19d874bdc14ece8fa94647046dd674'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:08.021892 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 994/2022] 10.222.0.118 () {58 vars in 1228 bytes} [Thu Jul 14 15:38:07 2022] DELETE /identity/v3/users/bd19d874bdc14ece8fa94647046dd674 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:38:08.032788 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:08.051125 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1029/2023] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:38:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:38:08.076624 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06bcfc8-a87b-4221-a883-e4af3c78921a admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:08.078787 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-e06bcfc8-a87b-4221-a883-e4af3c78921a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:08.113351 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:08.161540 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06bcfc8-a87b-4221-a883-e4af3c78921a admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:08.167326 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e7f69e-a182-4ae0-8152-2ad998b7a21f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b650be8114b64df0ac88441f1c50b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:08.168903 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e7f69e-a182-4ae0-8152-2ad998b7a21f service neutron] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:08.169486 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e7f69e-a182-4ae0-8152-2ad998b7a21f service neutron] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:08.177440 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e7f69e-a182-4ae0-8152-2ad998b7a21f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:08.264453 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e7f69e-a182-4ae0-8152-2ad998b7a21f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:08.266120 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e7f69e-a182-4ae0-8152-2ad998b7a21f service neutron] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:08.282069 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 995/2024] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:38:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:38:08.516752 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b499d80-fb9c-40bd-a4ec-0d72d3e874cf None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:08.518234 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-7b499d80-fb9c-40bd-a4ec-0d72d3e874cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:08.537675 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b499d80-fb9c-40bd-a4ec-0d72d3e874cf None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:08.546672 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48fef93-2cfd-40bb-b651-d5cb7fbae010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:08.548248 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48fef93-2cfd-40bb-b651-d5cb7fbae010 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:08.548639 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48fef93-2cfd-40bb-b651-d5cb7fbae010 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:08.548986 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48fef93-2cfd-40bb-b651-d5cb7fbae010 admin admin] PATH_INFO: `/v3/projects/2e7230ee761a48e6ad1338cc0212fc4b` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:08.550398 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48fef93-2cfd-40bb-b651-d5cb7fbae010 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e7230ee761a48e6ad1338cc0212fc4b)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:08.552392 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48fef93-2cfd-40bb-b651-d5cb7fbae010 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:08.627185 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-e48fef93-2cfd-40bb-b651-d5cb7fbae010 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e7230ee761a48e6ad1338cc0212fc4b', 'request_id': 'req-e48fef93-2cfd-40bb-b651-d5cb7fbae010'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:08.636071 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-e48fef93-2cfd-40bb-b651-d5cb7fbae010 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e7230ee761a48e6ad1338cc0212fc4b', 'request_id': 'req-e48fef93-2cfd-40bb-b651-d5cb7fbae010'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:08.642707 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-e48fef93-2cfd-40bb-b651-d5cb7fbae010 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e7230ee761a48e6ad1338cc0212fc4b', 'request_id': 'req-e48fef93-2cfd-40bb-b651-d5cb7fbae010'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:08.671546 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-e48fef93-2cfd-40bb-b651-d5cb7fbae010 admin admin] The token cache is being invalidate because project 2e7230ee761a48e6ad1338cc0212fc4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:38:08.672103 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-e48fef93-2cfd-40bb-b651-d5cb7fbae010 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:08.674504 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-e48fef93-2cfd-40bb-b651-d5cb7fbae010 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:08.677951 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1030/2025] 10.222.0.118 () {58 vars in 1237 bytes} [Thu Jul 14 15:38:08 2022] DELETE /identity/v3/projects/2e7230ee761a48e6ad1338cc0212fc4b => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:38:08.687731 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844243cc-8421-4d2a-9437-ff3290666449 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:08.688374 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844243cc-8421-4d2a-9437-ff3290666449 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:08.688806 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844243cc-8421-4d2a-9437-ff3290666449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:08.717435 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-844243cc-8421-4d2a-9437-ff3290666449 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:38:08.725507 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-844243cc-8421-4d2a-9437-ff3290666449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:08.810682 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 996/2026] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:38:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:38:08.819424 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a4ab0f-c155-48f4-bdc8-65286740f9f0 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:08.819710 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a4ab0f-c155-48f4-bdc8-65286740f9f0 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:08.819888 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a4ab0f-c155-48f4-bdc8-65286740f9f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:08.843795 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-a7a4ab0f-c155-48f4-bdc8-65286740f9f0 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:38:08.845763 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-a7a4ab0f-c155-48f4-bdc8-65286740f9f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:08.861507 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1031/2027] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:38:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:38:08.862771 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844243cc-8421-4d2a-9437-ff3290666449 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:08.877008 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844243cc-8421-4d2a-9437-ff3290666449 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:08.883031 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cd3f06-710f-4342-bbb9-5a2f68b7a699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:08.883760 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd3f06-710f-4342-bbb9-5a2f68b7a699 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:08.884047 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd3f06-710f-4342-bbb9-5a2f68b7a699 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:08.884327 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd3f06-710f-4342-bbb9-5a2f68b7a699 admin admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:08.885569 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cd3f06-710f-4342-bbb9-5a2f68b7a699 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:38:08.885741 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cd3f06-710f-4342-bbb9-5a2f68b7a699 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:08.887394 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cd3f06-710f-4342-bbb9-5a2f68b7a699 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:08.904415 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 997/2028] 10.222.0.118 () {58 vars in 1157 bytes} [Thu Jul 14 15:38:08 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:38:08.908741 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a4ab0f-c155-48f4-bdc8-65286740f9f0 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:08.942339 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a4ab0f-c155-48f4-bdc8-65286740f9f0 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:08.952699 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbe6beb-3188-48c7-b405-3fd20ef56906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:08.953400 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe6beb-3188-48c7-b405-3fd20ef56906 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:08.953685 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe6beb-3188-48c7-b405-3fd20ef56906 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:08.954525 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe6beb-3188-48c7-b405-3fd20ef56906 admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:08.955243 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbe6beb-3188-48c7-b405-3fd20ef56906 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:08.957242 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbe6beb-3188-48c7-b405-3fd20ef56906 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:09.001581 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1032/2029] 10.222.0.118 () {60 vars in 1157 bytes} [Thu Jul 14 15:38:08 2022] POST /identity/v3/projects => generated 390 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:38:09.005753 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cd3f06-710f-4342-bbb9-5a2f68b7a699 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:09.020838 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cd3f06-710f-4342-bbb9-5a2f68b7a699 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:09.127066 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbe6beb-3188-48c7-b405-3fd20ef56906 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:09.129157 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-5bbe6beb-3188-48c7-b405-3fd20ef56906 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:09.139573 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fab3dcd-35f3-46ba-97f7-5cfe3d9b807c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:09.140419 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fab3dcd-35f3-46ba-97f7-5cfe3d9b807c admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:09.140540 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fab3dcd-35f3-46ba-97f7-5cfe3d9b807c admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:09.140812 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fab3dcd-35f3-46ba-97f7-5cfe3d9b807c admin admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:09.143299 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fab3dcd-35f3-46ba-97f7-5cfe3d9b807c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:09.149856 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fab3dcd-35f3-46ba-97f7-5cfe3d9b807c admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:09.168759 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:09.203518 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 998/2030] 10.222.0.118 () {60 vars in 1148 bytes} [Thu Jul 14 15:38:09 2022] POST /identity/v3/users => generated 296 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:38:09.204806 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fab3dcd-35f3-46ba-97f7-5cfe3d9b807c admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:09.226386 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbe6beb-3188-48c7-b405-3fd20ef56906 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:09.226831 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fab3dcd-35f3-46ba-97f7-5cfe3d9b807c admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:09.234085 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc39d17-4e14-4ae1-8801-330c8844302e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:09.236247 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d8502e-6364-4480-aa8f-4880804f1225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:09.236717 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc39d17-4e14-4ae1-8801-330c8844302e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:09.237152 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc39d17-4e14-4ae1-8801-330c8844302e admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:09.237621 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc39d17-4e14-4ae1-8801-330c8844302e admin admin] PATH_INFO: `/v3/projects/afbb1bb6c1e943cbb4db6b09203ca4f9` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:09.237867 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d8502e-6364-4480-aa8f-4880804f1225 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:09.238287 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d8502e-6364-4480-aa8f-4880804f1225 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:09.239785 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc39d17-4e14-4ae1-8801-330c8844302e admin admin] RBAC: Authorizing `identity:delete_project(project_id=afbb1bb6c1e943cbb4db6b09203ca4f9)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:09.240194 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d8502e-6364-4480-aa8f-4880804f1225 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:09.241055 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d8502e-6364-4480-aa8f-4880804f1225 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:09.242545 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc39d17-4e14-4ae1-8801-330c8844302e admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:09.244318 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d8502e-6364-4480-aa8f-4880804f1225 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:09.285056 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 999/2031] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:38:09 2022] GET /identity/v3/roles => generated 1427 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:38:09.287323 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d8502e-6364-4480-aa8f-4880804f1225 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:09.308927 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d8502e-6364-4480-aa8f-4880804f1225 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:09.332062 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-fbc39d17-4e14-4ae1-8801-330c8844302e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afbb1bb6c1e943cbb4db6b09203ca4f9', 'request_id': 'req-fbc39d17-4e14-4ae1-8801-330c8844302e'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:09.334793 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:09.342449 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-fbc39d17-4e14-4ae1-8801-330c8844302e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afbb1bb6c1e943cbb4db6b09203ca4f9', 'request_id': 'req-fbc39d17-4e14-4ae1-8801-330c8844302e'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:09.354276 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-fbc39d17-4e14-4ae1-8801-330c8844302e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afbb1bb6c1e943cbb4db6b09203ca4f9', 'request_id': 'req-fbc39d17-4e14-4ae1-8801-330c8844302e'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:09.390487 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-fbc39d17-4e14-4ae1-8801-330c8844302e admin admin] The token cache is being invalidate because project afbb1bb6c1e943cbb4db6b09203ca4f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:38:09.390925 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-fbc39d17-4e14-4ae1-8801-330c8844302e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:09.392060 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-fbc39d17-4e14-4ae1-8801-330c8844302e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:09.394169 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1033/2032] 10.222.0.118 () {58 vars in 1237 bytes} [Thu Jul 14 15:38:09 2022] DELETE /identity/v3/projects/afbb1bb6c1e943cbb4db6b09203ca4f9 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:38:09.403136 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334dc979-2cb4-4abc-81dd-6654d5b1b0d0 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:09.403966 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334dc979-2cb4-4abc-81dd-6654d5b1b0d0 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:09.404350 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334dc979-2cb4-4abc-81dd-6654d5b1b0d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:09.429320 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a268d8-7231-446c-9187-514a7975a1ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:09.430149 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a268d8-7231-446c-9187-514a7975a1ac admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:09.430497 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a268d8-7231-446c-9187-514a7975a1ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:09.430994 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-334dc979-2cb4-4abc-81dd-6654d5b1b0d0 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:38:09.431333 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a268d8-7231-446c-9187-514a7975a1ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:09.432137 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a268d8-7231-446c-9187-514a7975a1ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:09.432539 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-334dc979-2cb4-4abc-81dd-6654d5b1b0d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:09.434007 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a268d8-7231-446c-9187-514a7975a1ac admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:09.446000 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1034/2033] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:38:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:38:09.448924 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1000/2034] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:38:09 2022] GET /identity/v3/roles => generated 1427 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:38:09.449458 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334dc979-2cb4-4abc-81dd-6654d5b1b0d0 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:09.451441 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b768f5-4884-4068-bfe1-f52fa4e33f05 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:09.451599 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-334dc979-2cb4-4abc-81dd-6654d5b1b0d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:09.451917 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b768f5-4884-4068-bfe1-f52fa4e33f05 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:09.452284 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b768f5-4884-4068-bfe1-f52fa4e33f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:09.468733 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334dc979-2cb4-4abc-81dd-6654d5b1b0d0 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:09.472386 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-01b768f5-4884-4068-bfe1-f52fa4e33f05 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:38:09.473630 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-01b768f5-4884-4068-bfe1-f52fa4e33f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:09.474699 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ce3320-e328-4cf8-b682-92cdb945d7b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:09.475770 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ce3320-e328-4cf8-b682-92cdb945d7b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:09.476318 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ce3320-e328-4cf8-b682-92cdb945d7b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:09.476707 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ce3320-e328-4cf8-b682-92cdb945d7b0 admin admin] PATH_INFO: `/v3/projects/ebb76b85e3d942ebbf1b59d76c64e009/users/3384dbe9c3824edfaddcb71d3e332cdf/roles/4abcf5e5e7cd4b53ae1828fec6550d53` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:09.483230 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1001/2035] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:38:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:38:09.487758 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b768f5-4884-4068-bfe1-f52fa4e33f05 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:09.495963 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ce3320-e328-4cf8-b682-92cdb945d7b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebb76b85e3d942ebbf1b59d76c64e009, user_id=3384dbe9c3824edfaddcb71d3e332cdf, role_id=4abcf5e5e7cd4b53ae1828fec6550d53)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:09.497178 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b768f5-4884-4068-bfe1-f52fa4e33f05 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:09.499096 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ce3320-e328-4cf8-b682-92cdb945d7b0 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:09.502467 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306a6dc7-8b6d-4871-a857-8fa597c6ab34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:09.503125 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306a6dc7-8b6d-4871-a857-8fa597c6ab34 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:09.503404 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306a6dc7-8b6d-4871-a857-8fa597c6ab34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:09.503673 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306a6dc7-8b6d-4871-a857-8fa597c6ab34 admin admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:09.504393 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306a6dc7-8b6d-4871-a857-8fa597c6ab34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:38:09.504724 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306a6dc7-8b6d-4871-a857-8fa597c6ab34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:09.506331 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306a6dc7-8b6d-4871-a857-8fa597c6ab34 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:09.514706 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1035/2036] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:38:09 2022] PUT /identity/v3/projects/ebb76b85e3d942ebbf1b59d76c64e009/users/3384dbe9c3824edfaddcb71d3e332cdf/roles/4abcf5e5e7cd4b53ae1828fec6550d53 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:38:09.523337 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1002/2037] 10.222.0.118 () {58 vars in 1157 bytes} [Thu Jul 14 15:38:09 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:38:09.526507 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ce3320-e328-4cf8-b682-92cdb945d7b0 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:09.527489 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e6068-e923-4d6c-a133-3b59a7c83895 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:09.527930 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e6068-e923-4d6c-a133-3b59a7c83895 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:09.528486 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e6068-e923-4d6c-a133-3b59a7c83895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:09.556321 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-934e6068-e923-4d6c-a133-3b59a7c83895 None None] MFA Rules not processed for user `3384dbe9c3824edfaddcb71d3e332cdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:38:09.557761 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-934e6068-e923-4d6c-a133-3b59a7c83895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:09.599240 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ce3320-e328-4cf8-b682-92cdb945d7b0 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:09.603933 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db9985e-c184-43ce-82ea-c39ed7a58094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:09.604599 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db9985e-c184-43ce-82ea-c39ed7a58094 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:09.604857 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db9985e-c184-43ce-82ea-c39ed7a58094 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:09.605126 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db9985e-c184-43ce-82ea-c39ed7a58094 admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:09.605824 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db9985e-c184-43ce-82ea-c39ed7a58094 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:09.607819 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db9985e-c184-43ce-82ea-c39ed7a58094 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:09.626170 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1003/2038] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:38:09 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:38:09.630608 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934e6068-e923-4d6c-a133-3b59a7c83895 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:09.635307 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1036/2039] 10.222.0.118 () {60 vars in 1157 bytes} [Thu Jul 14 15:38:09 2022] POST /identity/v3/projects => generated 392 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:38:09.639369 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db9985e-c184-43ce-82ea-c39ed7a58094 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:09.641299 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934e6068-e923-4d6c-a133-3b59a7c83895 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:09.689022 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:09.712974 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c6f033-7291-45d8-b1e1-eb1292f932c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:09.713659 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c6f033-7291-45d8-b1e1-eb1292f932c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:09.714105 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c6f033-7291-45d8-b1e1-eb1292f932c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:09.715077 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c6f033-7291-45d8-b1e1-eb1292f932c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:09.715883 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c6f033-7291-45d8-b1e1-eb1292f932c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:09.716131 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db9985e-c184-43ce-82ea-c39ed7a58094 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:09.717945 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c6f033-7291-45d8-b1e1-eb1292f932c8 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:09.730236 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b932d009-60c6-4f53-935c-d2425dd8393d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:09.731048 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b932d009-60c6-4f53-935c-d2425dd8393d admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:09.731433 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b932d009-60c6-4f53-935c-d2425dd8393d admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:09.731812 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b932d009-60c6-4f53-935c-d2425dd8393d admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:09.732657 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b932d009-60c6-4f53-935c-d2425dd8393d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:09.735502 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b932d009-60c6-4f53-935c-d2425dd8393d admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:09.747278 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1004/2040] 10.222.0.118 () {60 vars in 1157 bytes} [Thu Jul 14 15:38:09 2022] POST /identity/v3/projects => generated 388 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:38:09.751107 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c6f033-7291-45d8-b1e1-eb1292f932c8 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:09.761429 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1037/2041] 10.222.0.118 () {60 vars in 1148 bytes} [Thu Jul 14 15:38:09 2022] POST /identity/v3/users => generated 297 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:38:09.765983 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b932d009-60c6-4f53-935c-d2425dd8393d admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:09.776725 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b932d009-60c6-4f53-935c-d2425dd8393d admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:09.798666 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=92,keystone:DELETE=2,keystone:INSERT=6 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:09.838616 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c6f033-7291-45d8-b1e1-eb1292f932c8 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:09.842098 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383b0a49-7d66-406f-b3e9-eb4ec8c20335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:09.843028 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b0a49-7d66-406f-b3e9-eb4ec8c20335 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:09.843384 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b0a49-7d66-406f-b3e9-eb4ec8c20335 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:09.843644 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b0a49-7d66-406f-b3e9-eb4ec8c20335 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:09.845243 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383b0a49-7d66-406f-b3e9-eb4ec8c20335 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:09.847981 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383b0a49-7d66-406f-b3e9-eb4ec8c20335 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:09.850064 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4e1a0f-b1f0-4206-bb39-9c4367a8758a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:09.855008 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4e1a0f-b1f0-4206-bb39-9c4367a8758a admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:09.855375 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4e1a0f-b1f0-4206-bb39-9c4367a8758a admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:09.855751 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4e1a0f-b1f0-4206-bb39-9c4367a8758a admin admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:09.857040 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4e1a0f-b1f0-4206-bb39-9c4367a8758a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:09.859565 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4e1a0f-b1f0-4206-bb39-9c4367a8758a admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:09.867017 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1038/2042] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:38:09 2022] GET /identity/v3/roles => generated 1427 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:38:09.868294 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17afbcf-850d-48c9-9e49-65a37eaff680 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:09.868590 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17afbcf-850d-48c9-9e49-65a37eaff680 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:09.868861 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17afbcf-850d-48c9-9e49-65a37eaff680 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:09.870735 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1039/2043] 10.222.0.118 () {54 vars in 926 bytes} [Thu Jul 14 15:38:09 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:38:09.871381 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17afbcf-850d-48c9-9e49-65a37eaff680 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:09.874712 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-a17afbcf-850d-48c9-9e49-65a37eaff680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:09.885496 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1005/2044] 10.222.0.118 () {60 vars in 1148 bytes} [Thu Jul 14 15:38:09 2022] POST /identity/v3/users => generated 301 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:38:09.885496 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4e1a0f-b1f0-4206-bb39-9c4367a8758a admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:09.892510 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17afbcf-850d-48c9-9e49-65a37eaff680 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:09.895837 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4e1a0f-b1f0-4206-bb39-9c4367a8758a admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:09.897348 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3fedbd-bc74-4dc7-9872-c8ae42d64e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:09.898491 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3fedbd-bc74-4dc7-9872-c8ae42d64e07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:09.898873 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3fedbd-bc74-4dc7-9872-c8ae42d64e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:09.899245 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3fedbd-bc74-4dc7-9872-c8ae42d64e07 admin admin] PATH_INFO: `/v3/users/cb3789b5896349f89ec70d97b70d3e7e` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:09.900511 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c937dda-95e6-4ba1-94cb-acf2d6af9b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:09.900633 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3fedbd-bc74-4dc7-9872-c8ae42d64e07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb3789b5896349f89ec70d97b70d3e7e)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:09.901165 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c937dda-95e6-4ba1-94cb-acf2d6af9b5b admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:09.901441 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c937dda-95e6-4ba1-94cb-acf2d6af9b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:09.901711 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c937dda-95e6-4ba1-94cb-acf2d6af9b5b admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:09.902493 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c937dda-95e6-4ba1-94cb-acf2d6af9b5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:09.903088 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3fedbd-bc74-4dc7-9872-c8ae42d64e07 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:09.904130 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c937dda-95e6-4ba1-94cb-acf2d6af9b5b admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:09.915318 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1006/2045] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:38:09 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:38:09.916913 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa827f5c-379a-4c23-a39e-c08bd5359239 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:09.917302 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa827f5c-379a-4c23-a39e-c08bd5359239 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:09.917618 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa827f5c-379a-4c23-a39e-c08bd5359239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:09.939533 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-aa827f5c-379a-4c23-a39e-c08bd5359239 None None] MFA Rules not processed for user `e70b0f8be7e04adca6e3f218fbe3a295`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:38:09.940759 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-aa827f5c-379a-4c23-a39e-c08bd5359239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:09.954619 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-df3fedbd-bc74-4dc7-9872-c8ae42d64e07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb3789b5896349f89ec70d97b70d3e7e'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:09.962740 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-df3fedbd-bc74-4dc7-9872-c8ae42d64e07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb3789b5896349f89ec70d97b70d3e7e'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:09.963541 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-df3fedbd-bc74-4dc7-9872-c8ae42d64e07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb3789b5896349f89ec70d97b70d3e7e'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:09.964540 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-df3fedbd-bc74-4dc7-9872-c8ae42d64e07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb3789b5896349f89ec70d97b70d3e7e'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:09.979955 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-df3fedbd-bc74-4dc7-9872-c8ae42d64e07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb3789b5896349f89ec70d97b70d3e7e'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:09.996508 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1040/2046] 10.222.0.118 () {58 vars in 1228 bytes} [Thu Jul 14 15:38:09 2022] DELETE /identity/v3/users/cb3789b5896349f89ec70d97b70d3e7e => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:38:09.997585 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3fedbd-bc74-4dc7-9872-c8ae42d64e07 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:09.998951 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-df3fedbd-bc74-4dc7-9872-c8ae42d64e07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:10.018756 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1007/2047] 10.222.0.118 () {58 vars in 1023 bytes} [Thu Jul 14 15:38:09 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:38:10.019640 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa827f5c-379a-4c23-a39e-c08bd5359239 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:10.020995 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-aa827f5c-379a-4c23-a39e-c08bd5359239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:10.046743 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa827f5c-379a-4c23-a39e-c08bd5359239 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:10.079952 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3fedbd-bc74-4dc7-9872-c8ae42d64e07 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:10.086104 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b107130a-15f5-4f90-96a1-527f250ad4df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:10.086785 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b107130a-15f5-4f90-96a1-527f250ad4df admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:10.087072 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b107130a-15f5-4f90-96a1-527f250ad4df admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:10.087377 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b107130a-15f5-4f90-96a1-527f250ad4df admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:10.088143 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b107130a-15f5-4f90-96a1-527f250ad4df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:10.089805 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b107130a-15f5-4f90-96a1-527f250ad4df admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:10.101241 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1041/2048] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:38:09 2022] GET /identity/v3/roles => generated 1427 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:38:10.102042 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b107130a-15f5-4f90-96a1-527f250ad4df admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:10.106213 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-b107130a-15f5-4f90-96a1-527f250ad4df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:10.116729 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:10.137485 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdccfa0c-9ec2-40a7-9e19-1a475706a602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:10.138423 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdccfa0c-9ec2-40a7-9e19-1a475706a602 admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:10.138698 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdccfa0c-9ec2-40a7-9e19-1a475706a602 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:10.139254 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdccfa0c-9ec2-40a7-9e19-1a475706a602 admin admin] PATH_INFO: `/v3/projects/f36910943e914afc96b02a9102819133/users/2ecb87f9dbaa490a89397bb32055fe93/roles/4abcf5e5e7cd4b53ae1828fec6550d53` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:10.151784 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:10.156561 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdccfa0c-9ec2-40a7-9e19-1a475706a602 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f36910943e914afc96b02a9102819133, user_id=2ecb87f9dbaa490a89397bb32055fe93, role_id=4abcf5e5e7cd4b53ae1828fec6550d53)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:10.159849 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdccfa0c-9ec2-40a7-9e19-1a475706a602 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:10.182722 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1008/2049] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:38:10 2022] PUT /identity/v3/projects/f36910943e914afc96b02a9102819133/users/2ecb87f9dbaa490a89397bb32055fe93/roles/4abcf5e5e7cd4b53ae1828fec6550d53 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:38:10.182722 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdccfa0c-9ec2-40a7-9e19-1a475706a602 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:10.211349 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b107130a-15f5-4f90-96a1-527f250ad4df admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:10.261598 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdccfa0c-9ec2-40a7-9e19-1a475706a602 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:10.266834 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9676a46-1cb6-4eea-96f6-72c9be7f9fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:10.267745 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9676a46-1cb6-4eea-96f6-72c9be7f9fca admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:10.268194 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9676a46-1cb6-4eea-96f6-72c9be7f9fca admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:10.268471 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9676a46-1cb6-4eea-96f6-72c9be7f9fca admin admin] PATH_INFO: `/v3/projects/153b0e07014e4eba9bfdea3e073a6ca3/users/fa02846b7afa490b9d0ccb713c693f95/roles/3b880cef7dcf4baf87b50f8610c0c56e` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:10.290444 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655d9ec6-4d03-4d3f-8755-7ba076048b66 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b0f8be7e04adca6e3f218fbe3a295', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:10.291107 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655d9ec6-4d03-4d3f-8755-7ba076048b66 service placement] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:10.291388 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655d9ec6-4d03-4d3f-8755-7ba076048b66 service placement] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:10.291664 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655d9ec6-4d03-4d3f-8755-7ba076048b66 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:10.293299 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9676a46-1cb6-4eea-96f6-72c9be7f9fca admin admin] RBAC: Authorizing `identity:create_grant(project_id=153b0e07014e4eba9bfdea3e073a6ca3, user_id=fa02846b7afa490b9d0ccb713c693f95, role_id=3b880cef7dcf4baf87b50f8610c0c56e)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:10.296340 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9676a46-1cb6-4eea-96f6-72c9be7f9fca admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:10.301512 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655d9ec6-4d03-4d3f-8755-7ba076048b66 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:10.303193 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655d9ec6-4d03-4d3f-8755-7ba076048b66 service placement] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:10.310544 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1009/2050] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:38:10 2022] PUT /identity/v3/projects/153b0e07014e4eba9bfdea3e073a6ca3/users/fa02846b7afa490b9d0ccb713c693f95/roles/3b880cef7dcf4baf87b50f8610c0c56e => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:38:10.313689 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f675a87-71f8-4776-b093-9c4d02d118d5 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:10.313689 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f675a87-71f8-4776-b093-9c4d02d118d5 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:10.313689 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f675a87-71f8-4776-b093-9c4d02d118d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:10.315088 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1042/2051] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:38:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:38:10.315898 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655d9ec6-4d03-4d3f-8755-7ba076048b66 service placement] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:10.317233 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-655d9ec6-4d03-4d3f-8755-7ba076048b66 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:10.330896 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655d9ec6-4d03-4d3f-8755-7ba076048b66 service placement] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:10.344952 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-7f675a87-71f8-4776-b093-9c4d02d118d5 None None] MFA Rules not processed for user `2ecb87f9dbaa490a89397bb32055fe93`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:38:10.346303 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-7f675a87-71f8-4776-b093-9c4d02d118d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:10.390036 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bc0297-287e-4500-a630-b2268e4d74c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:10.390933 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bc0297-287e-4500-a630-b2268e4d74c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:10.391259 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bc0297-287e-4500-a630-b2268e4d74c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:10.391535 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bc0297-287e-4500-a630-b2268e4d74c9 admin admin] PATH_INFO: `/v3/projects/eec2b8c15d6b4ed19f8d35a8c769718d` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:10.392763 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bc0297-287e-4500-a630-b2268e4d74c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eec2b8c15d6b4ed19f8d35a8c769718d)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:10.394692 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bc0297-287e-4500-a630-b2268e4d74c9 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:10.415760 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1010/2052] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:38:10 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:38:10.416619 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f675a87-71f8-4776-b093-9c4d02d118d5 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:10.432286 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f675a87-71f8-4776-b093-9c4d02d118d5 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:10.437999 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58dc898-5894-4645-8719-00696a1af46f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:10.442163 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58dc898-5894-4645-8719-00696a1af46f admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:10.442790 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58dc898-5894-4645-8719-00696a1af46f admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:10.443570 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58dc898-5894-4645-8719-00696a1af46f admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:10.444788 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58dc898-5894-4645-8719-00696a1af46f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:10.447050 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58dc898-5894-4645-8719-00696a1af46f admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:10.449459 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-31bc0297-287e-4500-a630-b2268e4d74c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eec2b8c15d6b4ed19f8d35a8c769718d', 'request_id': 'req-31bc0297-287e-4500-a630-b2268e4d74c9'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:10.456837 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-31bc0297-287e-4500-a630-b2268e4d74c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eec2b8c15d6b4ed19f8d35a8c769718d', 'request_id': 'req-31bc0297-287e-4500-a630-b2268e4d74c9'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:10.459335 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1011/2053] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:38:10 2022] GET /identity/v3/roles => generated 1427 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:38:10.459815 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58dc898-5894-4645-8719-00696a1af46f admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:10.462261 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-b58dc898-5894-4645-8719-00696a1af46f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:10.468519 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-31bc0297-287e-4500-a630-b2268e4d74c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eec2b8c15d6b4ed19f8d35a8c769718d', 'request_id': 'req-31bc0297-287e-4500-a630-b2268e4d74c9'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:10.471750 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:10.488730 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-31bc0297-287e-4500-a630-b2268e4d74c9 admin admin] The token cache is being invalidate because project eec2b8c15d6b4ed19f8d35a8c769718d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:38:10.489019 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-31bc0297-287e-4500-a630-b2268e4d74c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:10.489664 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-31bc0297-287e-4500-a630-b2268e4d74c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:10.491309 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1043/2054] 10.222.0.118 () {58 vars in 1237 bytes} [Thu Jul 14 15:38:10 2022] DELETE /identity/v3/projects/eec2b8c15d6b4ed19f8d35a8c769718d => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:38:10.491994 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bc0297-287e-4500-a630-b2268e4d74c9 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:10.493290 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-31bc0297-287e-4500-a630-b2268e4d74c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:10.501855 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:10.545979 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58dc898-5894-4645-8719-00696a1af46f admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:10.571660 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bc0297-287e-4500-a630-b2268e4d74c9 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:10.578372 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d349b0-d822-4995-8cc1-173d1f61a1b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:10.579947 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d349b0-d822-4995-8cc1-173d1f61a1b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:10.580257 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d349b0-d822-4995-8cc1-173d1f61a1b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:10.580685 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d349b0-d822-4995-8cc1-173d1f61a1b6 admin admin] PATH_INFO: `/v3/projects/153b0e07014e4eba9bfdea3e073a6ca3/users/fa02846b7afa490b9d0ccb713c693f95/roles/3b880cef7dcf4baf87b50f8610c0c56e` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:10.582881 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d349b0-d822-4995-8cc1-173d1f61a1b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=153b0e07014e4eba9bfdea3e073a6ca3, user_id=fa02846b7afa490b9d0ccb713c693f95, role_id=3b880cef7dcf4baf87b50f8610c0c56e)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:10.585579 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d349b0-d822-4995-8cc1-173d1f61a1b6 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:10.596511 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1044/2055] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:38:10 2022] PUT /identity/v3/projects/153b0e07014e4eba9bfdea3e073a6ca3/users/fa02846b7afa490b9d0ccb713c693f95/roles/3b880cef7dcf4baf87b50f8610c0c56e => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:38:10.597779 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b7242a-474d-405d-b16c-3581232bb544 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:10.598094 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b7242a-474d-405d-b16c-3581232bb544 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:10.598371 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b7242a-474d-405d-b16c-3581232bb544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:10.605625 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56067d3-0f9b-4822-abe0-98dff4c90fe5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea647438ea1c438987f28cbe39c3ff2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:10.606479 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56067d3-0f9b-4822-abe0-98dff4c90fe5 service cinder] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:10.606770 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56067d3-0f9b-4822-abe0-98dff4c90fe5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:10.607193 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56067d3-0f9b-4822-abe0-98dff4c90fe5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:10.610232 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-f56067d3-0f9b-4822-abe0-98dff4c90fe5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:10.620430 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-28b7242a-474d-405d-b16c-3581232bb544 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:38:10.622124 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-28b7242a-474d-405d-b16c-3581232bb544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:10.670911 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56067d3-0f9b-4822-abe0-98dff4c90fe5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:10.672354 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56067d3-0f9b-4822-abe0-98dff4c90fe5 service cinder] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:10.681432 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1012/2056] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:38:10 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:38:10.682511 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1045/2057] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:38:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:38:10.682733 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e83c52d-6261-469e-b54f-377dc1902ac9 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:10.683031 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e83c52d-6261-469e-b54f-377dc1902ac9 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:10.683294 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e83c52d-6261-469e-b54f-377dc1902ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:10.691226 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa2ad45-e092-48d6-9447-385c5c934762 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:10.691520 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa2ad45-e092-48d6-9447-385c5c934762 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:10.691797 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa2ad45-e092-48d6-9447-385c5c934762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:10.711070 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-3aa2ad45-e092-48d6-9447-385c5c934762 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:38:10.712445 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-3aa2ad45-e092-48d6-9447-385c5c934762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:10.714845 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-4e83c52d-6261-469e-b54f-377dc1902ac9 None None] MFA Rules not processed for user `fa02846b7afa490b9d0ccb713c693f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:38:10.716277 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-4e83c52d-6261-469e-b54f-377dc1902ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:10.726111 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1046/2058] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:38:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:38:10.729423 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa2ad45-e092-48d6-9447-385c5c934762 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:10.738681 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa2ad45-e092-48d6-9447-385c5c934762 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:10.743290 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9170713f-23b3-4f8f-8e59-f36b8367740b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:10.743938 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9170713f-23b3-4f8f-8e59-f36b8367740b admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:10.744213 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9170713f-23b3-4f8f-8e59-f36b8367740b admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:10.744481 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9170713f-23b3-4f8f-8e59-f36b8367740b admin admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:10.745247 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9170713f-23b3-4f8f-8e59-f36b8367740b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:38:10.745497 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9170713f-23b3-4f8f-8e59-f36b8367740b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:10.747386 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9170713f-23b3-4f8f-8e59-f36b8367740b admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:10.759133 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1047/2059] 10.222.0.118 () {58 vars in 1157 bytes} [Thu Jul 14 15:38:10 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:38:10.763530 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9170713f-23b3-4f8f-8e59-f36b8367740b admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:10.776144 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9170713f-23b3-4f8f-8e59-f36b8367740b admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:10.783537 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5fcc64-0c02-4106-b193-d8cb48c12d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:10.784282 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5fcc64-0c02-4106-b193-d8cb48c12d5c admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:10.784639 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5fcc64-0c02-4106-b193-d8cb48c12d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:10.784986 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5fcc64-0c02-4106-b193-d8cb48c12d5c admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:10.785754 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5fcc64-0c02-4106-b193-d8cb48c12d5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:10.787803 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5fcc64-0c02-4106-b193-d8cb48c12d5c admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:10.811288 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1013/2060] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:38:10 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:38:10.822879 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e83c52d-6261-469e-b54f-377dc1902ac9 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:10.824280 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-4e83c52d-6261-469e-b54f-377dc1902ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:10.829281 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1048/2061] 10.222.0.118 () {60 vars in 1157 bytes} [Thu Jul 14 15:38:10 2022] POST /identity/v3/projects => generated 368 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:38:10.834037 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5fcc64-0c02-4106-b193-d8cb48c12d5c admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:10.877166 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:10.900848 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:INSERT=3,keystone:DELETE=1,keystone:SELECT=96 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:10.919776 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e83c52d-6261-469e-b54f-377dc1902ac9 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:10.928705 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5fcc64-0c02-4106-b193-d8cb48c12d5c admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:10.933821 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f70a24-579d-419c-9976-3cf2473120c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:10.934619 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f70a24-579d-419c-9976-3cf2473120c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:10.934869 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f70a24-579d-419c-9976-3cf2473120c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:10.935145 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f70a24-579d-419c-9976-3cf2473120c9 admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:10.935841 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f70a24-579d-419c-9976-3cf2473120c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:10.937776 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f70a24-579d-419c-9976-3cf2473120c9 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:10.964744 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1049/2062] 10.222.0.118 () {60 vars in 1148 bytes} [Thu Jul 14 15:38:10 2022] POST /identity/v3/users => generated 285 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:38:10.971028 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f70a24-579d-419c-9976-3cf2473120c9 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:10.983899 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f70a24-579d-419c-9976-3cf2473120c9 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:10.991235 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555ef7a4-12a1-4284-a0f7-f8b07f38bd92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:10.991982 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555ef7a4-12a1-4284-a0f7-f8b07f38bd92 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:10.992288 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555ef7a4-12a1-4284-a0f7-f8b07f38bd92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:10.992806 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555ef7a4-12a1-4284-a0f7-f8b07f38bd92 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:10.993744 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555ef7a4-12a1-4284-a0f7-f8b07f38bd92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:10.995398 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555ef7a4-12a1-4284-a0f7-f8b07f38bd92 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:11.002973 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18240f3f-1dac-48a0-b8d2-83a82769ff79 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea647438ea1c438987f28cbe39c3ff2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:11.003843 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18240f3f-1dac-48a0-b8d2-83a82769ff79 service cinder] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:11.004162 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18240f3f-1dac-48a0-b8d2-83a82769ff79 service cinder] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:11.004697 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18240f3f-1dac-48a0-b8d2-83a82769ff79 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:11.012640 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1050/2063] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:38:10 2022] GET /identity/v3/roles => generated 1427 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:38:11.013873 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555ef7a4-12a1-4284-a0f7-f8b07f38bd92 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:11.026503 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555ef7a4-12a1-4284-a0f7-f8b07f38bd92 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:11.034433 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264b3b4c-86a9-44cb-8f37-963f7013f3b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:11.035485 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264b3b4c-86a9-44cb-8f37-963f7013f3b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:11.036039 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264b3b4c-86a9-44cb-8f37-963f7013f3b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:11.036464 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264b3b4c-86a9-44cb-8f37-963f7013f3b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:11.037471 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264b3b4c-86a9-44cb-8f37-963f7013f3b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:11.039383 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264b3b4c-86a9-44cb-8f37-963f7013f3b3 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:11.052768 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1051/2064] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:38:11 2022] GET /identity/v3/roles => generated 1427 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:38:11.058380 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264b3b4c-86a9-44cb-8f37-963f7013f3b3 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:11.070894 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264b3b4c-86a9-44cb-8f37-963f7013f3b3 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:11.076264 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc99773-0290-4640-8cea-2484a082567e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:11.077590 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc99773-0290-4640-8cea-2484a082567e admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:11.077590 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc99773-0290-4640-8cea-2484a082567e admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:11.077882 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc99773-0290-4640-8cea-2484a082567e admin admin] PATH_INFO: `/v3/projects/9310c121358147958257abdf78ea192d/users/5215fb46983345cf8fa0765e2408dfd5/roles/4abcf5e5e7cd4b53ae1828fec6550d53` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:11.100800 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc99773-0290-4640-8cea-2484a082567e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9310c121358147958257abdf78ea192d, user_id=5215fb46983345cf8fa0765e2408dfd5, role_id=4abcf5e5e7cd4b53ae1828fec6550d53)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:11.104506 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc99773-0290-4640-8cea-2484a082567e admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:11.129994 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1052/2065] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:38:11 2022] PUT /identity/v3/projects/9310c121358147958257abdf78ea192d/users/5215fb46983345cf8fa0765e2408dfd5/roles/4abcf5e5e7cd4b53ae1828fec6550d53 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:38:11.130661 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18240f3f-1dac-48a0-b8d2-83a82769ff79 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:11.132103 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18240f3f-1dac-48a0-b8d2-83a82769ff79 service cinder] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:11.137849 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b7e4f0-2036-46aa-9693-e99193bb2288 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:11.137849 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b7e4f0-2036-46aa-9693-e99193bb2288 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:11.137849 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b7e4f0-2036-46aa-9693-e99193bb2288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:11.147477 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1014/2066] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:38:10 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:38:11.202058 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-c9b7e4f0-2036-46aa-9693-e99193bb2288 None None] MFA Rules not processed for user `5215fb46983345cf8fa0765e2408dfd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:38:11.204499 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-c9b7e4f0-2036-46aa-9693-e99193bb2288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:11.290014 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1053/2067] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:38:11 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Jul 14 15:38:11.303809 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18240f3f-1dac-48a0-b8d2-83a82769ff79 service cinder] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:11.306655 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b7e4f0-2036-46aa-9693-e99193bb2288 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:11.314530 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18240f3f-1dac-48a0-b8d2-83a82769ff79 service cinder] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:11.373003 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e9100f-3899-4e46-a98c-c611c1b3ae58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea647438ea1c438987f28cbe39c3ff2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:11.373257 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e9100f-3899-4e46-a98c-c611c1b3ae58 service cinder] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:11.373509 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e9100f-3899-4e46-a98c-c611c1b3ae58 service cinder] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:11.374335 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e9100f-3899-4e46-a98c-c611c1b3ae58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:11.384795 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e9100f-3899-4e46-a98c-c611c1b3ae58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:11.386354 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e9100f-3899-4e46-a98c-c611c1b3ae58 service cinder] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:11.394672 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b7e4f0-2036-46aa-9693-e99193bb2288 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:11.398694 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1015/2068] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:38:11 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:38:11.400913 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699b7aec-862f-41fa-adbc-f4f2cf1e110a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:11.401828 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699b7aec-862f-41fa-adbc-f4f2cf1e110a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:11.402699 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699b7aec-862f-41fa-adbc-f4f2cf1e110a admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:11.402699 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699b7aec-862f-41fa-adbc-f4f2cf1e110a admin admin] PATH_INFO: `/v3/users/3384dbe9c3824edfaddcb71d3e332cdf` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:11.404449 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699b7aec-862f-41fa-adbc-f4f2cf1e110a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3384dbe9c3824edfaddcb71d3e332cdf)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:11.406486 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699b7aec-862f-41fa-adbc-f4f2cf1e110a admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:11.443704 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:11.480116 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-699b7aec-862f-41fa-adbc-f4f2cf1e110a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3384dbe9c3824edfaddcb71d3e332cdf'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:11.489373 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-699b7aec-862f-41fa-adbc-f4f2cf1e110a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3384dbe9c3824edfaddcb71d3e332cdf'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:11.490292 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-699b7aec-862f-41fa-adbc-f4f2cf1e110a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3384dbe9c3824edfaddcb71d3e332cdf'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:11.490932 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-699b7aec-862f-41fa-adbc-f4f2cf1e110a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3384dbe9c3824edfaddcb71d3e332cdf'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:11.507513 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-699b7aec-862f-41fa-adbc-f4f2cf1e110a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3384dbe9c3824edfaddcb71d3e332cdf'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:11.523689 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1054/2069] 10.222.0.118 () {58 vars in 1228 bytes} [Thu Jul 14 15:38:11 2022] DELETE /identity/v3/users/3384dbe9c3824edfaddcb71d3e332cdf => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:38:11.528003 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4baa843-f699-4b07-83ae-16ec7e3473da None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:11.528320 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4baa843-f699-4b07-83ae-16ec7e3473da None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:11.528528 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4baa843-f699-4b07-83ae-16ec7e3473da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:11.548254 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-d4baa843-f699-4b07-83ae-16ec7e3473da None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:38:11.549862 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-d4baa843-f699-4b07-83ae-16ec7e3473da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:11.605919 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:11.657668 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1016/2070] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:38:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:38:11.685584 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699b7aec-862f-41fa-adbc-f4f2cf1e110a admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:11.685584 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-699b7aec-862f-41fa-adbc-f4f2cf1e110a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:11.801690 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699b7aec-862f-41fa-adbc-f4f2cf1e110a admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:11.809737 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db73bf9a-f924-4b0c-9c01-475617d0435e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b650be8114b64df0ac88441f1c50b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:11.810714 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db73bf9a-f924-4b0c-9c01-475617d0435e service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:11.811204 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db73bf9a-f924-4b0c-9c01-475617d0435e service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:11.811914 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db73bf9a-f924-4b0c-9c01-475617d0435e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:11.833058 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db73bf9a-f924-4b0c-9c01-475617d0435e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:11.836310 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db73bf9a-f924-4b0c-9c01-475617d0435e service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:11.855991 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1055/2071] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:38:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:38:12.142393 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4baa843-f699-4b07-83ae-16ec7e3473da None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:12.143806 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-d4baa843-f699-4b07-83ae-16ec7e3473da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:12.165297 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4baa843-f699-4b07-83ae-16ec7e3473da None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:12.175888 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699d08f5-9aca-44fc-9416-1fbe2494da4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:12.176904 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699d08f5-9aca-44fc-9416-1fbe2494da4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:12.177190 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699d08f5-9aca-44fc-9416-1fbe2494da4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:12.177460 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699d08f5-9aca-44fc-9416-1fbe2494da4b admin admin] PATH_INFO: `/v3/projects/ebb76b85e3d942ebbf1b59d76c64e009` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:12.179187 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699d08f5-9aca-44fc-9416-1fbe2494da4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebb76b85e3d942ebbf1b59d76c64e009)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:12.181286 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699d08f5-9aca-44fc-9416-1fbe2494da4b admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:12.232627 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-699d08f5-9aca-44fc-9416-1fbe2494da4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebb76b85e3d942ebbf1b59d76c64e009', 'request_id': 'req-699d08f5-9aca-44fc-9416-1fbe2494da4b'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:12.239793 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-699d08f5-9aca-44fc-9416-1fbe2494da4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebb76b85e3d942ebbf1b59d76c64e009', 'request_id': 'req-699d08f5-9aca-44fc-9416-1fbe2494da4b'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:12.245635 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-699d08f5-9aca-44fc-9416-1fbe2494da4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebb76b85e3d942ebbf1b59d76c64e009', 'request_id': 'req-699d08f5-9aca-44fc-9416-1fbe2494da4b'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:12.258300 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-699d08f5-9aca-44fc-9416-1fbe2494da4b admin admin] The token cache is being invalidate because project ebb76b85e3d942ebbf1b59d76c64e009 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:38:12.258594 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-699d08f5-9aca-44fc-9416-1fbe2494da4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:12.259246 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-699d08f5-9aca-44fc-9416-1fbe2494da4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:12.260967 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1017/2072] 10.222.0.118 () {58 vars in 1237 bytes} [Thu Jul 14 15:38:12 2022] DELETE /identity/v3/projects/ebb76b85e3d942ebbf1b59d76c64e009 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:38:12.265042 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db73bf9a-f924-4b0c-9c01-475617d0435e service neutron] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:12.275327 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db73bf9a-f924-4b0c-9c01-475617d0435e service neutron] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:12.349767 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e985c04b-0a68-47df-9149-3830db4f87c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:12.350792 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e985c04b-0a68-47df-9149-3830db4f87c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:12.351139 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e985c04b-0a68-47df-9149-3830db4f87c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:12.351424 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e985c04b-0a68-47df-9149-3830db4f87c1 admin admin] PATH_INFO: `/v3/users/fa02846b7afa490b9d0ccb713c693f95` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:12.352698 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e985c04b-0a68-47df-9149-3830db4f87c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa02846b7afa490b9d0ccb713c693f95)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:12.354798 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e985c04b-0a68-47df-9149-3830db4f87c1 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:12.400173 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:12.407843 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-e985c04b-0a68-47df-9149-3830db4f87c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa02846b7afa490b9d0ccb713c693f95'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:12.416734 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-e985c04b-0a68-47df-9149-3830db4f87c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa02846b7afa490b9d0ccb713c693f95'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:12.417646 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-e985c04b-0a68-47df-9149-3830db4f87c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa02846b7afa490b9d0ccb713c693f95'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:12.418536 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-e985c04b-0a68-47df-9149-3830db4f87c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa02846b7afa490b9d0ccb713c693f95'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:12.431575 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-e985c04b-0a68-47df-9149-3830db4f87c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa02846b7afa490b9d0ccb713c693f95'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:12.446024 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1056/2073] 10.222.0.118 () {58 vars in 1228 bytes} [Thu Jul 14 15:38:12 2022] DELETE /identity/v3/users/fa02846b7afa490b9d0ccb713c693f95 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:38:12.808949 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699d08f5-9aca-44fc-9416-1fbe2494da4b admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:12.810484 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-699d08f5-9aca-44fc-9416-1fbe2494da4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:12.838725 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699d08f5-9aca-44fc-9416-1fbe2494da4b admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:12.886037 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cab1a9d-bddf-4ddc-9136-189a3a8aaa80 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:12.886578 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cab1a9d-bddf-4ddc-9136-189a3a8aaa80 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:12.886769 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cab1a9d-bddf-4ddc-9136-189a3a8aaa80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:12.908003 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-1cab1a9d-bddf-4ddc-9136-189a3a8aaa80 None None] MFA Rules not processed for user `094fc0a7b58448bba6fdc962d519d126`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:38:12.909235 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-1cab1a9d-bddf-4ddc-9136-189a3a8aaa80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:12.921149 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885769cd-c470-4c5c-bdf7-69e89ff09641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:12.922185 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885769cd-c470-4c5c-bdf7-69e89ff09641 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:12.923330 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885769cd-c470-4c5c-bdf7-69e89ff09641 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:12.923443 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885769cd-c470-4c5c-bdf7-69e89ff09641 admin admin] PATH_INFO: `/v3/projects/153b0e07014e4eba9bfdea3e073a6ca3` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:12.924717 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885769cd-c470-4c5c-bdf7-69e89ff09641 admin admin] RBAC: Authorizing `identity:delete_project(project_id=153b0e07014e4eba9bfdea3e073a6ca3)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:12.926968 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885769cd-c470-4c5c-bdf7-69e89ff09641 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:12.976861 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1057/2074] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:38:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:38:12.982654 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-885769cd-c470-4c5c-bdf7-69e89ff09641 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '153b0e07014e4eba9bfdea3e073a6ca3', 'request_id': 'req-885769cd-c470-4c5c-bdf7-69e89ff09641'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:12.989813 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-885769cd-c470-4c5c-bdf7-69e89ff09641 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '153b0e07014e4eba9bfdea3e073a6ca3', 'request_id': 'req-885769cd-c470-4c5c-bdf7-69e89ff09641'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:12.998195 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:13.000660 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-885769cd-c470-4c5c-bdf7-69e89ff09641 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '153b0e07014e4eba9bfdea3e073a6ca3', 'request_id': 'req-885769cd-c470-4c5c-bdf7-69e89ff09641'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:13.021671 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-885769cd-c470-4c5c-bdf7-69e89ff09641 admin admin] The token cache is being invalidate because project 153b0e07014e4eba9bfdea3e073a6ca3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:38:13.022033 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-885769cd-c470-4c5c-bdf7-69e89ff09641 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:13.022659 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-885769cd-c470-4c5c-bdf7-69e89ff09641 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:13.024936 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1018/2075] 10.222.0.118 () {58 vars in 1237 bytes} [Thu Jul 14 15:38:12 2022] DELETE /identity/v3/projects/153b0e07014e4eba9bfdea3e073a6ca3 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:38:13.029783 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e2931-7601-48a5-8576-e52b692fdf76 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:13.030183 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e2931-7601-48a5-8576-e52b692fdf76 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:13.030608 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e2931-7601-48a5-8576-e52b692fdf76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:13.053218 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-035e2931-7601-48a5-8576-e52b692fdf76 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:38:13.054695 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-035e2931-7601-48a5-8576-e52b692fdf76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:13.136436 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1058/2076] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:38:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:38:13.138860 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8310ff9e-46ce-46d2-a5fc-5a0236a874c7 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:13.139186 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8310ff9e-46ce-46d2-a5fc-5a0236a874c7 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:13.139598 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8310ff9e-46ce-46d2-a5fc-5a0236a874c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:13.161092 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-8310ff9e-46ce-46d2-a5fc-5a0236a874c7 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:38:13.162401 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-8310ff9e-46ce-46d2-a5fc-5a0236a874c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:13.177325 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035e2931-7601-48a5-8576-e52b692fdf76 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:13.188783 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1019/2077] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:38:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:38:13.191127 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035e2931-7601-48a5-8576-e52b692fdf76 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:13.196157 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d16b62-4851-41c4-8134-d28f0ba4ebfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:13.196953 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d16b62-4851-41c4-8134-d28f0ba4ebfb admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:13.197319 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d16b62-4851-41c4-8134-d28f0ba4ebfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:13.197657 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d16b62-4851-41c4-8134-d28f0ba4ebfb admin admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:13.198554 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d16b62-4851-41c4-8134-d28f0ba4ebfb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:38:13.199110 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d16b62-4851-41c4-8134-d28f0ba4ebfb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:13.201340 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d16b62-4851-41c4-8134-d28f0ba4ebfb admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:13.223781 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1059/2078] 10.222.0.118 () {58 vars in 1157 bytes} [Thu Jul 14 15:38:13 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:38:13.224921 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8310ff9e-46ce-46d2-a5fc-5a0236a874c7 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:13.234674 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8310ff9e-46ce-46d2-a5fc-5a0236a874c7 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:13.242044 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a18862-d72b-4476-b768-f0c64b6a2ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:13.242950 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a18862-d72b-4476-b768-f0c64b6a2ef6 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:13.243353 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a18862-d72b-4476-b768-f0c64b6a2ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:13.243732 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a18862-d72b-4476-b768-f0c64b6a2ef6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:13.244580 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a18862-d72b-4476-b768-f0c64b6a2ef6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:13.247034 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a18862-d72b-4476-b768-f0c64b6a2ef6 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:13.279209 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1020/2079] 10.222.0.118 () {60 vars in 1157 bytes} [Thu Jul 14 15:38:13 2022] POST /identity/v3/projects => generated 384 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:38:13.283490 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d16b62-4851-41c4-8134-d28f0ba4ebfb admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:13.294858 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d16b62-4851-41c4-8134-d28f0ba4ebfb admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:13.345424 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:13.364192 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83dcf13-30c1-4659-b8bd-14613745e41d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:13.364394 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83dcf13-30c1-4659-b8bd-14613745e41d admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:13.365042 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83dcf13-30c1-4659-b8bd-14613745e41d admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:13.365042 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83dcf13-30c1-4659-b8bd-14613745e41d admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:13.365877 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83dcf13-30c1-4659-b8bd-14613745e41d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:13.367835 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83dcf13-30c1-4659-b8bd-14613745e41d admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:13.396470 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1060/2080] 10.222.0.118 () {60 vars in 1148 bytes} [Thu Jul 14 15:38:13 2022] POST /identity/v3/users => generated 293 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:38:13.400362 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a18862-d72b-4476-b768-f0c64b6a2ef6 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:13.412061 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a18862-d72b-4476-b768-f0c64b6a2ef6 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:13.417095 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91e429b-550e-468c-a12c-da5f1c2b3a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:13.417894 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91e429b-550e-468c-a12c-da5f1c2b3a7b admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:13.418376 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91e429b-550e-468c-a12c-da5f1c2b3a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:13.418948 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91e429b-550e-468c-a12c-da5f1c2b3a7b admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:13.419830 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91e429b-550e-468c-a12c-da5f1c2b3a7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:13.421579 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91e429b-550e-468c-a12c-da5f1c2b3a7b admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:13.434545 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1021/2081] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:38:13 2022] GET /identity/v3/roles => generated 1427 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:38:13.439175 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83dcf13-30c1-4659-b8bd-14613745e41d admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:13.451221 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83dcf13-30c1-4659-b8bd-14613745e41d admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:13.457748 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d0bad9-1214-479b-8956-87ccb968bed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:13.458465 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d0bad9-1214-479b-8956-87ccb968bed4 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:13.458749 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d0bad9-1214-479b-8956-87ccb968bed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:13.459026 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d0bad9-1214-479b-8956-87ccb968bed4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:13.459764 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d0bad9-1214-479b-8956-87ccb968bed4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:13.461538 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d0bad9-1214-479b-8956-87ccb968bed4 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:13.476747 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1061/2082] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:38:13 2022] GET /identity/v3/roles => generated 1427 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:38:13.481143 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91e429b-550e-468c-a12c-da5f1c2b3a7b admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:13.494922 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91e429b-550e-468c-a12c-da5f1c2b3a7b admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:13.500212 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891331c4-9349-4d01-b40c-82748852bf3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:13.501784 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891331c4-9349-4d01-b40c-82748852bf3a admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:13.502096 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891331c4-9349-4d01-b40c-82748852bf3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:13.502380 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891331c4-9349-4d01-b40c-82748852bf3a admin admin] PATH_INFO: `/v3/projects/eb1a8cdc72fd4801b4eca65fb0596710/users/5e749dd180f24879aea06fa5a8e9cd26/roles/4abcf5e5e7cd4b53ae1828fec6550d53` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:13.524095 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891331c4-9349-4d01-b40c-82748852bf3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb1a8cdc72fd4801b4eca65fb0596710, user_id=5e749dd180f24879aea06fa5a8e9cd26, role_id=4abcf5e5e7cd4b53ae1828fec6550d53)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:13.528317 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891331c4-9349-4d01-b40c-82748852bf3a admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:13.550326 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1022/2083] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:38:13 2022] PUT /identity/v3/projects/eb1a8cdc72fd4801b4eca65fb0596710/users/5e749dd180f24879aea06fa5a8e9cd26/roles/4abcf5e5e7cd4b53ae1828fec6550d53 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:38:13.626431 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de395e5a-697b-431c-9c57-37acd72cad80 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:13.626790 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de395e5a-697b-431c-9c57-37acd72cad80 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:13.627025 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de395e5a-697b-431c-9c57-37acd72cad80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:13.657609 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-de395e5a-697b-431c-9c57-37acd72cad80 None None] MFA Rules not processed for user `5e749dd180f24879aea06fa5a8e9cd26`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:38:13.659130 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-de395e5a-697b-431c-9c57-37acd72cad80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:13.748187 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1062/2084] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:38:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:38:13.761238 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891331c4-9349-4d01-b40c-82748852bf3a admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:13.763444 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-891331c4-9349-4d01-b40c-82748852bf3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:13.839849 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891331c4-9349-4d01-b40c-82748852bf3a admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:13.843615 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4ffb6e-5521-4256-9ee7-778b72be80d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea647438ea1c438987f28cbe39c3ff2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:13.844898 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4ffb6e-5521-4256-9ee7-778b72be80d7 service cinder] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:13.845379 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4ffb6e-5521-4256-9ee7-778b72be80d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:13.845786 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4ffb6e-5521-4256-9ee7-778b72be80d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:13.855602 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4ffb6e-5521-4256-9ee7-778b72be80d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:13.857214 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4ffb6e-5521-4256-9ee7-778b72be80d7 service cinder] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:13.867667 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1023/2085] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:38:13 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:38:16.477024 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de395e5a-697b-431c-9c57-37acd72cad80 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:16.592419 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de395e5a-697b-431c-9c57-37acd72cad80 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:16.598317 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26d90b1-e2f4-4f9a-8cdf-5e53a0c90e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:16.599270 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d90b1-e2f4-4f9a-8cdf-5e53a0c90e95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:16.599742 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d90b1-e2f4-4f9a-8cdf-5e53a0c90e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:16.600077 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d90b1-e2f4-4f9a-8cdf-5e53a0c90e95 admin admin] PATH_INFO: `/v3/users/5e749dd180f24879aea06fa5a8e9cd26` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:16.601420 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26d90b1-e2f4-4f9a-8cdf-5e53a0c90e95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e749dd180f24879aea06fa5a8e9cd26)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:16.603479 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26d90b1-e2f4-4f9a-8cdf-5e53a0c90e95 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:16.668760 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-e26d90b1-e2f4-4f9a-8cdf-5e53a0c90e95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e749dd180f24879aea06fa5a8e9cd26'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:16.677266 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-e26d90b1-e2f4-4f9a-8cdf-5e53a0c90e95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e749dd180f24879aea06fa5a8e9cd26'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:16.678073 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-e26d90b1-e2f4-4f9a-8cdf-5e53a0c90e95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e749dd180f24879aea06fa5a8e9cd26'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:16.678746 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-e26d90b1-e2f4-4f9a-8cdf-5e53a0c90e95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e749dd180f24879aea06fa5a8e9cd26'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:16.684071 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:16.697796 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-e26d90b1-e2f4-4f9a-8cdf-5e53a0c90e95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e749dd180f24879aea06fa5a8e9cd26'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:16.729904 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1063/2086] 10.222.0.118 () {58 vars in 1228 bytes} [Thu Jul 14 15:38:16 2022] DELETE /identity/v3/users/5e749dd180f24879aea06fa5a8e9cd26 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:38:16.731867 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d770b767-0001-4a0c-b48b-a14fb241adda None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:16.732305 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d770b767-0001-4a0c-b48b-a14fb241adda None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:16.732552 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d770b767-0001-4a0c-b48b-a14fb241adda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:16.753775 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-d770b767-0001-4a0c-b48b-a14fb241adda None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:38:16.755063 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-d770b767-0001-4a0c-b48b-a14fb241adda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:16.825785 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1024/2087] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:38:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:38:16.835439 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26d90b1-e2f4-4f9a-8cdf-5e53a0c90e95 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:16.836884 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-e26d90b1-e2f4-4f9a-8cdf-5e53a0c90e95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:16.896431 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26d90b1-e2f4-4f9a-8cdf-5e53a0c90e95 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:16.900269 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3e9e01-4136-4d1a-8ab3-335f84c84ab3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b650be8114b64df0ac88441f1c50b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:16.900916 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e9e01-4136-4d1a-8ab3-335f84c84ab3 service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:16.901193 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e9e01-4136-4d1a-8ab3-335f84c84ab3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:16.901466 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e9e01-4136-4d1a-8ab3-335f84c84ab3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:16.911217 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3e9e01-4136-4d1a-8ab3-335f84c84ab3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:16.912689 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3e9e01-4136-4d1a-8ab3-335f84c84ab3 service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:16.922649 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1064/2088] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:38:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:38:17.212641 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d770b767-0001-4a0c-b48b-a14fb241adda None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:17.214136 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-d770b767-0001-4a0c-b48b-a14fb241adda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:17.228752 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d770b767-0001-4a0c-b48b-a14fb241adda None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:17.233854 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6939ee-9b2b-473d-a1a2-0fe737c7e035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:17.234942 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6939ee-9b2b-473d-a1a2-0fe737c7e035 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:17.235671 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6939ee-9b2b-473d-a1a2-0fe737c7e035 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:17.235953 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6939ee-9b2b-473d-a1a2-0fe737c7e035 admin admin] PATH_INFO: `/v3/projects/eb1a8cdc72fd4801b4eca65fb0596710` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:17.237156 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6939ee-9b2b-473d-a1a2-0fe737c7e035 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb1a8cdc72fd4801b4eca65fb0596710)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:17.239829 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6939ee-9b2b-473d-a1a2-0fe737c7e035 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:17.268286 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:17.292925 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-dd6939ee-9b2b-473d-a1a2-0fe737c7e035 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb1a8cdc72fd4801b4eca65fb0596710', 'request_id': 'req-dd6939ee-9b2b-473d-a1a2-0fe737c7e035'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:17.298988 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-dd6939ee-9b2b-473d-a1a2-0fe737c7e035 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb1a8cdc72fd4801b4eca65fb0596710', 'request_id': 'req-dd6939ee-9b2b-473d-a1a2-0fe737c7e035'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:17.304698 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-dd6939ee-9b2b-473d-a1a2-0fe737c7e035 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb1a8cdc72fd4801b4eca65fb0596710', 'request_id': 'req-dd6939ee-9b2b-473d-a1a2-0fe737c7e035'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:17.317914 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-dd6939ee-9b2b-473d-a1a2-0fe737c7e035 admin admin] The token cache is being invalidate because project eb1a8cdc72fd4801b4eca65fb0596710 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:38:17.318231 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-dd6939ee-9b2b-473d-a1a2-0fe737c7e035 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:17.318858 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-dd6939ee-9b2b-473d-a1a2-0fe737c7e035 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:17.320434 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1025/2089] 10.222.0.118 () {58 vars in 1237 bytes} [Thu Jul 14 15:38:17 2022] DELETE /identity/v3/projects/eb1a8cdc72fd4801b4eca65fb0596710 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:38:20.366427 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3e9e01-4136-4d1a-8ab3-335f84c84ab3 service neutron] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:20.367822 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-6f3e9e01-4136-4d1a-8ab3-335f84c84ab3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:20.380739 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3e9e01-4136-4d1a-8ab3-335f84c84ab3 service neutron] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:20.437457 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017281c4-fbcf-493b-b343-8037bbf2b61f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:20.438351 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017281c4-fbcf-493b-b343-8037bbf2b61f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:20.438630 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017281c4-fbcf-493b-b343-8037bbf2b61f admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:20.438904 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017281c4-fbcf-493b-b343-8037bbf2b61f admin admin] PATH_INFO: `/v3/users/5215fb46983345cf8fa0765e2408dfd5` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:20.440100 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017281c4-fbcf-493b-b343-8037bbf2b61f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5215fb46983345cf8fa0765e2408dfd5)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:20.442047 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017281c4-fbcf-493b-b343-8037bbf2b61f admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:20.489012 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-017281c4-fbcf-493b-b343-8037bbf2b61f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5215fb46983345cf8fa0765e2408dfd5'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:20.498340 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-017281c4-fbcf-493b-b343-8037bbf2b61f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5215fb46983345cf8fa0765e2408dfd5'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:20.499426 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-017281c4-fbcf-493b-b343-8037bbf2b61f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5215fb46983345cf8fa0765e2408dfd5'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:20.500451 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-017281c4-fbcf-493b-b343-8037bbf2b61f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5215fb46983345cf8fa0765e2408dfd5'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:20.513785 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-017281c4-fbcf-493b-b343-8037bbf2b61f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5215fb46983345cf8fa0765e2408dfd5'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:20.523578 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:20.528591 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1065/2090] 10.222.0.118 () {58 vars in 1228 bytes} [Thu Jul 14 15:38:20 2022] DELETE /identity/v3/users/5215fb46983345cf8fa0765e2408dfd5 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:38:20.534161 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacb5a40-fd4f-418e-89c1-d46457da322a None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:20.534655 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacb5a40-fd4f-418e-89c1-d46457da322a None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:20.534750 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacb5a40-fd4f-418e-89c1-d46457da322a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:20.551773 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-eacb5a40-fd4f-418e-89c1-d46457da322a None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:38:20.552965 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-eacb5a40-fd4f-418e-89c1-d46457da322a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:20.610654 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1026/2091] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:38:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:38:20.620482 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017281c4-fbcf-493b-b343-8037bbf2b61f admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:20.622202 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-017281c4-fbcf-493b-b343-8037bbf2b61f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:20.679785 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017281c4-fbcf-493b-b343-8037bbf2b61f admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:20.683522 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904fdebf-d1ad-4a84-9ed2-979d473bb1ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b650be8114b64df0ac88441f1c50b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:20.684255 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904fdebf-d1ad-4a84-9ed2-979d473bb1ae service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:20.684580 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904fdebf-d1ad-4a84-9ed2-979d473bb1ae service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:20.684811 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904fdebf-d1ad-4a84-9ed2-979d473bb1ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:20.694669 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904fdebf-d1ad-4a84-9ed2-979d473bb1ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:20.696110 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904fdebf-d1ad-4a84-9ed2-979d473bb1ae service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:20.710009 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1066/2092] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:38:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:38:21.100030 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacb5a40-fd4f-418e-89c1-d46457da322a None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:21.101564 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-eacb5a40-fd4f-418e-89c1-d46457da322a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:21.115811 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacb5a40-fd4f-418e-89c1-d46457da322a None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:21.120706 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af829cc5-44d4-4c86-99b4-6e5f1752b28a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:21.121843 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af829cc5-44d4-4c86-99b4-6e5f1752b28a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:21.122157 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af829cc5-44d4-4c86-99b4-6e5f1752b28a admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:21.122556 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af829cc5-44d4-4c86-99b4-6e5f1752b28a admin admin] PATH_INFO: `/v3/users/2ecb87f9dbaa490a89397bb32055fe93` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:21.123804 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af829cc5-44d4-4c86-99b4-6e5f1752b28a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ecb87f9dbaa490a89397bb32055fe93)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:21.126536 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af829cc5-44d4-4c86-99b4-6e5f1752b28a admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:21.146913 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904fdebf-d1ad-4a84-9ed2-979d473bb1ae service neutron] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:21.149240 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-904fdebf-d1ad-4a84-9ed2-979d473bb1ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:21.170475 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904fdebf-d1ad-4a84-9ed2-979d473bb1ae service neutron] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:21.178948 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e93925b-23f5-4875-a176-4594fd54fb9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:21.180030 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e93925b-23f5-4875-a176-4594fd54fb9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:21.180420 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e93925b-23f5-4875-a176-4594fd54fb9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:21.180899 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e93925b-23f5-4875-a176-4594fd54fb9b admin admin] PATH_INFO: `/v3/projects/9310c121358147958257abdf78ea192d` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:21.182503 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e93925b-23f5-4875-a176-4594fd54fb9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9310c121358147958257abdf78ea192d)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:21.185442 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e93925b-23f5-4875-a176-4594fd54fb9b admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:21.222273 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-af829cc5-44d4-4c86-99b4-6e5f1752b28a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ecb87f9dbaa490a89397bb32055fe93'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:21.231020 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-af829cc5-44d4-4c86-99b4-6e5f1752b28a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ecb87f9dbaa490a89397bb32055fe93'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:21.232212 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-af829cc5-44d4-4c86-99b4-6e5f1752b28a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ecb87f9dbaa490a89397bb32055fe93'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:21.233046 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-af829cc5-44d4-4c86-99b4-6e5f1752b28a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ecb87f9dbaa490a89397bb32055fe93'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:21.248017 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-af829cc5-44d4-4c86-99b4-6e5f1752b28a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ecb87f9dbaa490a89397bb32055fe93'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:21.252351 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-5e93925b-23f5-4875-a176-4594fd54fb9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9310c121358147958257abdf78ea192d', 'request_id': 'req-5e93925b-23f5-4875-a176-4594fd54fb9b'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:21.259101 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-5e93925b-23f5-4875-a176-4594fd54fb9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9310c121358147958257abdf78ea192d', 'request_id': 'req-5e93925b-23f5-4875-a176-4594fd54fb9b'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:21.265737 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-5e93925b-23f5-4875-a176-4594fd54fb9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9310c121358147958257abdf78ea192d', 'request_id': 'req-5e93925b-23f5-4875-a176-4594fd54fb9b'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:21.267208 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1027/2093] 10.222.0.118 () {58 vars in 1228 bytes} [Thu Jul 14 15:38:21 2022] DELETE /identity/v3/users/2ecb87f9dbaa490a89397bb32055fe93 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:38:21.271431 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f19f42-b32b-40bf-b978-974b0200fb07 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:21.271694 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f19f42-b32b-40bf-b978-974b0200fb07 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:21.272031 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f19f42-b32b-40bf-b978-974b0200fb07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:21.280748 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-5e93925b-23f5-4875-a176-4594fd54fb9b admin admin] The token cache is being invalidate because project 9310c121358147958257abdf78ea192d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:38:21.281039 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-5e93925b-23f5-4875-a176-4594fd54fb9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:21.281688 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-5e93925b-23f5-4875-a176-4594fd54fb9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:21.283246 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1067/2094] 10.222.0.118 () {58 vars in 1237 bytes} [Thu Jul 14 15:38:21 2022] DELETE /identity/v3/projects/9310c121358147958257abdf78ea192d => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:38:21.287832 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d282769f-c6cf-4af4-bfcb-d72b866de6b8 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:21.288119 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d282769f-c6cf-4af4-bfcb-d72b866de6b8 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:21.288397 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d282769f-c6cf-4af4-bfcb-d72b866de6b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:21.290448 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-20f19f42-b32b-40bf-b978-974b0200fb07 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:38:21.291701 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-20f19f42-b32b-40bf-b978-974b0200fb07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:21.306962 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-d282769f-c6cf-4af4-bfcb-d72b866de6b8 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:38:21.308267 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-d282769f-c6cf-4af4-bfcb-d72b866de6b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:21.310829 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:21.356431 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1028/2095] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:38:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:38:21.366251 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f19f42-b32b-40bf-b978-974b0200fb07 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:21.367673 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-20f19f42-b32b-40bf-b978-974b0200fb07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:21.372362 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1068/2096] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:38:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:38:21.380426 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb77d7ae-8e93-4d16-a613-cc00704e43d1 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:21.380711 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb77d7ae-8e93-4d16-a613-cc00704e43d1 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:21.380988 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb77d7ae-8e93-4d16-a613-cc00704e43d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:21.402337 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-eb77d7ae-8e93-4d16-a613-cc00704e43d1 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:38:21.403611 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-eb77d7ae-8e93-4d16-a613-cc00704e43d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:21.412181 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1069/2097] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:38:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:38:21.416428 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb77d7ae-8e93-4d16-a613-cc00704e43d1 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:21.425295 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb77d7ae-8e93-4d16-a613-cc00704e43d1 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:21.428945 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f19f42-b32b-40bf-b978-974b0200fb07 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:21.429886 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943afe99-d81c-4dd4-89cf-80899c756cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:21.430572 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943afe99-d81c-4dd4-89cf-80899c756cae admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:21.431315 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943afe99-d81c-4dd4-89cf-80899c756cae admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:21.431315 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943afe99-d81c-4dd4-89cf-80899c756cae admin admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:21.431823 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943afe99-d81c-4dd4-89cf-80899c756cae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:38:21.432128 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943afe99-d81c-4dd4-89cf-80899c756cae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:21.433994 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943afe99-d81c-4dd4-89cf-80899c756cae admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:21.436409 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93598fb5-fbb4-4f2d-889b-203051685da3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b650be8114b64df0ac88441f1c50b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:21.438442 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93598fb5-fbb4-4f2d-889b-203051685da3 service neutron] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:21.438765 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93598fb5-fbb4-4f2d-889b-203051685da3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:21.439818 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93598fb5-fbb4-4f2d-889b-203051685da3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:21.448067 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1070/2098] 10.222.0.118 () {58 vars in 1157 bytes} [Thu Jul 14 15:38:21 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:38:21.451687 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93598fb5-fbb4-4f2d-889b-203051685da3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:21.452418 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943afe99-d81c-4dd4-89cf-80899c756cae admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:21.453310 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93598fb5-fbb4-4f2d-889b-203051685da3 service neutron] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:21.463193 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943afe99-d81c-4dd4-89cf-80899c756cae admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:21.464208 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1029/2099] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:38:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:38:21.468113 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daa4585-3817-4fd4-bc4e-8faccee7b931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:21.468767 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daa4585-3817-4fd4-bc4e-8faccee7b931 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:21.469078 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daa4585-3817-4fd4-bc4e-8faccee7b931 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:21.469351 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daa4585-3817-4fd4-bc4e-8faccee7b931 admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:21.470098 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daa4585-3817-4fd4-bc4e-8faccee7b931 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:21.472018 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daa4585-3817-4fd4-bc4e-8faccee7b931 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:21.475536 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:21.507824 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1071/2100] 10.222.0.118 () {60 vars in 1157 bytes} [Thu Jul 14 15:38:21 2022] POST /identity/v3/projects => generated 400 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:38:21.509091 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93598fb5-fbb4-4f2d-889b-203051685da3 service neutron] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:21.520069 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93598fb5-fbb4-4f2d-889b-203051685da3 service neutron] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:21.589541 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bf10fe-6cd1-45a8-b1db-1adaf2151745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:21.590266 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bf10fe-6cd1-45a8-b1db-1adaf2151745 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:21.590553 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bf10fe-6cd1-45a8-b1db-1adaf2151745 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:21.590829 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bf10fe-6cd1-45a8-b1db-1adaf2151745 admin admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:21.591531 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bf10fe-6cd1-45a8-b1db-1adaf2151745 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:21.593496 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bf10fe-6cd1-45a8-b1db-1adaf2151745 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:21.615945 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1030/2101] 10.222.0.118 () {60 vars in 1148 bytes} [Thu Jul 14 15:38:21 2022] POST /identity/v3/users => generated 301 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:38:21.620002 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daa4585-3817-4fd4-bc4e-8faccee7b931 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:21.631345 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daa4585-3817-4fd4-bc4e-8faccee7b931 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:21.636227 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8bc242-637c-4b6e-82de-b32140ce914c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:21.637117 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8bc242-637c-4b6e-82de-b32140ce914c admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:21.637404 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8bc242-637c-4b6e-82de-b32140ce914c admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:21.637685 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8bc242-637c-4b6e-82de-b32140ce914c admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:21.638856 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8bc242-637c-4b6e-82de-b32140ce914c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:21.640493 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8bc242-637c-4b6e-82de-b32140ce914c admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:21.652581 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1072/2102] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:38:21 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:38:21.656481 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bf10fe-6cd1-45a8-b1db-1adaf2151745 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:21.667610 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bf10fe-6cd1-45a8-b1db-1adaf2151745 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:21.674009 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46980958-4c2d-4940-a96b-d1b67f68352b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:21.674704 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46980958-4c2d-4940-a96b-d1b67f68352b admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:21.674990 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46980958-4c2d-4940-a96b-d1b67f68352b admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:21.675288 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46980958-4c2d-4940-a96b-d1b67f68352b admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:21.676268 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46980958-4c2d-4940-a96b-d1b67f68352b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:21.677896 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46980958-4c2d-4940-a96b-d1b67f68352b admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:21.689346 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1031/2103] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:38:21 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:38:21.693794 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8bc242-637c-4b6e-82de-b32140ce914c admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:21.705135 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8bc242-637c-4b6e-82de-b32140ce914c admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:21.710041 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd94ad8-5e55-4d52-9777-de90d6e5ac91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:21.710943 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd94ad8-5e55-4d52-9777-de90d6e5ac91 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:21.711225 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd94ad8-5e55-4d52-9777-de90d6e5ac91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:21.711507 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd94ad8-5e55-4d52-9777-de90d6e5ac91 admin admin] PATH_INFO: `/v3/projects/7ca662c895474ca18fcebaab3d8b9ec0/users/8051772f4f4b41bf86e6731d626af3ac/roles/4abcf5e5e7cd4b53ae1828fec6550d53` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:21.727196 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd94ad8-5e55-4d52-9777-de90d6e5ac91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ca662c895474ca18fcebaab3d8b9ec0, user_id=8051772f4f4b41bf86e6731d626af3ac, role_id=4abcf5e5e7cd4b53ae1828fec6550d53)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:21.729876 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd94ad8-5e55-4d52-9777-de90d6e5ac91 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:21.743467 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1073/2104] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:38:21 2022] PUT /identity/v3/projects/7ca662c895474ca18fcebaab3d8b9ec0/users/8051772f4f4b41bf86e6731d626af3ac/roles/4abcf5e5e7cd4b53ae1828fec6550d53 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:38:21.756066 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f93ba2-e79f-47ae-b053-13ebf2694fb4 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:21.756393 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f93ba2-e79f-47ae-b053-13ebf2694fb4 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:21.756851 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f93ba2-e79f-47ae-b053-13ebf2694fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:21.771245 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd94ad8-5e55-4d52-9777-de90d6e5ac91 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:21.773476 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-4dd94ad8-5e55-4d52-9777-de90d6e5ac91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:21.788573 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-85f93ba2-e79f-47ae-b053-13ebf2694fb4 None None] MFA Rules not processed for user `8051772f4f4b41bf86e6731d626af3ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:38:21.789918 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-85f93ba2-e79f-47ae-b053-13ebf2694fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:21.830832 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:21.847213 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd94ad8-5e55-4d52-9777-de90d6e5ac91 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:21.851990 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49ffa08-a3ce-4112-a052-c24ae1e80caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:21.852849 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ffa08-a3ce-4112-a052-c24ae1e80caf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:21.853127 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ffa08-a3ce-4112-a052-c24ae1e80caf admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:21.853401 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ffa08-a3ce-4112-a052-c24ae1e80caf admin admin] PATH_INFO: `/v3/projects/f36910943e914afc96b02a9102819133` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:21.854618 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49ffa08-a3ce-4112-a052-c24ae1e80caf admin admin] RBAC: Authorizing `identity:delete_project(project_id=f36910943e914afc96b02a9102819133)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:21.856562 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49ffa08-a3ce-4112-a052-c24ae1e80caf admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:21.866518 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1032/2105] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:38:21 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:38:21.870764 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f93ba2-e79f-47ae-b053-13ebf2694fb4 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:21.881938 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f93ba2-e79f-47ae-b053-13ebf2694fb4 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:21.887173 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ee45bf-9ed6-40bf-bba0-ca1886da4bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:21.887901 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ee45bf-9ed6-40bf-bba0-ca1886da4bf0 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:21.888179 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ee45bf-9ed6-40bf-bba0-ca1886da4bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:21.888447 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ee45bf-9ed6-40bf-bba0-ca1886da4bf0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:21.889133 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ee45bf-9ed6-40bf-bba0-ca1886da4bf0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:21.891117 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ee45bf-9ed6-40bf-bba0-ca1886da4bf0 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:21.908930 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-d49ffa08-a3ce-4112-a052-c24ae1e80caf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f36910943e914afc96b02a9102819133', 'request_id': 'req-d49ffa08-a3ce-4112-a052-c24ae1e80caf'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:21.915635 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-d49ffa08-a3ce-4112-a052-c24ae1e80caf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f36910943e914afc96b02a9102819133', 'request_id': 'req-d49ffa08-a3ce-4112-a052-c24ae1e80caf'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:21.922850 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-d49ffa08-a3ce-4112-a052-c24ae1e80caf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f36910943e914afc96b02a9102819133', 'request_id': 'req-d49ffa08-a3ce-4112-a052-c24ae1e80caf'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:21.926180 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1033/2106] 10.222.0.118 () {60 vars in 1157 bytes} [Thu Jul 14 15:38:21 2022] POST /identity/v3/projects => generated 406 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:38:21.927698 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ee45bf-9ed6-40bf-bba0-ca1886da4bf0 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:21.939926 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-d49ffa08-a3ce-4112-a052-c24ae1e80caf admin admin] The token cache is being invalidate because project f36910943e914afc96b02a9102819133 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:38:21.940318 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-d49ffa08-a3ce-4112-a052-c24ae1e80caf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:21.941023 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-d49ffa08-a3ce-4112-a052-c24ae1e80caf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:21.942714 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1074/2107] 10.222.0.118 () {58 vars in 1237 bytes} [Thu Jul 14 15:38:21 2022] DELETE /identity/v3/projects/f36910943e914afc96b02a9102819133 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:38:22.010302 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ee45bf-9ed6-40bf-bba0-ca1886da4bf0 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:22.015306 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83faf7b5-f51b-419d-8e76-ded51b63710f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:22.016022 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83faf7b5-f51b-419d-8e76-ded51b63710f admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:22.016301 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83faf7b5-f51b-419d-8e76-ded51b63710f admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:22.016575 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83faf7b5-f51b-419d-8e76-ded51b63710f admin admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:22.017291 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83faf7b5-f51b-419d-8e76-ded51b63710f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:22.019344 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83faf7b5-f51b-419d-8e76-ded51b63710f admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:22.045213 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1034/2108] 10.222.0.118 () {60 vars in 1148 bytes} [Thu Jul 14 15:38:21 2022] POST /identity/v3/users => generated 310 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:38:22.049810 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49ffa08-a3ce-4112-a052-c24ae1e80caf admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:22.051926 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-d49ffa08-a3ce-4112-a052-c24ae1e80caf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:22.110754 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:22.135876 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49ffa08-a3ce-4112-a052-c24ae1e80caf admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:22.140869 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef2cc07-4aa9-4b02-9b53-3e8307cac038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:22.141554 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef2cc07-4aa9-4b02-9b53-3e8307cac038 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:22.141832 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef2cc07-4aa9-4b02-9b53-3e8307cac038 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:22.142280 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef2cc07-4aa9-4b02-9b53-3e8307cac038 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:22.143026 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef2cc07-4aa9-4b02-9b53-3e8307cac038 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:22.144886 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef2cc07-4aa9-4b02-9b53-3e8307cac038 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:22.155669 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1075/2109] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:38:22 2022] GET /identity/v3/roles => generated 1427 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:38:22.160455 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83faf7b5-f51b-419d-8e76-ded51b63710f admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:22.170544 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83faf7b5-f51b-419d-8e76-ded51b63710f admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:22.175822 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc09eb6-31a7-43b9-9a51-98630209e407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:22.176704 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc09eb6-31a7-43b9-9a51-98630209e407 admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:22.176988 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc09eb6-31a7-43b9-9a51-98630209e407 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:22.177265 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc09eb6-31a7-43b9-9a51-98630209e407 admin admin] PATH_INFO: `/v3/projects/82930b6f3a32408aac903b6da36ada71/users/efeba232ac8f4e95a2b48f170ec5f774/roles/3b880cef7dcf4baf87b50f8610c0c56e` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:22.192063 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc09eb6-31a7-43b9-9a51-98630209e407 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82930b6f3a32408aac903b6da36ada71, user_id=efeba232ac8f4e95a2b48f170ec5f774, role_id=3b880cef7dcf4baf87b50f8610c0c56e)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:22.194849 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc09eb6-31a7-43b9-9a51-98630209e407 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:22.209003 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1035/2110] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:38:22 2022] PUT /identity/v3/projects/82930b6f3a32408aac903b6da36ada71/users/efeba232ac8f4e95a2b48f170ec5f774/roles/3b880cef7dcf4baf87b50f8610c0c56e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:38:22.213083 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef2cc07-4aa9-4b02-9b53-3e8307cac038 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:22.223550 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef2cc07-4aa9-4b02-9b53-3e8307cac038 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:22.284873 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc0727f-855c-48ee-bacc-601f1e854cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:22.285664 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc0727f-855c-48ee-bacc-601f1e854cee admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:22.286045 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc0727f-855c-48ee-bacc-601f1e854cee admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:22.286407 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc0727f-855c-48ee-bacc-601f1e854cee admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:22.287209 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc0727f-855c-48ee-bacc-601f1e854cee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:22.288887 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc0727f-855c-48ee-bacc-601f1e854cee admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:22.303779 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1076/2111] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:38:22 2022] GET /identity/v3/roles => generated 1427 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:38:22.304962 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc09eb6-31a7-43b9-9a51-98630209e407 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:22.318261 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc09eb6-31a7-43b9-9a51-98630209e407 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:22.323080 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db79a0c4-37bb-4969-93fb-b248e319e66b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:22.324000 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db79a0c4-37bb-4969-93fb-b248e319e66b admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:22.324279 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db79a0c4-37bb-4969-93fb-b248e319e66b admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:22.324737 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db79a0c4-37bb-4969-93fb-b248e319e66b admin admin] PATH_INFO: `/v3/projects/82930b6f3a32408aac903b6da36ada71/users/efeba232ac8f4e95a2b48f170ec5f774/roles/3b880cef7dcf4baf87b50f8610c0c56e` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:22.327022 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db79a0c4-37bb-4969-93fb-b248e319e66b admin admin] RBAC: Authorizing `identity:create_grant(project_id=82930b6f3a32408aac903b6da36ada71, user_id=efeba232ac8f4e95a2b48f170ec5f774, role_id=3b880cef7dcf4baf87b50f8610c0c56e)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:22.329387 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db79a0c4-37bb-4969-93fb-b248e319e66b admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:22.340459 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1036/2112] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:38:22 2022] PUT /identity/v3/projects/82930b6f3a32408aac903b6da36ada71/users/efeba232ac8f4e95a2b48f170ec5f774/roles/3b880cef7dcf4baf87b50f8610c0c56e => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:38:22.351308 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef2e55d-c59f-4785-bdee-4ab4ad56e8cc None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:22.351595 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef2e55d-c59f-4785-bdee-4ab4ad56e8cc None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:22.351900 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef2e55d-c59f-4785-bdee-4ab4ad56e8cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:22.380524 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-8ef2e55d-c59f-4785-bdee-4ab4ad56e8cc None None] MFA Rules not processed for user `efeba232ac8f4e95a2b48f170ec5f774`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:38:22.381768 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-8ef2e55d-c59f-4785-bdee-4ab4ad56e8cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:22.449007 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1077/2113] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:38:22 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:38:22.460321 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db79a0c4-37bb-4969-93fb-b248e319e66b admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:22.462038 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-db79a0c4-37bb-4969-93fb-b248e319e66b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:22.527402 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db79a0c4-37bb-4969-93fb-b248e319e66b admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:22.531140 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9ef374-c673-43f5-b825-0dc2f948f2b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea647438ea1c438987f28cbe39c3ff2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:22.532480 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ef374-c673-43f5-b825-0dc2f948f2b0 service cinder] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:22.532766 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ef374-c673-43f5-b825-0dc2f948f2b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:22.533043 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ef374-c673-43f5-b825-0dc2f948f2b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:22.543204 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9ef374-c673-43f5-b825-0dc2f948f2b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:22.544875 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9ef374-c673-43f5-b825-0dc2f948f2b0 service cinder] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:22.555147 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1037/2114] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:38:22 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:38:22.686682 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef2e55d-c59f-4785-bdee-4ab4ad56e8cc None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:22.743840 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:22.748308 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef2e55d-c59f-4785-bdee-4ab4ad56e8cc None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:22.753105 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04085b56-a386-460e-9c66-75246613898a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:22.753989 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04085b56-a386-460e-9c66-75246613898a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:22.754267 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04085b56-a386-460e-9c66-75246613898a admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:22.754537 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04085b56-a386-460e-9c66-75246613898a admin admin] PATH_INFO: `/v3/users/8051772f4f4b41bf86e6731d626af3ac` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:22.755705 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04085b56-a386-460e-9c66-75246613898a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8051772f4f4b41bf86e6731d626af3ac)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:22.757642 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04085b56-a386-460e-9c66-75246613898a admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:22.804040 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-04085b56-a386-460e-9c66-75246613898a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8051772f4f4b41bf86e6731d626af3ac'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:22.811512 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-04085b56-a386-460e-9c66-75246613898a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8051772f4f4b41bf86e6731d626af3ac'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:22.812123 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-04085b56-a386-460e-9c66-75246613898a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8051772f4f4b41bf86e6731d626af3ac'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:22.812781 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-04085b56-a386-460e-9c66-75246613898a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8051772f4f4b41bf86e6731d626af3ac'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:22.824874 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-04085b56-a386-460e-9c66-75246613898a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8051772f4f4b41bf86e6731d626af3ac'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:22.838468 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1078/2115] 10.222.0.118 () {58 vars in 1228 bytes} [Thu Jul 14 15:38:22 2022] DELETE /identity/v3/users/8051772f4f4b41bf86e6731d626af3ac => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:38:22.843415 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1345d8-0ea3-44f5-a51f-503482863524 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:22.843951 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1345d8-0ea3-44f5-a51f-503482863524 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:22.844626 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1345d8-0ea3-44f5-a51f-503482863524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:22.859023 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:22.866345 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-fc1345d8-0ea3-44f5-a51f-503482863524 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:38:22.867803 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-fc1345d8-0ea3-44f5-a51f-503482863524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:22.929928 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1038/2116] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:38:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:38:22.940788 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04085b56-a386-460e-9c66-75246613898a admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:22.942280 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-04085b56-a386-460e-9c66-75246613898a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:23.001138 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04085b56-a386-460e-9c66-75246613898a admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:23.005374 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45516710-176e-414c-b3f6-65ba40bf062e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b650be8114b64df0ac88441f1c50b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:23.006075 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45516710-176e-414c-b3f6-65ba40bf062e service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:23.006355 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45516710-176e-414c-b3f6-65ba40bf062e service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:23.006628 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45516710-176e-414c-b3f6-65ba40bf062e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:23.017469 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45516710-176e-414c-b3f6-65ba40bf062e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:23.020581 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45516710-176e-414c-b3f6-65ba40bf062e service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:23.032176 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1079/2117] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:38:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:38:23.368711 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1345d8-0ea3-44f5-a51f-503482863524 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:23.370339 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-fc1345d8-0ea3-44f5-a51f-503482863524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:23.384010 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1345d8-0ea3-44f5-a51f-503482863524 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:23.389187 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353645ea-3343-4a16-94a6-5f8e94102c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:23.390236 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353645ea-3343-4a16-94a6-5f8e94102c03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:23.390644 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353645ea-3343-4a16-94a6-5f8e94102c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:23.391026 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353645ea-3343-4a16-94a6-5f8e94102c03 admin admin] PATH_INFO: `/v3/projects/7ca662c895474ca18fcebaab3d8b9ec0` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:23.392331 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353645ea-3343-4a16-94a6-5f8e94102c03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ca662c895474ca18fcebaab3d8b9ec0)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:23.394631 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353645ea-3343-4a16-94a6-5f8e94102c03 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:23.445250 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-353645ea-3343-4a16-94a6-5f8e94102c03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ca662c895474ca18fcebaab3d8b9ec0', 'request_id': 'req-353645ea-3343-4a16-94a6-5f8e94102c03'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:23.451904 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-353645ea-3343-4a16-94a6-5f8e94102c03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ca662c895474ca18fcebaab3d8b9ec0', 'request_id': 'req-353645ea-3343-4a16-94a6-5f8e94102c03'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:23.458373 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-353645ea-3343-4a16-94a6-5f8e94102c03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ca662c895474ca18fcebaab3d8b9ec0', 'request_id': 'req-353645ea-3343-4a16-94a6-5f8e94102c03'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:23.471852 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-353645ea-3343-4a16-94a6-5f8e94102c03 admin admin] The token cache is being invalidate because project 7ca662c895474ca18fcebaab3d8b9ec0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:38:23.472145 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-353645ea-3343-4a16-94a6-5f8e94102c03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:23.472760 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-353645ea-3343-4a16-94a6-5f8e94102c03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:23.474335 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1039/2118] 10.222.0.118 () {58 vars in 1237 bytes} [Thu Jul 14 15:38:23 2022] DELETE /identity/v3/projects/7ca662c895474ca18fcebaab3d8b9ec0 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:38:23.478920 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45516710-176e-414c-b3f6-65ba40bf062e service neutron] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:23.489189 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45516710-176e-414c-b3f6-65ba40bf062e service neutron] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:23.549719 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f79168-6844-4ae2-9df5-57714964ded6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:23.550763 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f79168-6844-4ae2-9df5-57714964ded6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:23.551042 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f79168-6844-4ae2-9df5-57714964ded6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:23.551319 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f79168-6844-4ae2-9df5-57714964ded6 admin admin] PATH_INFO: `/v3/users/efeba232ac8f4e95a2b48f170ec5f774` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:23.552574 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f79168-6844-4ae2-9df5-57714964ded6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=efeba232ac8f4e95a2b48f170ec5f774)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:23.554590 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f79168-6844-4ae2-9df5-57714964ded6 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:23.578474 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:23.608577 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-09f79168-6844-4ae2-9df5-57714964ded6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efeba232ac8f4e95a2b48f170ec5f774'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:23.616084 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-09f79168-6844-4ae2-9df5-57714964ded6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efeba232ac8f4e95a2b48f170ec5f774'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:23.616720 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-09f79168-6844-4ae2-9df5-57714964ded6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efeba232ac8f4e95a2b48f170ec5f774'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:23.617322 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-09f79168-6844-4ae2-9df5-57714964ded6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efeba232ac8f4e95a2b48f170ec5f774'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:23.629331 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-09f79168-6844-4ae2-9df5-57714964ded6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efeba232ac8f4e95a2b48f170ec5f774'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:23.642037 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1080/2119] 10.222.0.118 () {58 vars in 1228 bytes} [Thu Jul 14 15:38:23 2022] DELETE /identity/v3/users/efeba232ac8f4e95a2b48f170ec5f774 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:38:23.911962 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353645ea-3343-4a16-94a6-5f8e94102c03 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:23.913620 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-353645ea-3343-4a16-94a6-5f8e94102c03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:23.930909 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353645ea-3343-4a16-94a6-5f8e94102c03 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:23.990424 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea3a7ee-6fad-4e90-9ca1-b6ada851ca0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:23.991485 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea3a7ee-6fad-4e90-9ca1-b6ada851ca0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:23.991825 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea3a7ee-6fad-4e90-9ca1-b6ada851ca0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:23.992135 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea3a7ee-6fad-4e90-9ca1-b6ada851ca0a admin admin] PATH_INFO: `/v3/projects/82930b6f3a32408aac903b6da36ada71` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:23.993364 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea3a7ee-6fad-4e90-9ca1-b6ada851ca0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=82930b6f3a32408aac903b6da36ada71)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:23.995317 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea3a7ee-6fad-4e90-9ca1-b6ada851ca0a admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:24.030081 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:24.044140 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-9ea3a7ee-6fad-4e90-9ca1-b6ada851ca0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82930b6f3a32408aac903b6da36ada71', 'request_id': 'req-9ea3a7ee-6fad-4e90-9ca1-b6ada851ca0a'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:24.050135 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-9ea3a7ee-6fad-4e90-9ca1-b6ada851ca0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82930b6f3a32408aac903b6da36ada71', 'request_id': 'req-9ea3a7ee-6fad-4e90-9ca1-b6ada851ca0a'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:24.055484 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-9ea3a7ee-6fad-4e90-9ca1-b6ada851ca0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82930b6f3a32408aac903b6da36ada71', 'request_id': 'req-9ea3a7ee-6fad-4e90-9ca1-b6ada851ca0a'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:24.069054 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-9ea3a7ee-6fad-4e90-9ca1-b6ada851ca0a admin admin] The token cache is being invalidate because project 82930b6f3a32408aac903b6da36ada71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:38:24.069338 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-9ea3a7ee-6fad-4e90-9ca1-b6ada851ca0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:24.069980 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-9ea3a7ee-6fad-4e90-9ca1-b6ada851ca0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:24.071530 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1040/2120] 10.222.0.118 () {58 vars in 1237 bytes} [Thu Jul 14 15:38:23 2022] DELETE /identity/v3/projects/82930b6f3a32408aac903b6da36ada71 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:38:24.076485 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa0e85c-f633-4045-937e-8ca86db2ce00 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:24.076776 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa0e85c-f633-4045-937e-8ca86db2ce00 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:24.077051 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa0e85c-f633-4045-937e-8ca86db2ce00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:24.096066 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-1aa0e85c-f633-4045-937e-8ca86db2ce00 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:38:24.097270 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-1aa0e85c-f633-4045-937e-8ca86db2ce00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:24.156281 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1081/2121] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:38:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:38:24.164589 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75fd2fb-4a93-4052-b504-de21f8f76db2 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:24.164872 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75fd2fb-4a93-4052-b504-de21f8f76db2 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:24.165150 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75fd2fb-4a93-4052-b504-de21f8f76db2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:24.183135 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-c75fd2fb-4a93-4052-b504-de21f8f76db2 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:38:24.184350 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-c75fd2fb-4a93-4052-b504-de21f8f76db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:24.192275 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1041/2122] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:38:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:38:24.196434 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa0e85c-f633-4045-937e-8ca86db2ce00 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:24.206913 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa0e85c-f633-4045-937e-8ca86db2ce00 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:24.211492 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c958f53-4995-4778-8d1d-cc98219b9fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:24.212145 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c958f53-4995-4778-8d1d-cc98219b9fe1 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:24.212423 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c958f53-4995-4778-8d1d-cc98219b9fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:24.212697 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c958f53-4995-4778-8d1d-cc98219b9fe1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:24.213425 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c958f53-4995-4778-8d1d-cc98219b9fe1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:38:24.213736 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c958f53-4995-4778-8d1d-cc98219b9fe1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:24.215380 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c958f53-4995-4778-8d1d-cc98219b9fe1 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:24.227536 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1082/2123] 10.222.0.118 () {58 vars in 1157 bytes} [Thu Jul 14 15:38:24 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:38:24.231745 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75fd2fb-4a93-4052-b504-de21f8f76db2 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:24.241298 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75fd2fb-4a93-4052-b504-de21f8f76db2 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:24.245983 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e3766e-1c57-46e3-89c3-d2c8ac79e684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:24.246898 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e3766e-1c57-46e3-89c3-d2c8ac79e684 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:24.247177 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e3766e-1c57-46e3-89c3-d2c8ac79e684 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:24.247450 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e3766e-1c57-46e3-89c3-d2c8ac79e684 admin admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:24.248137 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e3766e-1c57-46e3-89c3-d2c8ac79e684 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:24.250067 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e3766e-1c57-46e3-89c3-d2c8ac79e684 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:24.275049 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1042/2124] 10.222.0.118 () {60 vars in 1157 bytes} [Thu Jul 14 15:38:24 2022] POST /identity/v3/projects => generated 372 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:38:24.278972 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c958f53-4995-4778-8d1d-cc98219b9fe1 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:24.289710 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c958f53-4995-4778-8d1d-cc98219b9fe1 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:24.346366 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4803c808-e29b-4fb1-b844-14b868f18266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:24.347035 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4803c808-e29b-4fb1-b844-14b868f18266 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:24.347313 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4803c808-e29b-4fb1-b844-14b868f18266 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:24.347583 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4803c808-e29b-4fb1-b844-14b868f18266 admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:24.348286 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4803c808-e29b-4fb1-b844-14b868f18266 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:24.350220 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4803c808-e29b-4fb1-b844-14b868f18266 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:24.373287 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1083/2125] 10.222.0.118 () {60 vars in 1148 bytes} [Thu Jul 14 15:38:24 2022] POST /identity/v3/users => generated 287 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:38:24.374631 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e3766e-1c57-46e3-89c3-d2c8ac79e684 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:24.385638 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e3766e-1c57-46e3-89c3-d2c8ac79e684 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:24.390618 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9db0055-e165-4176-9c5b-b96b5bae80b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:24.391971 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9db0055-e165-4176-9c5b-b96b5bae80b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:24.392246 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9db0055-e165-4176-9c5b-b96b5bae80b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:24.392517 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9db0055-e165-4176-9c5b-b96b5bae80b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:24.393243 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9db0055-e165-4176-9c5b-b96b5bae80b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:24.394908 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9db0055-e165-4176-9c5b-b96b5bae80b8 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:24.405542 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1043/2126] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:38:24 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:38:24.409696 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4803c808-e29b-4fb1-b844-14b868f18266 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:24.419913 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4803c808-e29b-4fb1-b844-14b868f18266 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:24.424572 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bebd74-9aaf-49ca-bf06-769107132a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:24.425264 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bebd74-9aaf-49ca-bf06-769107132a98 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:24.425544 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bebd74-9aaf-49ca-bf06-769107132a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:24.425817 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bebd74-9aaf-49ca-bf06-769107132a98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:24.426580 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bebd74-9aaf-49ca-bf06-769107132a98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:24.428189 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bebd74-9aaf-49ca-bf06-769107132a98 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:24.439857 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1084/2127] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:38:24 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:38:24.443654 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9db0055-e165-4176-9c5b-b96b5bae80b8 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:24.454697 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9db0055-e165-4176-9c5b-b96b5bae80b8 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:24.459620 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae86073d-6d51-42e7-b60b-250379962e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:24.460658 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae86073d-6d51-42e7-b60b-250379962e69 admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:24.461001 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae86073d-6d51-42e7-b60b-250379962e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:24.461421 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae86073d-6d51-42e7-b60b-250379962e69 admin admin] PATH_INFO: `/v3/projects/66f5eceae2744240a0a14d45edc2c1f0/users/63fbcfdc052c4bfb9b38b073094e0a2c/roles/4abcf5e5e7cd4b53ae1828fec6550d53` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:24.476395 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae86073d-6d51-42e7-b60b-250379962e69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66f5eceae2744240a0a14d45edc2c1f0, user_id=63fbcfdc052c4bfb9b38b073094e0a2c, role_id=4abcf5e5e7cd4b53ae1828fec6550d53)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:24.479137 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae86073d-6d51-42e7-b60b-250379962e69 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:24.491935 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1044/2128] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:38:24 2022] PUT /identity/v3/projects/66f5eceae2744240a0a14d45edc2c1f0/users/63fbcfdc052c4bfb9b38b073094e0a2c/roles/4abcf5e5e7cd4b53ae1828fec6550d53 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:38:24.503833 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9ea82b-4469-4aec-b52c-f4cc1337daf7 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:24.504302 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9ea82b-4469-4aec-b52c-f4cc1337daf7 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:24.504417 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9ea82b-4469-4aec-b52c-f4cc1337daf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:24.511187 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:24.535474 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-ca9ea82b-4469-4aec-b52c-f4cc1337daf7 None None] MFA Rules not processed for user `63fbcfdc052c4bfb9b38b073094e0a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:38:24.536692 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-ca9ea82b-4469-4aec-b52c-f4cc1337daf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:24.600735 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1085/2129] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:38:24 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:38:24.605157 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae86073d-6d51-42e7-b60b-250379962e69 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:24.681739 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae86073d-6d51-42e7-b60b-250379962e69 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:24.686743 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29477704-fe3c-426d-800a-efcef793425a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:24.687399 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29477704-fe3c-426d-800a-efcef793425a admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:24.688227 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29477704-fe3c-426d-800a-efcef793425a admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:24.688495 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29477704-fe3c-426d-800a-efcef793425a admin admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:24.689197 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29477704-fe3c-426d-800a-efcef793425a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:24.691132 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29477704-fe3c-426d-800a-efcef793425a admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:24.717848 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1045/2130] 10.222.0.118 () {60 vars in 1157 bytes} [Thu Jul 14 15:38:24 2022] POST /identity/v3/projects => generated 374 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:38:24.722957 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9ea82b-4469-4aec-b52c-f4cc1337daf7 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:24.734109 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9ea82b-4469-4aec-b52c-f4cc1337daf7 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:24.792822 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1067d9-ad48-47e8-bce9-59a7d3c6e2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:24.793493 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1067d9-ad48-47e8-bce9-59a7d3c6e2cb admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:24.793774 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1067d9-ad48-47e8-bce9-59a7d3c6e2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:24.794086 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1067d9-ad48-47e8-bce9-59a7d3c6e2cb admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:24.794785 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1067d9-ad48-47e8-bce9-59a7d3c6e2cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:24.797294 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1067d9-ad48-47e8-bce9-59a7d3c6e2cb admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:24.816940 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1086/2131] 10.222.0.118 () {60 vars in 1148 bytes} [Thu Jul 14 15:38:24 2022] POST /identity/v3/users => generated 294 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:38:24.820934 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29477704-fe3c-426d-800a-efcef793425a admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:24.831227 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29477704-fe3c-426d-800a-efcef793425a admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:24.836172 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd1c3a0-1be6-46a7-b6ee-9f4740215a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:24.836835 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd1c3a0-1be6-46a7-b6ee-9f4740215a5f admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:24.837138 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd1c3a0-1be6-46a7-b6ee-9f4740215a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:24.837415 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd1c3a0-1be6-46a7-b6ee-9f4740215a5f admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:24.838181 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd1c3a0-1be6-46a7-b6ee-9f4740215a5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:24.839849 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd1c3a0-1be6-46a7-b6ee-9f4740215a5f admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:24.850408 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1046/2132] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:38:24 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:38:24.854219 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1067d9-ad48-47e8-bce9-59a7d3c6e2cb admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:24.864581 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1067d9-ad48-47e8-bce9-59a7d3c6e2cb admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:24.869420 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bbbd8f-3fa1-4c30-9fa8-7d92f18c0e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:24.870319 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bbbd8f-3fa1-4c30-9fa8-7d92f18c0e73 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:24.870600 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bbbd8f-3fa1-4c30-9fa8-7d92f18c0e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:24.870877 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bbbd8f-3fa1-4c30-9fa8-7d92f18c0e73 admin admin] PATH_INFO: `/v3/projects/b1f9bbd5639147eda4283e4b7657d323/users/a8c6d2c9d57c440fb69c285d948c1059/roles/3b880cef7dcf4baf87b50f8610c0c56e` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:24.886346 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bbbd8f-3fa1-4c30-9fa8-7d92f18c0e73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1f9bbd5639147eda4283e4b7657d323, user_id=a8c6d2c9d57c440fb69c285d948c1059, role_id=3b880cef7dcf4baf87b50f8610c0c56e)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:24.889128 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bbbd8f-3fa1-4c30-9fa8-7d92f18c0e73 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:24.901993 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1087/2133] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:38:24 2022] PUT /identity/v3/projects/b1f9bbd5639147eda4283e4b7657d323/users/a8c6d2c9d57c440fb69c285d948c1059/roles/3b880cef7dcf4baf87b50f8610c0c56e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:38:24.906208 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd1c3a0-1be6-46a7-b6ee-9f4740215a5f admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:24.916250 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd1c3a0-1be6-46a7-b6ee-9f4740215a5f admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:24.946857 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:24.976957 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a04c0ca-ca34-4d1d-9894-b8cb3b09b857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:24.977627 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a04c0ca-ca34-4d1d-9894-b8cb3b09b857 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:24.977905 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a04c0ca-ca34-4d1d-9894-b8cb3b09b857 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:24.978237 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a04c0ca-ca34-4d1d-9894-b8cb3b09b857 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:24.978964 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a04c0ca-ca34-4d1d-9894-b8cb3b09b857 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:24.980562 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a04c0ca-ca34-4d1d-9894-b8cb3b09b857 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:24.991425 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1047/2134] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:38:24 2022] GET /identity/v3/roles => generated 1427 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:38:24.995609 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bbbd8f-3fa1-4c30-9fa8-7d92f18c0e73 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:25.006927 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bbbd8f-3fa1-4c30-9fa8-7d92f18c0e73 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:25.011677 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a753006a-b5ac-4b21-98f2-d295ac3e8c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:25.012556 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a753006a-b5ac-4b21-98f2-d295ac3e8c6a admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:25.012835 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a753006a-b5ac-4b21-98f2-d295ac3e8c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:25.013108 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a753006a-b5ac-4b21-98f2-d295ac3e8c6a admin admin] PATH_INFO: `/v3/projects/b1f9bbd5639147eda4283e4b7657d323/users/a8c6d2c9d57c440fb69c285d948c1059/roles/3b880cef7dcf4baf87b50f8610c0c56e` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:25.015180 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a753006a-b5ac-4b21-98f2-d295ac3e8c6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1f9bbd5639147eda4283e4b7657d323, user_id=a8c6d2c9d57c440fb69c285d948c1059, role_id=3b880cef7dcf4baf87b50f8610c0c56e)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:25.017807 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a753006a-b5ac-4b21-98f2-d295ac3e8c6a admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:25.028134 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1088/2135] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:38:24 2022] PUT /identity/v3/projects/b1f9bbd5639147eda4283e4b7657d323/users/a8c6d2c9d57c440fb69c285d948c1059/roles/3b880cef7dcf4baf87b50f8610c0c56e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:38:25.038971 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c64099-d196-4788-a21b-0f3487525b2e None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:25.040132 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c64099-d196-4788-a21b-0f3487525b2e None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:25.040407 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c64099-d196-4788-a21b-0f3487525b2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:25.067747 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-76c64099-d196-4788-a21b-0f3487525b2e None None] MFA Rules not processed for user `a8c6d2c9d57c440fb69c285d948c1059`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:38:25.068944 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-76c64099-d196-4788-a21b-0f3487525b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:25.137522 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1048/2136] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:38:25 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:38:25.148609 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a753006a-b5ac-4b21-98f2-d295ac3e8c6a admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:25.150357 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-a753006a-b5ac-4b21-98f2-d295ac3e8c6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:25.205881 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:25.212160 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a753006a-b5ac-4b21-98f2-d295ac3e8c6a admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:25.216273 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65ba69e-77b1-41e2-937f-5fc173abf1b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea647438ea1c438987f28cbe39c3ff2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:25.216920 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65ba69e-77b1-41e2-937f-5fc173abf1b5 service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:25.217198 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65ba69e-77b1-41e2-937f-5fc173abf1b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:25.217494 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65ba69e-77b1-41e2-937f-5fc173abf1b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:25.227254 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65ba69e-77b1-41e2-937f-5fc173abf1b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:25.228667 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65ba69e-77b1-41e2-937f-5fc173abf1b5 service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:25.238767 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1089/2137] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:38:25 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:38:25.643396 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c64099-d196-4788-a21b-0f3487525b2e None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:25.708403 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c64099-d196-4788-a21b-0f3487525b2e None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:25.713542 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd94a57-f57c-453a-ae57-f90db5cf6ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:25.714552 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd94a57-f57c-453a-ae57-f90db5cf6ad2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:25.714837 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd94a57-f57c-453a-ae57-f90db5cf6ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:25.715108 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd94a57-f57c-453a-ae57-f90db5cf6ad2 admin admin] PATH_INFO: `/v3/users/63fbcfdc052c4bfb9b38b073094e0a2c` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:25.716330 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd94a57-f57c-453a-ae57-f90db5cf6ad2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63fbcfdc052c4bfb9b38b073094e0a2c)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:25.718381 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd94a57-f57c-453a-ae57-f90db5cf6ad2 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:25.774508 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-5cd94a57-f57c-453a-ae57-f90db5cf6ad2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63fbcfdc052c4bfb9b38b073094e0a2c'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:25.780555 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:25.783789 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-5cd94a57-f57c-453a-ae57-f90db5cf6ad2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63fbcfdc052c4bfb9b38b073094e0a2c'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:25.785225 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-5cd94a57-f57c-453a-ae57-f90db5cf6ad2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63fbcfdc052c4bfb9b38b073094e0a2c'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:25.786437 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-5cd94a57-f57c-453a-ae57-f90db5cf6ad2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63fbcfdc052c4bfb9b38b073094e0a2c'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:25.801707 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-5cd94a57-f57c-453a-ae57-f90db5cf6ad2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63fbcfdc052c4bfb9b38b073094e0a2c'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:25.814952 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1049/2138] 10.222.0.118 () {58 vars in 1228 bytes} [Thu Jul 14 15:38:25 2022] DELETE /identity/v3/users/63fbcfdc052c4bfb9b38b073094e0a2c => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:38:25.819994 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43575ff-c69c-48fc-9672-1159b96a73d7 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:25.820613 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43575ff-c69c-48fc-9672-1159b96a73d7 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:25.820613 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43575ff-c69c-48fc-9672-1159b96a73d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:25.839278 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-f43575ff-c69c-48fc-9672-1159b96a73d7 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:38:25.843384 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-f43575ff-c69c-48fc-9672-1159b96a73d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:25.927486 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1090/2139] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:38:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:38:25.936197 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd94a57-f57c-453a-ae57-f90db5cf6ad2 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:25.937750 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-5cd94a57-f57c-453a-ae57-f90db5cf6ad2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:26.008824 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd94a57-f57c-453a-ae57-f90db5cf6ad2 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:26.013082 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00a5106-544a-4dfd-8e02-d1d7bb141e11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b650be8114b64df0ac88441f1c50b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:26.013745 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00a5106-544a-4dfd-8e02-d1d7bb141e11 service neutron] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:26.014058 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00a5106-544a-4dfd-8e02-d1d7bb141e11 service neutron] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:26.014337 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00a5106-544a-4dfd-8e02-d1d7bb141e11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:26.024892 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00a5106-544a-4dfd-8e02-d1d7bb141e11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:26.026512 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00a5106-544a-4dfd-8e02-d1d7bb141e11 service neutron] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:26.038583 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1050/2140] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:38:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:38:26.325516 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43575ff-c69c-48fc-9672-1159b96a73d7 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:26.327130 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-f43575ff-c69c-48fc-9672-1159b96a73d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:26.349283 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43575ff-c69c-48fc-9672-1159b96a73d7 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:26.356081 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c961127a-3ee5-4ad0-9460-7e7fc0ab0188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:26.356502 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c961127a-3ee5-4ad0-9460-7e7fc0ab0188 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:26.356896 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c961127a-3ee5-4ad0-9460-7e7fc0ab0188 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:26.357232 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c961127a-3ee5-4ad0-9460-7e7fc0ab0188 admin admin] PATH_INFO: `/v3/projects/66f5eceae2744240a0a14d45edc2c1f0` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:26.358629 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c961127a-3ee5-4ad0-9460-7e7fc0ab0188 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66f5eceae2744240a0a14d45edc2c1f0)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:26.360688 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c961127a-3ee5-4ad0-9460-7e7fc0ab0188 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:26.410833 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-c961127a-3ee5-4ad0-9460-7e7fc0ab0188 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66f5eceae2744240a0a14d45edc2c1f0', 'request_id': 'req-c961127a-3ee5-4ad0-9460-7e7fc0ab0188'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:26.417028 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-c961127a-3ee5-4ad0-9460-7e7fc0ab0188 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66f5eceae2744240a0a14d45edc2c1f0', 'request_id': 'req-c961127a-3ee5-4ad0-9460-7e7fc0ab0188'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:26.424150 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-c961127a-3ee5-4ad0-9460-7e7fc0ab0188 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66f5eceae2744240a0a14d45edc2c1f0', 'request_id': 'req-c961127a-3ee5-4ad0-9460-7e7fc0ab0188'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:26.438466 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-c961127a-3ee5-4ad0-9460-7e7fc0ab0188 admin admin] The token cache is being invalidate because project 66f5eceae2744240a0a14d45edc2c1f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:38:26.438917 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-c961127a-3ee5-4ad0-9460-7e7fc0ab0188 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:26.439638 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-c961127a-3ee5-4ad0-9460-7e7fc0ab0188 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:26.441322 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1091/2141] 10.222.0.118 () {58 vars in 1237 bytes} [Thu Jul 14 15:38:26 2022] DELETE /identity/v3/projects/66f5eceae2744240a0a14d45edc2c1f0 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:38:26.445683 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00a5106-544a-4dfd-8e02-d1d7bb141e11 service neutron] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:26.455435 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00a5106-544a-4dfd-8e02-d1d7bb141e11 service neutron] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:26.512124 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe302c28-03ab-41e6-be75-83bbf816ef9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:26.512909 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe302c28-03ab-41e6-be75-83bbf816ef9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:26.513190 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe302c28-03ab-41e6-be75-83bbf816ef9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:26.513469 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe302c28-03ab-41e6-be75-83bbf816ef9a admin admin] PATH_INFO: `/v3/users/a8c6d2c9d57c440fb69c285d948c1059` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:26.514674 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe302c28-03ab-41e6-be75-83bbf816ef9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8c6d2c9d57c440fb69c285d948c1059)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:26.516663 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe302c28-03ab-41e6-be75-83bbf816ef9a admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:26.560397 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-fe302c28-03ab-41e6-be75-83bbf816ef9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8c6d2c9d57c440fb69c285d948c1059'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:26.568009 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-fe302c28-03ab-41e6-be75-83bbf816ef9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8c6d2c9d57c440fb69c285d948c1059'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:26.568682 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-fe302c28-03ab-41e6-be75-83bbf816ef9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8c6d2c9d57c440fb69c285d948c1059'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:26.569282 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-fe302c28-03ab-41e6-be75-83bbf816ef9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8c6d2c9d57c440fb69c285d948c1059'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:26.581019 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-fe302c28-03ab-41e6-be75-83bbf816ef9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8c6d2c9d57c440fb69c285d948c1059'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:26.583571 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:26.595223 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1051/2142] 10.222.0.118 () {58 vars in 1228 bytes} [Thu Jul 14 15:38:26 2022] DELETE /identity/v3/users/a8c6d2c9d57c440fb69c285d948c1059 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:38:26.861882 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c961127a-3ee5-4ad0-9460-7e7fc0ab0188 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:26.863397 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-c961127a-3ee5-4ad0-9460-7e7fc0ab0188 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:26.878612 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c961127a-3ee5-4ad0-9460-7e7fc0ab0188 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:26.936517 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715895f3-33f7-4af9-8ead-41ab76875bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:26.937394 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715895f3-33f7-4af9-8ead-41ab76875bab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:26.937675 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715895f3-33f7-4af9-8ead-41ab76875bab admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:26.937947 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715895f3-33f7-4af9-8ead-41ab76875bab admin admin] PATH_INFO: `/v3/projects/b1f9bbd5639147eda4283e4b7657d323` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:26.939145 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715895f3-33f7-4af9-8ead-41ab76875bab admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1f9bbd5639147eda4283e4b7657d323)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:26.941043 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715895f3-33f7-4af9-8ead-41ab76875bab admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:26.957025 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:26.987994 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-715895f3-33f7-4af9-8ead-41ab76875bab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1f9bbd5639147eda4283e4b7657d323', 'request_id': 'req-715895f3-33f7-4af9-8ead-41ab76875bab'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:26.993742 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-715895f3-33f7-4af9-8ead-41ab76875bab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1f9bbd5639147eda4283e4b7657d323', 'request_id': 'req-715895f3-33f7-4af9-8ead-41ab76875bab'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:27.000224 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-715895f3-33f7-4af9-8ead-41ab76875bab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1f9bbd5639147eda4283e4b7657d323', 'request_id': 'req-715895f3-33f7-4af9-8ead-41ab76875bab'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:27.012190 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-715895f3-33f7-4af9-8ead-41ab76875bab admin admin] The token cache is being invalidate because project b1f9bbd5639147eda4283e4b7657d323 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:38:27.012473 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-715895f3-33f7-4af9-8ead-41ab76875bab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:27.013156 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-715895f3-33f7-4af9-8ead-41ab76875bab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:27.014748 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1092/2143] 10.222.0.118 () {58 vars in 1237 bytes} [Thu Jul 14 15:38:26 2022] DELETE /identity/v3/projects/b1f9bbd5639147eda4283e4b7657d323 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:38:27.020279 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc416f1-a5d9-445f-a1ee-55755d68bb50 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:27.020736 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc416f1-a5d9-445f-a1ee-55755d68bb50 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:27.020838 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc416f1-a5d9-445f-a1ee-55755d68bb50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:27.039325 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-bdc416f1-a5d9-445f-a1ee-55755d68bb50 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:38:27.040464 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-bdc416f1-a5d9-445f-a1ee-55755d68bb50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:27.101005 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1052/2144] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:38:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:38:27.109723 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bf58e6-1846-49d3-91cf-cbb1ab70cc76 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:27.110046 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bf58e6-1846-49d3-91cf-cbb1ab70cc76 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:27.110323 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bf58e6-1846-49d3-91cf-cbb1ab70cc76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:27.128474 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-d0bf58e6-1846-49d3-91cf-cbb1ab70cc76 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:38:27.129684 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-d0bf58e6-1846-49d3-91cf-cbb1ab70cc76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:27.137553 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1093/2145] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:38:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:38:27.142385 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc416f1-a5d9-445f-a1ee-55755d68bb50 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:27.152154 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc416f1-a5d9-445f-a1ee-55755d68bb50 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:27.157437 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c219d5-6320-4d50-b1b6-483be6fe6e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:27.158142 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c219d5-6320-4d50-b1b6-483be6fe6e38 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:27.158411 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c219d5-6320-4d50-b1b6-483be6fe6e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:27.158692 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c219d5-6320-4d50-b1b6-483be6fe6e38 admin admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:27.159442 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c219d5-6320-4d50-b1b6-483be6fe6e38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:38:27.159731 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c219d5-6320-4d50-b1b6-483be6fe6e38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:27.161370 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c219d5-6320-4d50-b1b6-483be6fe6e38 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:27.174525 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1053/2146] 10.222.0.118 () {58 vars in 1157 bytes} [Thu Jul 14 15:38:27 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:38:27.179249 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bf58e6-1846-49d3-91cf-cbb1ab70cc76 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:27.188903 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bf58e6-1846-49d3-91cf-cbb1ab70cc76 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:27.193693 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49f2434-508f-4d6e-9490-aeaa3b2ddcf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:27.194373 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f2434-508f-4d6e-9490-aeaa3b2ddcf2 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:27.194651 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f2434-508f-4d6e-9490-aeaa3b2ddcf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:27.194924 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f2434-508f-4d6e-9490-aeaa3b2ddcf2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:27.195618 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49f2434-508f-4d6e-9490-aeaa3b2ddcf2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:27.197512 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49f2434-508f-4d6e-9490-aeaa3b2ddcf2 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:27.224803 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1094/2147] 10.222.0.118 () {60 vars in 1157 bytes} [Thu Jul 14 15:38:27 2022] POST /identity/v3/projects => generated 356 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:38:27.228939 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c219d5-6320-4d50-b1b6-483be6fe6e38 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:27.239802 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c219d5-6320-4d50-b1b6-483be6fe6e38 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:27.306367 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27af7f4-4218-438a-9258-efcb11139ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:27.307052 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27af7f4-4218-438a-9258-efcb11139ff8 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:27.307634 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27af7f4-4218-438a-9258-efcb11139ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:27.307962 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27af7f4-4218-438a-9258-efcb11139ff8 admin admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:27.309023 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27af7f4-4218-438a-9258-efcb11139ff8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:27.311020 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27af7f4-4218-438a-9258-efcb11139ff8 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:27.332409 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1054/2148] 10.222.0.118 () {60 vars in 1148 bytes} [Thu Jul 14 15:38:27 2022] POST /identity/v3/users => generated 279 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:38:27.336443 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49f2434-508f-4d6e-9490-aeaa3b2ddcf2 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:27.348130 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49f2434-508f-4d6e-9490-aeaa3b2ddcf2 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:27.352775 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1484757f-bc92-4955-9df8-854375ae18a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:27.353430 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1484757f-bc92-4955-9df8-854375ae18a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:27.353705 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1484757f-bc92-4955-9df8-854375ae18a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:27.353987 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1484757f-bc92-4955-9df8-854375ae18a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:27.354796 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1484757f-bc92-4955-9df8-854375ae18a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:27.356417 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1484757f-bc92-4955-9df8-854375ae18a7 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:27.366782 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1095/2149] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:38:27 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:38:27.370705 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27af7f4-4218-438a-9258-efcb11139ff8 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:27.381528 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27af7f4-4218-438a-9258-efcb11139ff8 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:27.386140 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b1303f-d7fd-464e-ac94-560c175f7c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:27.386804 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b1303f-d7fd-464e-ac94-560c175f7c47 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:27.387082 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b1303f-d7fd-464e-ac94-560c175f7c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:27.387357 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b1303f-d7fd-464e-ac94-560c175f7c47 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:27.388081 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b1303f-d7fd-464e-ac94-560c175f7c47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:27.389682 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b1303f-d7fd-464e-ac94-560c175f7c47 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:27.401098 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1055/2150] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:38:27 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:38:27.405353 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1484757f-bc92-4955-9df8-854375ae18a7 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:27.415565 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1484757f-bc92-4955-9df8-854375ae18a7 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:27.420326 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4a9725-fde1-412a-b1ab-8ee89b407bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:27.421203 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4a9725-fde1-412a-b1ab-8ee89b407bc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:27.421485 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4a9725-fde1-412a-b1ab-8ee89b407bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:27.421792 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4a9725-fde1-412a-b1ab-8ee89b407bc7 admin admin] PATH_INFO: `/v3/projects/3040e53ce77b4c49b96ff1828aa2ada3/users/8c9ed5323cf1407c9093193f6be70ce4/roles/4abcf5e5e7cd4b53ae1828fec6550d53` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:27.436260 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4a9725-fde1-412a-b1ab-8ee89b407bc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3040e53ce77b4c49b96ff1828aa2ada3, user_id=8c9ed5323cf1407c9093193f6be70ce4, role_id=4abcf5e5e7cd4b53ae1828fec6550d53)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:27.439496 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4a9725-fde1-412a-b1ab-8ee89b407bc7 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:27.452270 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1096/2151] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:38:27 2022] PUT /identity/v3/projects/3040e53ce77b4c49b96ff1828aa2ada3/users/8c9ed5323cf1407c9093193f6be70ce4/roles/4abcf5e5e7cd4b53ae1828fec6550d53 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:38:27.463267 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5313f9c-4e73-4af1-afa5-7bd2bd0e0ea9 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:27.463579 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5313f9c-4e73-4af1-afa5-7bd2bd0e0ea9 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:27.463858 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5313f9c-4e73-4af1-afa5-7bd2bd0e0ea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:27.493173 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-e5313f9c-4e73-4af1-afa5-7bd2bd0e0ea9 None None] MFA Rules not processed for user `8c9ed5323cf1407c9093193f6be70ce4`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:38:27.494529 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-e5313f9c-4e73-4af1-afa5-7bd2bd0e0ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:27.546227 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:27.568091 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1056/2152] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:38:27 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:38:27.572658 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4a9725-fde1-412a-b1ab-8ee89b407bc7 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:27.638360 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4a9725-fde1-412a-b1ab-8ee89b407bc7 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:27.643795 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b443e97d-693d-42de-b5cd-a1b3eb65f8ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:27.644475 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b443e97d-693d-42de-b5cd-a1b3eb65f8ba admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:27.644755 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b443e97d-693d-42de-b5cd-a1b3eb65f8ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:27.645028 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b443e97d-693d-42de-b5cd-a1b3eb65f8ba admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:27.645746 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b443e97d-693d-42de-b5cd-a1b3eb65f8ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:27.647772 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b443e97d-693d-42de-b5cd-a1b3eb65f8ba admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:27.675582 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1097/2153] 10.222.0.118 () {60 vars in 1157 bytes} [Thu Jul 14 15:38:27 2022] POST /identity/v3/projects => generated 356 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:38:27.679784 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5313f9c-4e73-4af1-afa5-7bd2bd0e0ea9 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:27.691989 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5313f9c-4e73-4af1-afa5-7bd2bd0e0ea9 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:27.753496 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebf519d-0378-40d7-a742-9570169bd9b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:27.754232 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebf519d-0378-40d7-a742-9570169bd9b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:27.754512 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebf519d-0378-40d7-a742-9570169bd9b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:27.754781 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebf519d-0378-40d7-a742-9570169bd9b9 admin admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:27.755521 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebf519d-0378-40d7-a742-9570169bd9b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:27.757488 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebf519d-0378-40d7-a742-9570169bd9b9 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:27.779939 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1057/2154] 10.222.0.118 () {60 vars in 1148 bytes} [Thu Jul 14 15:38:27 2022] POST /identity/v3/users => generated 285 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:38:27.783502 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b443e97d-693d-42de-b5cd-a1b3eb65f8ba admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:27.794418 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b443e97d-693d-42de-b5cd-a1b3eb65f8ba admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:27.799717 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079bf435-b582-4493-873d-1952ca707287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:27.800317 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079bf435-b582-4493-873d-1952ca707287 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:27.800591 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079bf435-b582-4493-873d-1952ca707287 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:27.800862 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079bf435-b582-4493-873d-1952ca707287 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:27.801586 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079bf435-b582-4493-873d-1952ca707287 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:27.803213 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079bf435-b582-4493-873d-1952ca707287 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:27.815730 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1098/2155] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:38:27 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:38:27.820012 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebf519d-0378-40d7-a742-9570169bd9b9 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:27.829884 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebf519d-0378-40d7-a742-9570169bd9b9 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:27.834496 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7bf4bd-ad91-43e8-91bc-338152e17c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:27.835372 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7bf4bd-ad91-43e8-91bc-338152e17c53 admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:27.835648 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7bf4bd-ad91-43e8-91bc-338152e17c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:27.835920 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7bf4bd-ad91-43e8-91bc-338152e17c53 admin admin] PATH_INFO: `/v3/projects/36fe9affd5954c8ba7418315aa10bee3/users/cbd21d4a408342bd85fa056712d17df2/roles/3b880cef7dcf4baf87b50f8610c0c56e` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:27.850728 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7bf4bd-ad91-43e8-91bc-338152e17c53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36fe9affd5954c8ba7418315aa10bee3, user_id=cbd21d4a408342bd85fa056712d17df2, role_id=3b880cef7dcf4baf87b50f8610c0c56e)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:27.853480 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7bf4bd-ad91-43e8-91bc-338152e17c53 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:27.866711 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1058/2156] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:38:27 2022] PUT /identity/v3/projects/36fe9affd5954c8ba7418315aa10bee3/users/cbd21d4a408342bd85fa056712d17df2/roles/3b880cef7dcf4baf87b50f8610c0c56e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:38:27.870865 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079bf435-b582-4493-873d-1952ca707287 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:27.881911 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079bf435-b582-4493-873d-1952ca707287 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:27.891118 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:27.940935 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c768398-6350-4798-ad75-92773e29274e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:27.941600 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c768398-6350-4798-ad75-92773e29274e admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:27.941878 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c768398-6350-4798-ad75-92773e29274e admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:27.942174 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c768398-6350-4798-ad75-92773e29274e admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:27.942897 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c768398-6350-4798-ad75-92773e29274e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:27.944482 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c768398-6350-4798-ad75-92773e29274e admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:27.954090 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1099/2157] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:38:27 2022] GET /identity/v3/roles => generated 1427 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:38:27.958384 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7bf4bd-ad91-43e8-91bc-338152e17c53 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:27.968632 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7bf4bd-ad91-43e8-91bc-338152e17c53 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:27.973145 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5fcf94-2fa6-4889-88ad-e8c2b2ead864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:27.974044 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5fcf94-2fa6-4889-88ad-e8c2b2ead864 admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:27.974318 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5fcf94-2fa6-4889-88ad-e8c2b2ead864 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:27.974585 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5fcf94-2fa6-4889-88ad-e8c2b2ead864 admin admin] PATH_INFO: `/v3/projects/36fe9affd5954c8ba7418315aa10bee3/users/cbd21d4a408342bd85fa056712d17df2/roles/3b880cef7dcf4baf87b50f8610c0c56e` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:27.976510 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5fcf94-2fa6-4889-88ad-e8c2b2ead864 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36fe9affd5954c8ba7418315aa10bee3, user_id=cbd21d4a408342bd85fa056712d17df2, role_id=3b880cef7dcf4baf87b50f8610c0c56e)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:27.979172 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5fcf94-2fa6-4889-88ad-e8c2b2ead864 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:27.989703 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1059/2158] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:38:27 2022] PUT /identity/v3/projects/36fe9affd5954c8ba7418315aa10bee3/users/cbd21d4a408342bd85fa056712d17df2/roles/3b880cef7dcf4baf87b50f8610c0c56e => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:38:28.001036 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77cd47b-6a90-4641-9bb7-488e23ba37f5 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:28.001322 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77cd47b-6a90-4641-9bb7-488e23ba37f5 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:28.001625 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77cd47b-6a90-4641-9bb7-488e23ba37f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:28.029253 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-a77cd47b-6a90-4641-9bb7-488e23ba37f5 None None] MFA Rules not processed for user `cbd21d4a408342bd85fa056712d17df2`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:38:28.030563 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-a77cd47b-6a90-4641-9bb7-488e23ba37f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:28.098686 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1100/2159] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:38:27 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:38:28.110234 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5fcf94-2fa6-4889-88ad-e8c2b2ead864 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:28.112120 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-1c5fcf94-2fa6-4889-88ad-e8c2b2ead864 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:28.169388 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5fcf94-2fa6-4889-88ad-e8c2b2ead864 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:28.174322 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef07500b-8a43-487a-b394-e33ab2cb5b3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea647438ea1c438987f28cbe39c3ff2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:28.174980 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef07500b-8a43-487a-b394-e33ab2cb5b3b service cinder] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:28.175265 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef07500b-8a43-487a-b394-e33ab2cb5b3b service cinder] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:28.175545 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef07500b-8a43-487a-b394-e33ab2cb5b3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:28.185323 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef07500b-8a43-487a-b394-e33ab2cb5b3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:28.186797 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef07500b-8a43-487a-b394-e33ab2cb5b3b service cinder] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:28.196820 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1060/2160] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:38:28 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:38:28.274250 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77cd47b-6a90-4641-9bb7-488e23ba37f5 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:28.284287 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77cd47b-6a90-4641-9bb7-488e23ba37f5 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:28.287883 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111a61f8-a4b1-4bd9-8113-ca8dbbe2ab76 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea647438ea1c438987f28cbe39c3ff2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:28.288522 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111a61f8-a4b1-4bd9-8113-ca8dbbe2ab76 service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:28.288796 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111a61f8-a4b1-4bd9-8113-ca8dbbe2ab76 service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:28.289066 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111a61f8-a4b1-4bd9-8113-ca8dbbe2ab76 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:28.349022 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111a61f8-a4b1-4bd9-8113-ca8dbbe2ab76 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:28.350782 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111a61f8-a4b1-4bd9-8113-ca8dbbe2ab76 service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:28.361434 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1101/2161] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:38:28 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:38:31.451193 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d58f025-b6b5-4226-b00e-6adea2ddafce None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:31.451655 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d58f025-b6b5-4226-b00e-6adea2ddafce None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:31.451742 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d58f025-b6b5-4226-b00e-6adea2ddafce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:31.471371 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-7d58f025-b6b5-4226-b00e-6adea2ddafce None None] MFA Rules not processed for user `f7ad5ae70939416e8157693e02997a58`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:38:31.473271 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-7d58f025-b6b5-4226-b00e-6adea2ddafce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:31.519361 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:31.536796 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1061/2162] 10.222.0.118 () {58 vars in 1014 bytes} [Thu Jul 14 15:38:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:38:31.583823 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111a61f8-a4b1-4bd9-8113-ca8dbbe2ab76 service cinder] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:31.586015 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-111a61f8-a4b1-4bd9-8113-ca8dbbe2ab76 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:31.623739 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:31.664567 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111a61f8-a4b1-4bd9-8113-ca8dbbe2ab76 service cinder] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:31.669412 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547e5925-6832-403b-b832-8423f5b252fa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b672a6a601584d2d826147069e90a10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:31.670081 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547e5925-6832-403b-b832-8423f5b252fa service swift] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:31.670359 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547e5925-6832-403b-b832-8423f5b252fa service swift] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:31.670626 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547e5925-6832-403b-b832-8423f5b252fa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:31.678597 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547e5925-6832-403b-b832-8423f5b252fa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:31.680167 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547e5925-6832-403b-b832-8423f5b252fa service swift] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:31.688451 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1102/2163] 10.222.0.118 () {60 vars in 1389 bytes} [Thu Jul 14 15:38:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 14 15:38:41.528841 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=5 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:41.684975 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=17 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:43.913556 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d58f025-b6b5-4226-b00e-6adea2ddafce None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:43.999896 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d58f025-b6b5-4226-b00e-6adea2ddafce None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:44.004499 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b3703d-aec4-4212-831b-e40a378904ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:44.005388 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b3703d-aec4-4212-831b-e40a378904ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:44.005993 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b3703d-aec4-4212-831b-e40a378904ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:44.005993 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b3703d-aec4-4212-831b-e40a378904ae admin admin] PATH_INFO: `/v3/users/8c9ed5323cf1407c9093193f6be70ce4` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:44.007164 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b3703d-aec4-4212-831b-e40a378904ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c9ed5323cf1407c9093193f6be70ce4)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:44.009114 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b3703d-aec4-4212-831b-e40a378904ae admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:44.076642 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-b5b3703d-aec4-4212-831b-e40a378904ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c9ed5323cf1407c9093193f6be70ce4'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:44.092070 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-b5b3703d-aec4-4212-831b-e40a378904ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c9ed5323cf1407c9093193f6be70ce4'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:44.093649 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-b5b3703d-aec4-4212-831b-e40a378904ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c9ed5323cf1407c9093193f6be70ce4'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:44.093934 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-b5b3703d-aec4-4212-831b-e40a378904ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c9ed5323cf1407c9093193f6be70ce4'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:44.115861 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-b5b3703d-aec4-4212-831b-e40a378904ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c9ed5323cf1407c9093193f6be70ce4'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:44.132603 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1062/2164] 10.222.0.118 () {58 vars in 1228 bytes} [Thu Jul 14 15:38:43 2022] DELETE /identity/v3/users/8c9ed5323cf1407c9093193f6be70ce4 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:38:44.137227 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a573e-485c-40e6-93b5-05c3646e752d None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:44.137784 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a573e-485c-40e6-93b5-05c3646e752d None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:44.137784 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a573e-485c-40e6-93b5-05c3646e752d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:44.157732 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-006a573e-485c-40e6-93b5-05c3646e752d None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:38:44.159176 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-006a573e-485c-40e6-93b5-05c3646e752d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:44.227881 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1103/2165] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:38:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:38:44.240095 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b3703d-aec4-4212-831b-e40a378904ae admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:44.241599 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-b5b3703d-aec4-4212-831b-e40a378904ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:44.316695 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b3703d-aec4-4212-831b-e40a378904ae admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:44.320452 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee2294b-7f7c-4a22-a989-d4bb3e423561 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b650be8114b64df0ac88441f1c50b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:44.321178 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee2294b-7f7c-4a22-a989-d4bb3e423561 service neutron] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:44.321526 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee2294b-7f7c-4a22-a989-d4bb3e423561 service neutron] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:44.321861 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee2294b-7f7c-4a22-a989-d4bb3e423561 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:44.333201 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee2294b-7f7c-4a22-a989-d4bb3e423561 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:44.334660 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee2294b-7f7c-4a22-a989-d4bb3e423561 service neutron] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:44.345460 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1063/2166] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:38:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:38:44.656759 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006a573e-485c-40e6-93b5-05c3646e752d None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:44.658820 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-006a573e-485c-40e6-93b5-05c3646e752d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:44.676025 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006a573e-485c-40e6-93b5-05c3646e752d None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:44.682085 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c895630-ac34-4f39-89d0-106e65b16011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:44.683120 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c895630-ac34-4f39-89d0-106e65b16011 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:44.683398 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c895630-ac34-4f39-89d0-106e65b16011 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:44.683675 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c895630-ac34-4f39-89d0-106e65b16011 admin admin] PATH_INFO: `/v3/projects/3040e53ce77b4c49b96ff1828aa2ada3` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:44.684949 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c895630-ac34-4f39-89d0-106e65b16011 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3040e53ce77b4c49b96ff1828aa2ada3)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:44.687661 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c895630-ac34-4f39-89d0-106e65b16011 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:44.761846 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-9c895630-ac34-4f39-89d0-106e65b16011 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3040e53ce77b4c49b96ff1828aa2ada3', 'request_id': 'req-9c895630-ac34-4f39-89d0-106e65b16011'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:44.768024 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-9c895630-ac34-4f39-89d0-106e65b16011 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3040e53ce77b4c49b96ff1828aa2ada3', 'request_id': 'req-9c895630-ac34-4f39-89d0-106e65b16011'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:44.777246 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-9c895630-ac34-4f39-89d0-106e65b16011 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3040e53ce77b4c49b96ff1828aa2ada3', 'request_id': 'req-9c895630-ac34-4f39-89d0-106e65b16011'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:44.797983 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-9c895630-ac34-4f39-89d0-106e65b16011 admin admin] The token cache is being invalidate because project 3040e53ce77b4c49b96ff1828aa2ada3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:38:44.798274 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-9c895630-ac34-4f39-89d0-106e65b16011 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:44.798920 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-9c895630-ac34-4f39-89d0-106e65b16011 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:44.800481 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1104/2167] 10.222.0.118 () {58 vars in 1237 bytes} [Thu Jul 14 15:38:44 2022] DELETE /identity/v3/projects/3040e53ce77b4c49b96ff1828aa2ada3 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:38:44.804639 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee2294b-7f7c-4a22-a989-d4bb3e423561 service neutron] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:44.821549 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee2294b-7f7c-4a22-a989-d4bb3e423561 service neutron] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:44.844068 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:44.898057 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c16e385-7e37-4bd2-adb5-90c880a5f1d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:44.899004 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c16e385-7e37-4bd2-adb5-90c880a5f1d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:44.899332 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c16e385-7e37-4bd2-adb5-90c880a5f1d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:44.899616 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c16e385-7e37-4bd2-adb5-90c880a5f1d6 admin admin] PATH_INFO: `/v3/users/cbd21d4a408342bd85fa056712d17df2` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:44.900862 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c16e385-7e37-4bd2-adb5-90c880a5f1d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbd21d4a408342bd85fa056712d17df2)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:44.902910 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c16e385-7e37-4bd2-adb5-90c880a5f1d6 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:44.972793 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-1c16e385-7e37-4bd2-adb5-90c880a5f1d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbd21d4a408342bd85fa056712d17df2'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:44.982564 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-1c16e385-7e37-4bd2-adb5-90c880a5f1d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbd21d4a408342bd85fa056712d17df2'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:44.984398 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-1c16e385-7e37-4bd2-adb5-90c880a5f1d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbd21d4a408342bd85fa056712d17df2'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:44.985125 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-1c16e385-7e37-4bd2-adb5-90c880a5f1d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbd21d4a408342bd85fa056712d17df2'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:45.001376 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-1c16e385-7e37-4bd2-adb5-90c880a5f1d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbd21d4a408342bd85fa056712d17df2'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:45.016740 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1064/2168] 10.222.0.118 () {58 vars in 1228 bytes} [Thu Jul 14 15:38:44 2022] DELETE /identity/v3/users/cbd21d4a408342bd85fa056712d17df2 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:38:45.394286 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c895630-ac34-4f39-89d0-106e65b16011 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:45.397001 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-9c895630-ac34-4f39-89d0-106e65b16011 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:45.422476 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c895630-ac34-4f39-89d0-106e65b16011 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:45.486791 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f12cee-439e-4ecc-8616-157d4b1e90ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:45.487727 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f12cee-439e-4ecc-8616-157d4b1e90ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:45.488006 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f12cee-439e-4ecc-8616-157d4b1e90ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:45.488280 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f12cee-439e-4ecc-8616-157d4b1e90ff admin admin] PATH_INFO: `/v3/projects/36fe9affd5954c8ba7418315aa10bee3` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:45.489504 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f12cee-439e-4ecc-8616-157d4b1e90ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=36fe9affd5954c8ba7418315aa10bee3)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:45.491442 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f12cee-439e-4ecc-8616-157d4b1e90ff admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:45.527607 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:45.549727 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-09f12cee-439e-4ecc-8616-157d4b1e90ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36fe9affd5954c8ba7418315aa10bee3', 'request_id': 'req-09f12cee-439e-4ecc-8616-157d4b1e90ff'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:45.555776 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-09f12cee-439e-4ecc-8616-157d4b1e90ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36fe9affd5954c8ba7418315aa10bee3', 'request_id': 'req-09f12cee-439e-4ecc-8616-157d4b1e90ff'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:45.562509 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-09f12cee-439e-4ecc-8616-157d4b1e90ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36fe9affd5954c8ba7418315aa10bee3', 'request_id': 'req-09f12cee-439e-4ecc-8616-157d4b1e90ff'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:45.580687 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-09f12cee-439e-4ecc-8616-157d4b1e90ff admin admin] The token cache is being invalidate because project 36fe9affd5954c8ba7418315aa10bee3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:38:45.581118 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-09f12cee-439e-4ecc-8616-157d4b1e90ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:45.581999 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-09f12cee-439e-4ecc-8616-157d4b1e90ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:45.583758 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1105/2169] 10.222.0.118 () {58 vars in 1237 bytes} [Thu Jul 14 15:38:45 2022] DELETE /identity/v3/projects/36fe9affd5954c8ba7418315aa10bee3 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:38:45.588691 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58fe25d-377d-4fc2-ba54-330a2a9c11ad None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:45.589071 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58fe25d-377d-4fc2-ba54-330a2a9c11ad None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:45.589416 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58fe25d-377d-4fc2-ba54-330a2a9c11ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:45.608802 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-d58fe25d-377d-4fc2-ba54-330a2a9c11ad None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:38:45.610141 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-d58fe25d-377d-4fc2-ba54-330a2a9c11ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:45.682520 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1065/2170] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:38:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:38:45.687607 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30abfc08-5931-4e4b-a39c-59b4be5a78ef None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:45.687607 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30abfc08-5931-4e4b-a39c-59b4be5a78ef None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:45.687920 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30abfc08-5931-4e4b-a39c-59b4be5a78ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:45.714728 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-30abfc08-5931-4e4b-a39c-59b4be5a78ef None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:38:45.715963 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-30abfc08-5931-4e4b-a39c-59b4be5a78ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:45.729746 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1106/2171] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:38:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:38:45.734637 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58fe25d-377d-4fc2-ba54-330a2a9c11ad None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:45.745320 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58fe25d-377d-4fc2-ba54-330a2a9c11ad None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:45.751275 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d639737e-f0cc-44fa-8c36-ec008c971c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:45.751972 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d639737e-f0cc-44fa-8c36-ec008c971c49 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:45.752265 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d639737e-f0cc-44fa-8c36-ec008c971c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:45.752481 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d639737e-f0cc-44fa-8c36-ec008c971c49 admin admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:45.753213 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d639737e-f0cc-44fa-8c36-ec008c971c49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:38:45.753513 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d639737e-f0cc-44fa-8c36-ec008c971c49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:45.755249 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d639737e-f0cc-44fa-8c36-ec008c971c49 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:45.774230 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1066/2172] 10.222.0.118 () {58 vars in 1157 bytes} [Thu Jul 14 15:38:45 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:38:45.774733 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30abfc08-5931-4e4b-a39c-59b4be5a78ef None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:45.785998 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30abfc08-5931-4e4b-a39c-59b4be5a78ef None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:45.790850 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c05060-3ddd-4ef9-a41a-81e32d837b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:45.791608 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c05060-3ddd-4ef9-a41a-81e32d837b0f admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:45.791908 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c05060-3ddd-4ef9-a41a-81e32d837b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:45.792160 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c05060-3ddd-4ef9-a41a-81e32d837b0f admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:45.792906 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c05060-3ddd-4ef9-a41a-81e32d837b0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:45.794930 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c05060-3ddd-4ef9-a41a-81e32d837b0f admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:45.823263 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1107/2173] 10.222.0.118 () {60 vars in 1157 bytes} [Thu Jul 14 15:38:45 2022] POST /identity/v3/projects => generated 378 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:38:45.827657 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d639737e-f0cc-44fa-8c36-ec008c971c49 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:45.842247 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d639737e-f0cc-44fa-8c36-ec008c971c49 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:45.873011 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:45.907913 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47b91a3-ff89-49eb-9c00-b1a466eb6980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:45.908592 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47b91a3-ff89-49eb-9c00-b1a466eb6980 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:45.908990 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47b91a3-ff89-49eb-9c00-b1a466eb6980 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:45.909272 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47b91a3-ff89-49eb-9c00-b1a466eb6980 admin admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:45.909982 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47b91a3-ff89-49eb-9c00-b1a466eb6980 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:45.911991 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47b91a3-ff89-49eb-9c00-b1a466eb6980 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:45.936859 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1067/2174] 10.222.0.118 () {60 vars in 1148 bytes} [Thu Jul 14 15:38:45 2022] POST /identity/v3/users => generated 290 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:38:45.938135 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c05060-3ddd-4ef9-a41a-81e32d837b0f admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:45.948921 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c05060-3ddd-4ef9-a41a-81e32d837b0f admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:45.955241 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e53197-5fdf-458a-8ebd-fd68f7c83744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:45.955912 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e53197-5fdf-458a-8ebd-fd68f7c83744 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:45.956213 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e53197-5fdf-458a-8ebd-fd68f7c83744 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:45.956484 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e53197-5fdf-458a-8ebd-fd68f7c83744 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:45.957211 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e53197-5fdf-458a-8ebd-fd68f7c83744 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:45.958848 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e53197-5fdf-458a-8ebd-fd68f7c83744 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:45.970667 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1108/2175] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:38:45 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:38:45.974734 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47b91a3-ff89-49eb-9c00-b1a466eb6980 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:45.985908 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47b91a3-ff89-49eb-9c00-b1a466eb6980 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:45.991973 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f765873-ac11-4731-b854-3674ba7baa10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:45.992656 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f765873-ac11-4731-b854-3674ba7baa10 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:45.992924 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f765873-ac11-4731-b854-3674ba7baa10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:45.993195 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f765873-ac11-4731-b854-3674ba7baa10 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:45.993928 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f765873-ac11-4731-b854-3674ba7baa10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:45.995618 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f765873-ac11-4731-b854-3674ba7baa10 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:46.007286 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1068/2176] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:38:45 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:38:46.011412 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e53197-5fdf-458a-8ebd-fd68f7c83744 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:46.023138 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e53197-5fdf-458a-8ebd-fd68f7c83744 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:46.028230 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03673ab-5c41-4dff-a8ea-059fd268b6cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:46.029223 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03673ab-5c41-4dff-a8ea-059fd268b6cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:46.029574 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03673ab-5c41-4dff-a8ea-059fd268b6cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:46.029942 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03673ab-5c41-4dff-a8ea-059fd268b6cd admin admin] PATH_INFO: `/v3/projects/14d6f8f81c9047dc96e45b7d47ecdae3/users/cf4b4df6e24b4192a61284cca083b861/roles/4abcf5e5e7cd4b53ae1828fec6550d53` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:46.046963 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03673ab-5c41-4dff-a8ea-059fd268b6cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=14d6f8f81c9047dc96e45b7d47ecdae3, user_id=cf4b4df6e24b4192a61284cca083b861, role_id=4abcf5e5e7cd4b53ae1828fec6550d53)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:46.049735 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03673ab-5c41-4dff-a8ea-059fd268b6cd admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:46.064683 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1109/2177] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:38:46 2022] PUT /identity/v3/projects/14d6f8f81c9047dc96e45b7d47ecdae3/users/cf4b4df6e24b4192a61284cca083b861/roles/4abcf5e5e7cd4b53ae1828fec6550d53 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:38:46.075032 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a9bd00-8786-4fb3-a545-8b0f5679a322 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:46.075322 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a9bd00-8786-4fb3-a545-8b0f5679a322 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:46.075601 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a9bd00-8786-4fb3-a545-8b0f5679a322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:46.105017 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-36a9bd00-8786-4fb3-a545-8b0f5679a322 None None] MFA Rules not processed for user `cf4b4df6e24b4192a61284cca083b861`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:38:46.106426 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-36a9bd00-8786-4fb3-a545-8b0f5679a322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:46.182765 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1069/2178] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:38:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:38:46.188235 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03673ab-5c41-4dff-a8ea-059fd268b6cd admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:46.260911 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03673ab-5c41-4dff-a8ea-059fd268b6cd admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:46.266638 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd706ff1-e32a-49e0-b086-b70cdcd18520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:46.267424 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd706ff1-e32a-49e0-b086-b70cdcd18520 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:46.267710 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd706ff1-e32a-49e0-b086-b70cdcd18520 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:46.267980 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd706ff1-e32a-49e0-b086-b70cdcd18520 admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:46.268681 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd706ff1-e32a-49e0-b086-b70cdcd18520 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:46.270652 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd706ff1-e32a-49e0-b086-b70cdcd18520 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:46.302147 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1110/2179] 10.222.0.118 () {60 vars in 1157 bytes} [Thu Jul 14 15:38:46 2022] POST /identity/v3/projects => generated 378 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:38:46.305448 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a9bd00-8786-4fb3-a545-8b0f5679a322 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:46.317694 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a9bd00-8786-4fb3-a545-8b0f5679a322 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:46.384335 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be065907-7df7-4500-ba26-d549c3ae69f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:46.385009 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be065907-7df7-4500-ba26-d549c3ae69f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:46.385433 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be065907-7df7-4500-ba26-d549c3ae69f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:46.385716 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be065907-7df7-4500-ba26-d549c3ae69f4 admin admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:46.386450 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be065907-7df7-4500-ba26-d549c3ae69f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:46.388607 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be065907-7df7-4500-ba26-d549c3ae69f4 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:46.442894 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1070/2180] 10.222.0.118 () {60 vars in 1148 bytes} [Thu Jul 14 15:38:46 2022] POST /identity/v3/users => generated 296 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:38:46.444958 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd706ff1-e32a-49e0-b086-b70cdcd18520 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:46.460445 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd706ff1-e32a-49e0-b086-b70cdcd18520 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:46.466761 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab86446a-035f-4389-b2c5-a92de2a072d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:46.469566 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab86446a-035f-4389-b2c5-a92de2a072d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:46.470266 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab86446a-035f-4389-b2c5-a92de2a072d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:46.470551 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab86446a-035f-4389-b2c5-a92de2a072d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:46.472095 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab86446a-035f-4389-b2c5-a92de2a072d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:46.475371 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab86446a-035f-4389-b2c5-a92de2a072d0 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:46.501440 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1111/2181] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:38:46 2022] GET /identity/v3/roles => generated 1427 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:38:46.503057 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be065907-7df7-4500-ba26-d549c3ae69f4 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:46.523782 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be065907-7df7-4500-ba26-d549c3ae69f4 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:46.539176 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f221d4cc-196b-4bbb-a8a5-2172061ce4f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:46.540439 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f221d4cc-196b-4bbb-a8a5-2172061ce4f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:46.540846 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f221d4cc-196b-4bbb-a8a5-2172061ce4f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:46.541895 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f221d4cc-196b-4bbb-a8a5-2172061ce4f4 admin admin] PATH_INFO: `/v3/projects/837d69b3091149e29c00c8c3dcabefb0/users/cb52fe6206844b0aa1a49953da090f91/roles/3b880cef7dcf4baf87b50f8610c0c56e` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:46.562763 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f221d4cc-196b-4bbb-a8a5-2172061ce4f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=837d69b3091149e29c00c8c3dcabefb0, user_id=cb52fe6206844b0aa1a49953da090f91, role_id=3b880cef7dcf4baf87b50f8610c0c56e)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:46.565563 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f221d4cc-196b-4bbb-a8a5-2172061ce4f4 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:46.586387 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1071/2182] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:38:46 2022] PUT /identity/v3/projects/837d69b3091149e29c00c8c3dcabefb0/users/cb52fe6206844b0aa1a49953da090f91/roles/3b880cef7dcf4baf87b50f8610c0c56e => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:38:46.591450 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab86446a-035f-4389-b2c5-a92de2a072d0 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:46.607345 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab86446a-035f-4389-b2c5-a92de2a072d0 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:46.636680 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:46.683074 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12e1b87-4ff7-4a62-b3b8-747874840c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:46.683805 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12e1b87-4ff7-4a62-b3b8-747874840c6c admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:46.684149 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12e1b87-4ff7-4a62-b3b8-747874840c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:46.684358 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12e1b87-4ff7-4a62-b3b8-747874840c6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:46.685097 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12e1b87-4ff7-4a62-b3b8-747874840c6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:46.686969 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12e1b87-4ff7-4a62-b3b8-747874840c6c admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:46.698385 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1112/2183] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:38:46 2022] GET /identity/v3/roles => generated 1427 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:38:46.703211 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f221d4cc-196b-4bbb-a8a5-2172061ce4f4 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:46.714155 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:46.726928 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f221d4cc-196b-4bbb-a8a5-2172061ce4f4 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:46.733424 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5d2899-4290-4c07-9017-2632d1f876ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:46.734382 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5d2899-4290-4c07-9017-2632d1f876ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:46.734661 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5d2899-4290-4c07-9017-2632d1f876ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:46.734938 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5d2899-4290-4c07-9017-2632d1f876ff admin admin] PATH_INFO: `/v3/projects/837d69b3091149e29c00c8c3dcabefb0/users/cb52fe6206844b0aa1a49953da090f91/roles/3b880cef7dcf4baf87b50f8610c0c56e` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:46.737522 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5d2899-4290-4c07-9017-2632d1f876ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=837d69b3091149e29c00c8c3dcabefb0, user_id=cb52fe6206844b0aa1a49953da090f91, role_id=3b880cef7dcf4baf87b50f8610c0c56e)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:46.740452 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5d2899-4290-4c07-9017-2632d1f876ff admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:46.753138 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1072/2184] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:38:46 2022] PUT /identity/v3/projects/837d69b3091149e29c00c8c3dcabefb0/users/cb52fe6206844b0aa1a49953da090f91/roles/3b880cef7dcf4baf87b50f8610c0c56e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:38:46.765515 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c189f0-2c3d-4a29-bf41-8042b6e58f2f None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:46.765799 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c189f0-2c3d-4a29-bf41-8042b6e58f2f None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:46.766111 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c189f0-2c3d-4a29-bf41-8042b6e58f2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:46.825774 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-f8c189f0-2c3d-4a29-bf41-8042b6e58f2f None None] MFA Rules not processed for user `cb52fe6206844b0aa1a49953da090f91`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:38:46.827973 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-f8c189f0-2c3d-4a29-bf41-8042b6e58f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:46.938950 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1113/2185] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:38:46 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:38:46.950894 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5d2899-4290-4c07-9017-2632d1f876ff admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:46.955918 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-3a5d2899-4290-4c07-9017-2632d1f876ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:47.034130 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5d2899-4290-4c07-9017-2632d1f876ff admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:47.040457 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88369462-7d6c-4a8a-82dc-1869fb723460 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea647438ea1c438987f28cbe39c3ff2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:47.041068 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88369462-7d6c-4a8a-82dc-1869fb723460 service cinder] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:47.041335 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88369462-7d6c-4a8a-82dc-1869fb723460 service cinder] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:47.041611 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88369462-7d6c-4a8a-82dc-1869fb723460 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:47.122335 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88369462-7d6c-4a8a-82dc-1869fb723460 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:47.124795 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88369462-7d6c-4a8a-82dc-1869fb723460 service cinder] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:47.146059 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1073/2186] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:38:46 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:38:48.575039 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c189f0-2c3d-4a29-bf41-8042b6e58f2f None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:48.584820 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c189f0-2c3d-4a29-bf41-8042b6e58f2f None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:48.595515 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850e7de3-6e78-46f6-b1bd-361972e1ee85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea647438ea1c438987f28cbe39c3ff2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:48.596232 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850e7de3-6e78-46f6-b1bd-361972e1ee85 service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:48.596797 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850e7de3-6e78-46f6-b1bd-361972e1ee85 service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:48.597092 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850e7de3-6e78-46f6-b1bd-361972e1ee85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:48.607966 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850e7de3-6e78-46f6-b1bd-361972e1ee85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:48.609987 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850e7de3-6e78-46f6-b1bd-361972e1ee85 service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:48.620442 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1114/2187] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:38:48 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:38:49.166233 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7d28b8-a7c7-4c2f-b3f9-50508d32a6cc None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:49.166676 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7d28b8-a7c7-4c2f-b3f9-50508d32a6cc None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:49.166772 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7d28b8-a7c7-4c2f-b3f9-50508d32a6cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:49.183552 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-6f7d28b8-a7c7-4c2f-b3f9-50508d32a6cc None None] MFA Rules not processed for user `f7ad5ae70939416e8157693e02997a58`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:38:49.184757 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-6f7d28b8-a7c7-4c2f-b3f9-50508d32a6cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:49.240238 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1074/2188] 10.222.0.118 () {58 vars in 972 bytes} [Thu Jul 14 15:38:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:38:49.253238 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850e7de3-6e78-46f6-b1bd-361972e1ee85 service cinder] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:49.254625 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-850e7de3-6e78-46f6-b1bd-361972e1ee85 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:49.321502 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850e7de3-6e78-46f6-b1bd-361972e1ee85 service cinder] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:49.326784 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae2d7ea-ea48-4cda-a0e5-ec718f2af7a7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b672a6a601584d2d826147069e90a10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:49.327995 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae2d7ea-ea48-4cda-a0e5-ec718f2af7a7 service swift] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:49.328281 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae2d7ea-ea48-4cda-a0e5-ec718f2af7a7 service swift] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:49.328553 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae2d7ea-ea48-4cda-a0e5-ec718f2af7a7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:49.337008 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae2d7ea-ea48-4cda-a0e5-ec718f2af7a7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:49.338660 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae2d7ea-ea48-4cda-a0e5-ec718f2af7a7 service swift] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:49.346606 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1115/2189] 10.222.0.118 () {60 vars in 1389 bytes} [Thu Jul 14 15:38:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 15:38:51.404662 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7d28b8-a7c7-4c2f-b3f9-50508d32a6cc None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:51.409879 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-6f7d28b8-a7c7-4c2f-b3f9-50508d32a6cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:51.488961 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:51.509679 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7d28b8-a7c7-4c2f-b3f9-50508d32a6cc None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:51.516030 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ea6217-a4f6-4d48-830c-252f9bc0abfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:51.516977 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ea6217-a4f6-4d48-830c-252f9bc0abfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:51.517261 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ea6217-a4f6-4d48-830c-252f9bc0abfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:51.517552 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ea6217-a4f6-4d48-830c-252f9bc0abfe admin admin] PATH_INFO: `/v3/users/094fc0a7b58448bba6fdc962d519d126` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:51.518870 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ea6217-a4f6-4d48-830c-252f9bc0abfe admin admin] RBAC: Authorizing `identity:delete_user(user_id=094fc0a7b58448bba6fdc962d519d126)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:51.521117 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ea6217-a4f6-4d48-830c-252f9bc0abfe admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:51.581728 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-b9ea6217-a4f6-4d48-830c-252f9bc0abfe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '094fc0a7b58448bba6fdc962d519d126'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:51.589307 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-b9ea6217-a4f6-4d48-830c-252f9bc0abfe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '094fc0a7b58448bba6fdc962d519d126'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:51.590098 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-b9ea6217-a4f6-4d48-830c-252f9bc0abfe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '094fc0a7b58448bba6fdc962d519d126'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:51.590710 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-b9ea6217-a4f6-4d48-830c-252f9bc0abfe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '094fc0a7b58448bba6fdc962d519d126'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:51.603843 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-b9ea6217-a4f6-4d48-830c-252f9bc0abfe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '094fc0a7b58448bba6fdc962d519d126'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:51.621497 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1075/2190] 10.222.0.118 () {58 vars in 1228 bytes} [Thu Jul 14 15:38:51 2022] DELETE /identity/v3/users/094fc0a7b58448bba6fdc962d519d126 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:38:51.816190 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae2d7ea-ea48-4cda-a0e5-ec718f2af7a7 service swift] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:51.827737 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae2d7ea-ea48-4cda-a0e5-ec718f2af7a7 service swift] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:51.850116 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:51.887464 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b370bcd-6d15-42f5-8048-463f9f2887c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:51.888316 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b370bcd-6d15-42f5-8048-463f9f2887c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:51.888588 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b370bcd-6d15-42f5-8048-463f9f2887c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:51.888850 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b370bcd-6d15-42f5-8048-463f9f2887c2 admin admin] PATH_INFO: `/v3/projects/c0239ccc26a74cb7a8f52a4819e59856` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:51.890557 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b370bcd-6d15-42f5-8048-463f9f2887c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0239ccc26a74cb7a8f52a4819e59856)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:51.892488 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b370bcd-6d15-42f5-8048-463f9f2887c2 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:51.937403 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-6b370bcd-6d15-42f5-8048-463f9f2887c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0239ccc26a74cb7a8f52a4819e59856', 'request_id': 'req-6b370bcd-6d15-42f5-8048-463f9f2887c2'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:51.943451 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-6b370bcd-6d15-42f5-8048-463f9f2887c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0239ccc26a74cb7a8f52a4819e59856', 'request_id': 'req-6b370bcd-6d15-42f5-8048-463f9f2887c2'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:51.949502 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-6b370bcd-6d15-42f5-8048-463f9f2887c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0239ccc26a74cb7a8f52a4819e59856', 'request_id': 'req-6b370bcd-6d15-42f5-8048-463f9f2887c2'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:51.961926 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-6b370bcd-6d15-42f5-8048-463f9f2887c2 admin admin] The token cache is being invalidate because project c0239ccc26a74cb7a8f52a4819e59856 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:38:51.962243 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-6b370bcd-6d15-42f5-8048-463f9f2887c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:51.962849 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-6b370bcd-6d15-42f5-8048-463f9f2887c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:51.964408 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1116/2191] 10.222.0.118 () {58 vars in 1237 bytes} [Thu Jul 14 15:38:51 2022] DELETE /identity/v3/projects/c0239ccc26a74cb7a8f52a4819e59856 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:38:51.969889 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e891572-531f-4638-9786-1f9ad71b9029 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:51.970204 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e891572-531f-4638-9786-1f9ad71b9029 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:51.970479 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e891572-531f-4638-9786-1f9ad71b9029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:51.988106 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-5e891572-531f-4638-9786-1f9ad71b9029 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:38:51.989339 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-5e891572-531f-4638-9786-1f9ad71b9029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:52.047427 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1076/2192] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:38:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:38:52.055093 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba38c46-50e6-414f-b2b2-0eac105d44b4 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:52.055443 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba38c46-50e6-414f-b2b2-0eac105d44b4 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:52.055721 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba38c46-50e6-414f-b2b2-0eac105d44b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:52.074114 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-9ba38c46-50e6-414f-b2b2-0eac105d44b4 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:38:52.075329 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-9ba38c46-50e6-414f-b2b2-0eac105d44b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:52.083754 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1117/2193] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:38:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:38:52.087925 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e891572-531f-4638-9786-1f9ad71b9029 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:52.098262 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e891572-531f-4638-9786-1f9ad71b9029 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:52.102818 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61dfb53-c4f7-4522-b0f8-8e6cff4a1c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:52.103467 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61dfb53-c4f7-4522-b0f8-8e6cff4a1c62 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:52.103745 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61dfb53-c4f7-4522-b0f8-8e6cff4a1c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:52.104016 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61dfb53-c4f7-4522-b0f8-8e6cff4a1c62 admin admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:52.104740 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61dfb53-c4f7-4522-b0f8-8e6cff4a1c62 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:38:52.105040 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61dfb53-c4f7-4522-b0f8-8e6cff4a1c62 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:52.106669 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61dfb53-c4f7-4522-b0f8-8e6cff4a1c62 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:52.117985 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1077/2194] 10.222.0.118 () {58 vars in 1157 bytes} [Thu Jul 14 15:38:52 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:38:52.122599 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba38c46-50e6-414f-b2b2-0eac105d44b4 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:52.132344 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba38c46-50e6-414f-b2b2-0eac105d44b4 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:52.137327 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6281bf16-4020-4861-a439-bc9e1eb481f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:52.137996 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6281bf16-4020-4861-a439-bc9e1eb481f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:52.138365 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6281bf16-4020-4861-a439-bc9e1eb481f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:52.138642 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6281bf16-4020-4861-a439-bc9e1eb481f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:52.139962 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6281bf16-4020-4861-a439-bc9e1eb481f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:52.141875 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6281bf16-4020-4861-a439-bc9e1eb481f1 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:52.166818 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1118/2195] 10.222.0.118 () {60 vars in 1157 bytes} [Thu Jul 14 15:38:52 2022] POST /identity/v3/projects => generated 374 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:38:52.171204 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61dfb53-c4f7-4522-b0f8-8e6cff4a1c62 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:52.181186 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61dfb53-c4f7-4522-b0f8-8e6cff4a1c62 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:52.233219 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:52.241533 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b92343a-37ff-4d3b-b059-a3d1d7e4cef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:52.242448 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b92343a-37ff-4d3b-b059-a3d1d7e4cef4 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:52.242896 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b92343a-37ff-4d3b-b059-a3d1d7e4cef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:52.243511 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b92343a-37ff-4d3b-b059-a3d1d7e4cef4 admin admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:52.244382 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b92343a-37ff-4d3b-b059-a3d1d7e4cef4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:52.246985 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b92343a-37ff-4d3b-b059-a3d1d7e4cef4 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:52.271540 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1078/2196] 10.222.0.118 () {60 vars in 1148 bytes} [Thu Jul 14 15:38:52 2022] POST /identity/v3/users => generated 288 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:38:52.275613 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6281bf16-4020-4861-a439-bc9e1eb481f1 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:52.292834 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6281bf16-4020-4861-a439-bc9e1eb481f1 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:52.298592 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cd4d94-092f-4d61-ac25-16adc2b971c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:52.299475 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd4d94-092f-4d61-ac25-16adc2b971c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:52.299827 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd4d94-092f-4d61-ac25-16adc2b971c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:52.300125 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd4d94-092f-4d61-ac25-16adc2b971c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:52.300867 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cd4d94-092f-4d61-ac25-16adc2b971c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:52.302644 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cd4d94-092f-4d61-ac25-16adc2b971c4 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:52.314131 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1119/2197] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:38:52 2022] GET /identity/v3/roles => generated 1427 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:38:52.318136 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b92343a-37ff-4d3b-b059-a3d1d7e4cef4 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:52.330852 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b92343a-37ff-4d3b-b059-a3d1d7e4cef4 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:52.335649 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06024e3b-5b87-491e-aea4-2ac23dcb5614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:52.336346 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06024e3b-5b87-491e-aea4-2ac23dcb5614 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:52.336627 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06024e3b-5b87-491e-aea4-2ac23dcb5614 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:52.336905 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06024e3b-5b87-491e-aea4-2ac23dcb5614 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:52.337667 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06024e3b-5b87-491e-aea4-2ac23dcb5614 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:52.339384 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06024e3b-5b87-491e-aea4-2ac23dcb5614 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:52.353860 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1079/2198] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:38:52 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:38:52.356002 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cd4d94-092f-4d61-ac25-16adc2b971c4 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:52.366258 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cd4d94-092f-4d61-ac25-16adc2b971c4 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:52.371516 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f206ec59-01e6-4cc3-9ee5-b04712e4af01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:52.372408 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f206ec59-01e6-4cc3-9ee5-b04712e4af01 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:52.372681 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f206ec59-01e6-4cc3-9ee5-b04712e4af01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:52.372952 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f206ec59-01e6-4cc3-9ee5-b04712e4af01 admin admin] PATH_INFO: `/v3/projects/2b460097853d49b1bc5b1fdbd808d93b/users/1a96cc256f3c421883372b0504ac6e24/roles/4abcf5e5e7cd4b53ae1828fec6550d53` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:52.390673 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f206ec59-01e6-4cc3-9ee5-b04712e4af01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b460097853d49b1bc5b1fdbd808d93b, user_id=1a96cc256f3c421883372b0504ac6e24, role_id=4abcf5e5e7cd4b53ae1828fec6550d53)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:52.392047 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f206ec59-01e6-4cc3-9ee5-b04712e4af01 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:52.406322 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1120/2199] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:38:52 2022] PUT /identity/v3/projects/2b460097853d49b1bc5b1fdbd808d93b/users/1a96cc256f3c421883372b0504ac6e24/roles/4abcf5e5e7cd4b53ae1828fec6550d53 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:38:52.416757 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacdf19c-7de6-4d58-8ce6-9e8e52652975 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:52.417253 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacdf19c-7de6-4d58-8ce6-9e8e52652975 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:52.417432 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacdf19c-7de6-4d58-8ce6-9e8e52652975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:52.445497 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-bacdf19c-7de6-4d58-8ce6-9e8e52652975 None None] MFA Rules not processed for user `1a96cc256f3c421883372b0504ac6e24`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:38:52.446688 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-bacdf19c-7de6-4d58-8ce6-9e8e52652975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:52.517813 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1080/2200] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:38:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:38:52.528799 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f206ec59-01e6-4cc3-9ee5-b04712e4af01 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:52.530643 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-f206ec59-01e6-4cc3-9ee5-b04712e4af01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:52.589737 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:52.593939 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f206ec59-01e6-4cc3-9ee5-b04712e4af01 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:52.599255 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60493b8d-f452-4fc1-be1c-a24f8b1128df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea647438ea1c438987f28cbe39c3ff2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:52.600282 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60493b8d-f452-4fc1-be1c-a24f8b1128df service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:52.600774 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60493b8d-f452-4fc1-be1c-a24f8b1128df service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:52.601409 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60493b8d-f452-4fc1-be1c-a24f8b1128df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:52.612702 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60493b8d-f452-4fc1-be1c-a24f8b1128df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:52.614511 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacdf19c-7de6-4d58-8ce6-9e8e52652975 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:52.614672 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60493b8d-f452-4fc1-be1c-a24f8b1128df service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:52.615952 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-bacdf19c-7de6-4d58-8ce6-9e8e52652975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:52.625602 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1121/2201] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:38:52 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:38:52.698099 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacdf19c-7de6-4d58-8ce6-9e8e52652975 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:52.703114 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526bcba1-cb3a-4f7c-9877-a0bc2e6a5053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:52.704158 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526bcba1-cb3a-4f7c-9877-a0bc2e6a5053 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:52.704506 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526bcba1-cb3a-4f7c-9877-a0bc2e6a5053 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:52.704849 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526bcba1-cb3a-4f7c-9877-a0bc2e6a5053 admin admin] PATH_INFO: `/v3/users/cf4b4df6e24b4192a61284cca083b861` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:52.712340 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526bcba1-cb3a-4f7c-9877-a0bc2e6a5053 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf4b4df6e24b4192a61284cca083b861)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:52.712340 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526bcba1-cb3a-4f7c-9877-a0bc2e6a5053 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:52.779968 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-526bcba1-cb3a-4f7c-9877-a0bc2e6a5053 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf4b4df6e24b4192a61284cca083b861'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:52.790924 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-526bcba1-cb3a-4f7c-9877-a0bc2e6a5053 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf4b4df6e24b4192a61284cca083b861'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:52.792204 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-526bcba1-cb3a-4f7c-9877-a0bc2e6a5053 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf4b4df6e24b4192a61284cca083b861'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:52.792743 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-526bcba1-cb3a-4f7c-9877-a0bc2e6a5053 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf4b4df6e24b4192a61284cca083b861'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:52.804267 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:52.813004 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-526bcba1-cb3a-4f7c-9877-a0bc2e6a5053 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf4b4df6e24b4192a61284cca083b861'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:52.834689 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1081/2202] 10.222.0.118 () {58 vars in 1228 bytes} [Thu Jul 14 15:38:52 2022] DELETE /identity/v3/users/cf4b4df6e24b4192a61284cca083b861 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:38:52.836749 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6179f39-1e55-440e-a55f-5af5cafc493f None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:52.837261 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6179f39-1e55-440e-a55f-5af5cafc493f None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:52.837370 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6179f39-1e55-440e-a55f-5af5cafc493f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:52.860097 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-b6179f39-1e55-440e-a55f-5af5cafc493f None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:38:52.861336 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-b6179f39-1e55-440e-a55f-5af5cafc493f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:52.950287 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1122/2203] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:38:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:38:52.960517 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526bcba1-cb3a-4f7c-9877-a0bc2e6a5053 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:52.962239 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-526bcba1-cb3a-4f7c-9877-a0bc2e6a5053 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:53.060252 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526bcba1-cb3a-4f7c-9877-a0bc2e6a5053 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:53.076788 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3405cf89-76ec-4bfb-8e60-550348810205 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b650be8114b64df0ac88441f1c50b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:53.077908 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3405cf89-76ec-4bfb-8e60-550348810205 service neutron] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:53.080065 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3405cf89-76ec-4bfb-8e60-550348810205 service neutron] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:53.080841 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3405cf89-76ec-4bfb-8e60-550348810205 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:53.096074 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3405cf89-76ec-4bfb-8e60-550348810205 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:53.098124 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3405cf89-76ec-4bfb-8e60-550348810205 service neutron] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:53.113470 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1082/2204] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:38:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:38:53.544455 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6179f39-1e55-440e-a55f-5af5cafc493f None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:53.546165 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-b6179f39-1e55-440e-a55f-5af5cafc493f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:53.558722 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6179f39-1e55-440e-a55f-5af5cafc493f None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:53.568616 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addeb38a-c6bb-4047-8082-b7e6061451b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:53.569584 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addeb38a-c6bb-4047-8082-b7e6061451b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:53.569952 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addeb38a-c6bb-4047-8082-b7e6061451b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:53.570270 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addeb38a-c6bb-4047-8082-b7e6061451b0 admin admin] PATH_INFO: `/v3/projects/14d6f8f81c9047dc96e45b7d47ecdae3` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:53.571838 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addeb38a-c6bb-4047-8082-b7e6061451b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14d6f8f81c9047dc96e45b7d47ecdae3)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:53.584152 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addeb38a-c6bb-4047-8082-b7e6061451b0 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:53.648797 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-addeb38a-c6bb-4047-8082-b7e6061451b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14d6f8f81c9047dc96e45b7d47ecdae3', 'request_id': 'req-addeb38a-c6bb-4047-8082-b7e6061451b0'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:53.654404 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-addeb38a-c6bb-4047-8082-b7e6061451b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14d6f8f81c9047dc96e45b7d47ecdae3', 'request_id': 'req-addeb38a-c6bb-4047-8082-b7e6061451b0'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:53.660724 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-addeb38a-c6bb-4047-8082-b7e6061451b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14d6f8f81c9047dc96e45b7d47ecdae3', 'request_id': 'req-addeb38a-c6bb-4047-8082-b7e6061451b0'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:53.672836 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-addeb38a-c6bb-4047-8082-b7e6061451b0 admin admin] The token cache is being invalidate because project 14d6f8f81c9047dc96e45b7d47ecdae3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:38:53.673121 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-addeb38a-c6bb-4047-8082-b7e6061451b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:53.673746 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-addeb38a-c6bb-4047-8082-b7e6061451b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:53.675414 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1123/2205] 10.222.0.118 () {58 vars in 1237 bytes} [Thu Jul 14 15:38:53 2022] DELETE /identity/v3/projects/14d6f8f81c9047dc96e45b7d47ecdae3 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:38:53.679341 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3405cf89-76ec-4bfb-8e60-550348810205 service neutron] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:53.689709 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3405cf89-76ec-4bfb-8e60-550348810205 service neutron] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:53.753620 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80d922d-7a07-4d56-acb1-7489b54cdb6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:53.754512 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80d922d-7a07-4d56-acb1-7489b54cdb6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:53.754795 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80d922d-7a07-4d56-acb1-7489b54cdb6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:53.755073 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80d922d-7a07-4d56-acb1-7489b54cdb6a admin admin] PATH_INFO: `/v3/users/cb52fe6206844b0aa1a49953da090f91` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:53.756263 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80d922d-7a07-4d56-acb1-7489b54cdb6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb52fe6206844b0aa1a49953da090f91)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:53.758233 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80d922d-7a07-4d56-acb1-7489b54cdb6a admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:53.803499 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-a80d922d-7a07-4d56-acb1-7489b54cdb6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb52fe6206844b0aa1a49953da090f91'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:53.810256 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-a80d922d-7a07-4d56-acb1-7489b54cdb6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb52fe6206844b0aa1a49953da090f91'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:53.810915 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-a80d922d-7a07-4d56-acb1-7489b54cdb6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb52fe6206844b0aa1a49953da090f91'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:53.812042 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-a80d922d-7a07-4d56-acb1-7489b54cdb6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb52fe6206844b0aa1a49953da090f91'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:53.824853 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-a80d922d-7a07-4d56-acb1-7489b54cdb6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb52fe6206844b0aa1a49953da090f91'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:53.840331 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1083/2206] 10.222.0.118 () {58 vars in 1228 bytes} [Thu Jul 14 15:38:53 2022] DELETE /identity/v3/users/cb52fe6206844b0aa1a49953da090f91 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:38:54.115053 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addeb38a-c6bb-4047-8082-b7e6061451b0 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:54.116503 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-addeb38a-c6bb-4047-8082-b7e6061451b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:54.132162 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addeb38a-c6bb-4047-8082-b7e6061451b0 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:54.191620 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1209fcbc-afe2-4ec9-bb2f-442e801558eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:54.192480 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1209fcbc-afe2-4ec9-bb2f-442e801558eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:54.192757 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1209fcbc-afe2-4ec9-bb2f-442e801558eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:54.193029 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1209fcbc-afe2-4ec9-bb2f-442e801558eb admin admin] PATH_INFO: `/v3/projects/837d69b3091149e29c00c8c3dcabefb0` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:54.194244 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1209fcbc-afe2-4ec9-bb2f-442e801558eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=837d69b3091149e29c00c8c3dcabefb0)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:54.196144 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1209fcbc-afe2-4ec9-bb2f-442e801558eb admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:54.214004 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:54.263537 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-1209fcbc-afe2-4ec9-bb2f-442e801558eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '837d69b3091149e29c00c8c3dcabefb0', 'request_id': 'req-1209fcbc-afe2-4ec9-bb2f-442e801558eb'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:54.270407 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-1209fcbc-afe2-4ec9-bb2f-442e801558eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '837d69b3091149e29c00c8c3dcabefb0', 'request_id': 'req-1209fcbc-afe2-4ec9-bb2f-442e801558eb'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:54.279566 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-1209fcbc-afe2-4ec9-bb2f-442e801558eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '837d69b3091149e29c00c8c3dcabefb0', 'request_id': 'req-1209fcbc-afe2-4ec9-bb2f-442e801558eb'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:54.304890 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-1209fcbc-afe2-4ec9-bb2f-442e801558eb admin admin] The token cache is being invalidate because project 837d69b3091149e29c00c8c3dcabefb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:38:54.305242 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-1209fcbc-afe2-4ec9-bb2f-442e801558eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:54.306184 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-1209fcbc-afe2-4ec9-bb2f-442e801558eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:54.308001 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1124/2207] 10.222.0.118 () {58 vars in 1237 bytes} [Thu Jul 14 15:38:54 2022] DELETE /identity/v3/projects/837d69b3091149e29c00c8c3dcabefb0 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:38:54.313657 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cc19b9-161c-4d1f-a7e2-09a17c362de7 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:54.314152 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cc19b9-161c-4d1f-a7e2-09a17c362de7 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:54.314663 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cc19b9-161c-4d1f-a7e2-09a17c362de7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:54.325289 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:54.340702 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-14cc19b9-161c-4d1f-a7e2-09a17c362de7 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:38:54.343180 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-14cc19b9-161c-4d1f-a7e2-09a17c362de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:54.425553 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1084/2208] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:38:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:38:54.433390 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e5448-a009-40ff-92d1-84f9f8a2cb8c None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:54.433935 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e5448-a009-40ff-92d1-84f9f8a2cb8c None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:54.434393 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e5448-a009-40ff-92d1-84f9f8a2cb8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:54.458196 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-345e5448-a009-40ff-92d1-84f9f8a2cb8c None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:38:54.459459 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-345e5448-a009-40ff-92d1-84f9f8a2cb8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:54.469618 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1125/2209] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:38:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:38:54.475081 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cc19b9-161c-4d1f-a7e2-09a17c362de7 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:54.493357 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cc19b9-161c-4d1f-a7e2-09a17c362de7 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:54.502006 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755e3073-861c-4cd8-91a6-4eb256c5ab37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:54.502941 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755e3073-861c-4cd8-91a6-4eb256c5ab37 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:54.503404 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755e3073-861c-4cd8-91a6-4eb256c5ab37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:54.503774 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755e3073-861c-4cd8-91a6-4eb256c5ab37 admin admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:54.505018 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755e3073-861c-4cd8-91a6-4eb256c5ab37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:38:54.505465 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755e3073-861c-4cd8-91a6-4eb256c5ab37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:54.507885 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755e3073-861c-4cd8-91a6-4eb256c5ab37 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:54.531424 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1085/2210] 10.222.0.118 () {58 vars in 1157 bytes} [Thu Jul 14 15:38:54 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:38:54.532285 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345e5448-a009-40ff-92d1-84f9f8a2cb8c None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:54.542558 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345e5448-a009-40ff-92d1-84f9f8a2cb8c None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:54.547983 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286372b8-84c3-404b-b00a-a5c66a30bb35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:54.548715 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286372b8-84c3-404b-b00a-a5c66a30bb35 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:54.549096 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286372b8-84c3-404b-b00a-a5c66a30bb35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:54.549427 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286372b8-84c3-404b-b00a-a5c66a30bb35 admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:54.550336 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286372b8-84c3-404b-b00a-a5c66a30bb35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:54.552242 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286372b8-84c3-404b-b00a-a5c66a30bb35 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:54.580734 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1126/2211] 10.222.0.118 () {60 vars in 1157 bytes} [Thu Jul 14 15:38:54 2022] POST /identity/v3/projects => generated 374 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:38:54.585559 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755e3073-861c-4cd8-91a6-4eb256c5ab37 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:54.597516 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755e3073-861c-4cd8-91a6-4eb256c5ab37 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:54.658815 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfb4b98-ef1e-4874-9cf6-8184f446b712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:54.659542 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfb4b98-ef1e-4874-9cf6-8184f446b712 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:54.659824 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfb4b98-ef1e-4874-9cf6-8184f446b712 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:54.660101 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfb4b98-ef1e-4874-9cf6-8184f446b712 admin admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:54.660856 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfb4b98-ef1e-4874-9cf6-8184f446b712 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:54.662905 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfb4b98-ef1e-4874-9cf6-8184f446b712 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:54.684117 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1086/2212] 10.222.0.118 () {60 vars in 1148 bytes} [Thu Jul 14 15:38:54 2022] POST /identity/v3/users => generated 288 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:38:54.688335 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286372b8-84c3-404b-b00a-a5c66a30bb35 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:54.699006 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286372b8-84c3-404b-b00a-a5c66a30bb35 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:54.704340 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f366b5-ce78-4757-a52c-1b49a2210062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:54.705106 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f366b5-ce78-4757-a52c-1b49a2210062 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:54.705485 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f366b5-ce78-4757-a52c-1b49a2210062 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:54.705810 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f366b5-ce78-4757-a52c-1b49a2210062 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:54.710154 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f366b5-ce78-4757-a52c-1b49a2210062 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:54.710154 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f366b5-ce78-4757-a52c-1b49a2210062 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:54.723532 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1127/2213] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:38:54 2022] GET /identity/v3/roles => generated 1427 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:38:54.727885 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfb4b98-ef1e-4874-9cf6-8184f446b712 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:54.738941 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfb4b98-ef1e-4874-9cf6-8184f446b712 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:54.743984 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6faf9ae-531c-4d10-9ef8-1f9ad9a50a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:54.744788 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6faf9ae-531c-4d10-9ef8-1f9ad9a50a7e admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:54.747121 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6faf9ae-531c-4d10-9ef8-1f9ad9a50a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:54.747121 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6faf9ae-531c-4d10-9ef8-1f9ad9a50a7e admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:54.747121 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6faf9ae-531c-4d10-9ef8-1f9ad9a50a7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:54.748448 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6faf9ae-531c-4d10-9ef8-1f9ad9a50a7e admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:54.760453 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1087/2214] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:38:54 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:38:54.765527 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f366b5-ce78-4757-a52c-1b49a2210062 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:54.784728 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f366b5-ce78-4757-a52c-1b49a2210062 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:54.789642 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1956a3-76de-48a0-aa50-b824ee36cbfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:54.790586 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1956a3-76de-48a0-aa50-b824ee36cbfb admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:54.790883 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1956a3-76de-48a0-aa50-b824ee36cbfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:54.791135 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1956a3-76de-48a0-aa50-b824ee36cbfb admin admin] PATH_INFO: `/v3/projects/0738f614aba64ae187dc04aaa4fb46d4/users/350ecd5926a749c29476b2c4fabbd716/roles/4abcf5e5e7cd4b53ae1828fec6550d53` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:54.808630 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1956a3-76de-48a0-aa50-b824ee36cbfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=0738f614aba64ae187dc04aaa4fb46d4, user_id=350ecd5926a749c29476b2c4fabbd716, role_id=4abcf5e5e7cd4b53ae1828fec6550d53)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:54.811948 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1956a3-76de-48a0-aa50-b824ee36cbfb admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:54.827741 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1128/2215] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:38:54 2022] PUT /identity/v3/projects/0738f614aba64ae187dc04aaa4fb46d4/users/350ecd5926a749c29476b2c4fabbd716/roles/4abcf5e5e7cd4b53ae1828fec6550d53 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:38:54.832498 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732cccb1-8652-4caa-9cd7-79135e66d6a0 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:54.832790 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732cccb1-8652-4caa-9cd7-79135e66d6a0 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:54.833070 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732cccb1-8652-4caa-9cd7-79135e66d6a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:54.852329 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-732cccb1-8652-4caa-9cd7-79135e66d6a0 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:38:54.853565 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-732cccb1-8652-4caa-9cd7-79135e66d6a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:54.917794 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1088/2216] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:38:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:38:54.927331 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1956a3-76de-48a0-aa50-b824ee36cbfb admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:54.929092 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-7f1956a3-76de-48a0-aa50-b824ee36cbfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:54.985900 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1956a3-76de-48a0-aa50-b824ee36cbfb admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:54.989650 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0690fc90-f9ab-4d26-b565-610fca7c4877 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b650be8114b64df0ac88441f1c50b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:54.990336 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0690fc90-f9ab-4d26-b565-610fca7c4877 service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:54.990614 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0690fc90-f9ab-4d26-b565-610fca7c4877 service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:54.990888 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0690fc90-f9ab-4d26-b565-610fca7c4877 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:55.000384 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0690fc90-f9ab-4d26-b565-610fca7c4877 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:55.001828 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0690fc90-f9ab-4d26-b565-610fca7c4877 service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:55.011318 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1129/2217] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:38:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:38:55.959840 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc667819-287c-42b0-9ae8-4f73d142ab72 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:55.960325 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc667819-287c-42b0-9ae8-4f73d142ab72 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:55.960423 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc667819-287c-42b0-9ae8-4f73d142ab72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:56.005533 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:56.025000 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-fc667819-287c-42b0-9ae8-4f73d142ab72 None None] MFA Rules not processed for user `350ecd5926a749c29476b2c4fabbd716`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:38:56.026306 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-fc667819-287c-42b0-9ae8-4f73d142ab72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:56.150567 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1089/2218] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:38:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:38:56.152710 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0690fc90-f9ab-4d26-b565-610fca7c4877 service neutron] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:56.167795 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0690fc90-f9ab-4d26-b565-610fca7c4877 service neutron] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:56.173465 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7620594-67e8-410a-b7c2-c542fe9f4c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:56.174283 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7620594-67e8-410a-b7c2-c542fe9f4c9a admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:56.174951 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7620594-67e8-410a-b7c2-c542fe9f4c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:56.174951 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7620594-67e8-410a-b7c2-c542fe9f4c9a admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:56.175523 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7620594-67e8-410a-b7c2-c542fe9f4c9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:56.177576 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7620594-67e8-410a-b7c2-c542fe9f4c9a admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:56.207305 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1130/2219] 10.222.0.118 () {60 vars in 1157 bytes} [Thu Jul 14 15:38:56 2022] POST /identity/v3/projects => generated 374 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:38:56.211513 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc667819-287c-42b0-9ae8-4f73d142ab72 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:56.223994 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc667819-287c-42b0-9ae8-4f73d142ab72 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:56.291724 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f149281-c25f-48e4-af96-438baf68356e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:56.292463 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f149281-c25f-48e4-af96-438baf68356e admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:56.292738 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f149281-c25f-48e4-af96-438baf68356e admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:56.293009 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f149281-c25f-48e4-af96-438baf68356e admin admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:56.293755 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f149281-c25f-48e4-af96-438baf68356e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:56.296014 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f149281-c25f-48e4-af96-438baf68356e admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:56.322194 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1090/2220] 10.222.0.118 () {60 vars in 1148 bytes} [Thu Jul 14 15:38:56 2022] POST /identity/v3/users => generated 294 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:38:56.323368 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7620594-67e8-410a-b7c2-c542fe9f4c9a admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:56.334313 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7620594-67e8-410a-b7c2-c542fe9f4c9a admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:56.339113 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baba9e3-1808-4d8e-9432-418027fd8173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:56.339570 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baba9e3-1808-4d8e-9432-418027fd8173 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:56.339845 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baba9e3-1808-4d8e-9432-418027fd8173 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:56.340120 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baba9e3-1808-4d8e-9432-418027fd8173 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:56.340842 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baba9e3-1808-4d8e-9432-418027fd8173 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:56.343086 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baba9e3-1808-4d8e-9432-418027fd8173 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:56.353867 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1131/2221] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:38:56 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:38:56.358171 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f149281-c25f-48e4-af96-438baf68356e admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:56.369055 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f149281-c25f-48e4-af96-438baf68356e admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:56.374664 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2349796-7a41-473b-a521-e1990b38a320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:56.375582 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2349796-7a41-473b-a521-e1990b38a320 admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:56.375863 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2349796-7a41-473b-a521-e1990b38a320 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:56.376135 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2349796-7a41-473b-a521-e1990b38a320 admin admin] PATH_INFO: `/v3/projects/1a7f6bdc33164ba98473d3713eb5c6aa/users/4c84446748054a5d96c7bab031c18184/roles/3b880cef7dcf4baf87b50f8610c0c56e` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:56.393022 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2349796-7a41-473b-a521-e1990b38a320 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a7f6bdc33164ba98473d3713eb5c6aa, user_id=4c84446748054a5d96c7bab031c18184, role_id=3b880cef7dcf4baf87b50f8610c0c56e)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:56.395872 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2349796-7a41-473b-a521-e1990b38a320 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:56.409995 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1091/2222] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:38:56 2022] PUT /identity/v3/projects/1a7f6bdc33164ba98473d3713eb5c6aa/users/4c84446748054a5d96c7bab031c18184/roles/3b880cef7dcf4baf87b50f8610c0c56e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:38:56.414028 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baba9e3-1808-4d8e-9432-418027fd8173 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:56.424322 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baba9e3-1808-4d8e-9432-418027fd8173 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:56.432289 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:56.488913 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d77a46-fa17-4e8e-a80a-a1e42da7a00e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:56.489600 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d77a46-fa17-4e8e-a80a-a1e42da7a00e admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:56.489878 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d77a46-fa17-4e8e-a80a-a1e42da7a00e admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:56.490199 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d77a46-fa17-4e8e-a80a-a1e42da7a00e admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:56.490966 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d77a46-fa17-4e8e-a80a-a1e42da7a00e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:56.492621 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d77a46-fa17-4e8e-a80a-a1e42da7a00e admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:56.506760 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1132/2223] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:38:56 2022] GET /identity/v3/roles => generated 1427 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:38:56.507997 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2349796-7a41-473b-a521-e1990b38a320 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:56.519255 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2349796-7a41-473b-a521-e1990b38a320 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:56.524054 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13f58e1-e383-469f-8d18-7f68e526be59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:56.525037 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13f58e1-e383-469f-8d18-7f68e526be59 admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:56.525390 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13f58e1-e383-469f-8d18-7f68e526be59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:56.525768 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13f58e1-e383-469f-8d18-7f68e526be59 admin admin] PATH_INFO: `/v3/projects/1a7f6bdc33164ba98473d3713eb5c6aa/users/4c84446748054a5d96c7bab031c18184/roles/3b880cef7dcf4baf87b50f8610c0c56e` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:56.527948 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13f58e1-e383-469f-8d18-7f68e526be59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a7f6bdc33164ba98473d3713eb5c6aa, user_id=4c84446748054a5d96c7bab031c18184, role_id=3b880cef7dcf4baf87b50f8610c0c56e)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:56.531362 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13f58e1-e383-469f-8d18-7f68e526be59 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:56.542745 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1092/2224] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:38:56 2022] PUT /identity/v3/projects/1a7f6bdc33164ba98473d3713eb5c6aa/users/4c84446748054a5d96c7bab031c18184/roles/3b880cef7dcf4baf87b50f8610c0c56e => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:38:57.477860 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e0f62-d8e5-4b4b-a863-df00720c65a4 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:57.478805 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e0f62-d8e5-4b4b-a863-df00720c65a4 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:57.479265 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e0f62-d8e5-4b4b-a863-df00720c65a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:57.505794 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-991e0f62-d8e5-4b4b-a863-df00720c65a4 None None] MFA Rules not processed for user `34f09b2afbe54a6ab1ba27292bc5a964`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:38:57.507063 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-991e0f62-d8e5-4b4b-a863-df00720c65a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:57.584212 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e0b42d-85fd-49e2-8c0e-7a7b3490522b None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:57.584722 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e0b42d-85fd-49e2-8c0e-7a7b3490522b None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:57.585119 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e0b42d-85fd-49e2-8c0e-7a7b3490522b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:57.598522 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1133/2225] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:38:57 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:38:57.630872 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-66e0b42d-85fd-49e2-8c0e-7a7b3490522b None None] MFA Rules not processed for user `4c84446748054a5d96c7bab031c18184`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:38:57.633734 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-66e0b42d-85fd-49e2-8c0e-7a7b3490522b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:57.715108 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:57.762379 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1093/2226] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:38:57 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:38:57.773461 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd60ad4f-c673-48c5-94ff-788d262fad1d None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:57.773945 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd60ad4f-c673-48c5-94ff-788d262fad1d None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:57.774274 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd60ad4f-c673-48c5-94ff-788d262fad1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:57.803354 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-bd60ad4f-c673-48c5-94ff-788d262fad1d None None] MFA Rules not processed for user `350ecd5926a749c29476b2c4fabbd716`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:38:57.804570 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-bd60ad4f-c673-48c5-94ff-788d262fad1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:57.878323 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1134/2227] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:38:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:38:57.884561 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e0b42d-85fd-49e2-8c0e-7a7b3490522b None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:57.886187 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-66e0b42d-85fd-49e2-8c0e-7a7b3490522b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:57.979559 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e0b42d-85fd-49e2-8c0e-7a7b3490522b None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:57.985614 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83207ff7-e109-4295-afcc-ade33b50e8a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0177fc696ea40069902803da09f437c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:57.986888 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83207ff7-e109-4295-afcc-ade33b50e8a9 service nova] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:57.987271 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83207ff7-e109-4295-afcc-ade33b50e8a9 service nova] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:57.987682 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83207ff7-e109-4295-afcc-ade33b50e8a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:57.997951 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83207ff7-e109-4295-afcc-ade33b50e8a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:57.999733 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83207ff7-e109-4295-afcc-ade33b50e8a9 service nova] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:58.011478 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1094/2228] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:38:57 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:39:03.294902 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd60ad4f-c673-48c5-94ff-788d262fad1d None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:03.297506 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-bd60ad4f-c673-48c5-94ff-788d262fad1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:39:03.393194 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:03.400038 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd60ad4f-c673-48c5-94ff-788d262fad1d None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:03.406523 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f037290-205d-4bf0-9842-8d4a59ef2d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:03.407497 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f037290-205d-4bf0-9842-8d4a59ef2d39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:03.407838 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f037290-205d-4bf0-9842-8d4a59ef2d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:03.408238 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f037290-205d-4bf0-9842-8d4a59ef2d39 admin admin] PATH_INFO: `/v3/users/1a96cc256f3c421883372b0504ac6e24` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:03.409530 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f037290-205d-4bf0-9842-8d4a59ef2d39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a96cc256f3c421883372b0504ac6e24)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:03.411641 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f037290-205d-4bf0-9842-8d4a59ef2d39 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:03.471532 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-9f037290-205d-4bf0-9842-8d4a59ef2d39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a96cc256f3c421883372b0504ac6e24'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:03.479402 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-9f037290-205d-4bf0-9842-8d4a59ef2d39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a96cc256f3c421883372b0504ac6e24'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:03.480101 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-9f037290-205d-4bf0-9842-8d4a59ef2d39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a96cc256f3c421883372b0504ac6e24'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:03.480766 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-9f037290-205d-4bf0-9842-8d4a59ef2d39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a96cc256f3c421883372b0504ac6e24'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:03.500801 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-9f037290-205d-4bf0-9842-8d4a59ef2d39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a96cc256f3c421883372b0504ac6e24'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:03.516384 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1135/2229] 10.222.0.118 () {58 vars in 1228 bytes} [Thu Jul 14 15:39:03 2022] DELETE /identity/v3/users/1a96cc256f3c421883372b0504ac6e24 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:39:03.522160 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d50447a-ac7b-4a3b-b905-4210868c76ab None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:03.522688 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d50447a-ac7b-4a3b-b905-4210868c76ab None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:03.522975 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d50447a-ac7b-4a3b-b905-4210868c76ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:03.557032 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-9d50447a-ac7b-4a3b-b905-4210868c76ab None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:39:03.559280 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-9d50447a-ac7b-4a3b-b905-4210868c76ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:39:03.660003 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1095/2230] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:39:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:39:03.667569 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f037290-205d-4bf0-9842-8d4a59ef2d39 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:03.669376 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-9f037290-205d-4bf0-9842-8d4a59ef2d39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:39:03.737790 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f037290-205d-4bf0-9842-8d4a59ef2d39 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:03.741736 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e050749-308c-4be5-93d3-671c7daa29f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b650be8114b64df0ac88441f1c50b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:03.742469 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e050749-308c-4be5-93d3-671c7daa29f6 service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:03.742747 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e050749-308c-4be5-93d3-671c7daa29f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:03.743018 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e050749-308c-4be5-93d3-671c7daa29f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:03.753558 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e050749-308c-4be5-93d3-671c7daa29f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:03.755023 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e050749-308c-4be5-93d3-671c7daa29f6 service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:03.766375 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1136/2231] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:39:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:39:04.062040 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d50447a-ac7b-4a3b-b905-4210868c76ab None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:04.063694 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-9d50447a-ac7b-4a3b-b905-4210868c76ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:39:04.079545 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d50447a-ac7b-4a3b-b905-4210868c76ab None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:04.085222 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41825c76-b9c2-4d94-aec5-6a09bec56069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:04.086388 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41825c76-b9c2-4d94-aec5-6a09bec56069 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:04.086817 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41825c76-b9c2-4d94-aec5-6a09bec56069 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:04.087144 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41825c76-b9c2-4d94-aec5-6a09bec56069 admin admin] PATH_INFO: `/v3/projects/2b460097853d49b1bc5b1fdbd808d93b` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:04.088773 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41825c76-b9c2-4d94-aec5-6a09bec56069 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b460097853d49b1bc5b1fdbd808d93b)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:04.090814 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41825c76-b9c2-4d94-aec5-6a09bec56069 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:04.143477 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-41825c76-b9c2-4d94-aec5-6a09bec56069 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b460097853d49b1bc5b1fdbd808d93b', 'request_id': 'req-41825c76-b9c2-4d94-aec5-6a09bec56069'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:04.149705 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-41825c76-b9c2-4d94-aec5-6a09bec56069 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b460097853d49b1bc5b1fdbd808d93b', 'request_id': 'req-41825c76-b9c2-4d94-aec5-6a09bec56069'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:04.153777 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:04.156256 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-41825c76-b9c2-4d94-aec5-6a09bec56069 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b460097853d49b1bc5b1fdbd808d93b', 'request_id': 'req-41825c76-b9c2-4d94-aec5-6a09bec56069'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:04.171916 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-41825c76-b9c2-4d94-aec5-6a09bec56069 admin admin] The token cache is being invalidate because project 2b460097853d49b1bc5b1fdbd808d93b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:39:04.172206 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-41825c76-b9c2-4d94-aec5-6a09bec56069 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:04.172878 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-41825c76-b9c2-4d94-aec5-6a09bec56069 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:04.175090 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1096/2232] 10.222.0.118 () {58 vars in 1237 bytes} [Thu Jul 14 15:39:04 2022] DELETE /identity/v3/projects/2b460097853d49b1bc5b1fdbd808d93b => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:39:04.179822 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959715ec-036e-4cf3-8477-5d185f4276ba None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:04.180179 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959715ec-036e-4cf3-8477-5d185f4276ba None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:04.180547 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959715ec-036e-4cf3-8477-5d185f4276ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:04.198833 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-959715ec-036e-4cf3-8477-5d185f4276ba None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:39:04.200054 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-959715ec-036e-4cf3-8477-5d185f4276ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:39:04.259094 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1137/2233] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:39:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:39:04.267792 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eabc5b1-a9be-4560-8146-3c8d0d52fcfd None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:04.268217 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eabc5b1-a9be-4560-8146-3c8d0d52fcfd None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:04.268549 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eabc5b1-a9be-4560-8146-3c8d0d52fcfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:04.286915 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-4eabc5b1-a9be-4560-8146-3c8d0d52fcfd None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:39:04.288128 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-4eabc5b1-a9be-4560-8146-3c8d0d52fcfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:39:04.295941 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1097/2234] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:39:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:39:04.300233 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959715ec-036e-4cf3-8477-5d185f4276ba None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:04.309842 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959715ec-036e-4cf3-8477-5d185f4276ba None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:04.314903 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d771f9d8-4a34-4ed4-9b3d-7c3345cbf43b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:04.315551 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d771f9d8-4a34-4ed4-9b3d-7c3345cbf43b admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:04.315832 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d771f9d8-4a34-4ed4-9b3d-7c3345cbf43b admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:04.316105 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d771f9d8-4a34-4ed4-9b3d-7c3345cbf43b admin admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:04.316830 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d771f9d8-4a34-4ed4-9b3d-7c3345cbf43b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:39:04.317135 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d771f9d8-4a34-4ed4-9b3d-7c3345cbf43b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:04.318765 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d771f9d8-4a34-4ed4-9b3d-7c3345cbf43b admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:04.330941 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1138/2235] 10.222.0.118 () {58 vars in 1157 bytes} [Thu Jul 14 15:39:04 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:39:04.334894 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eabc5b1-a9be-4560-8146-3c8d0d52fcfd None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:04.345920 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eabc5b1-a9be-4560-8146-3c8d0d52fcfd None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:04.351590 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f62869-5675-420b-962b-3e6a44095c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:04.352260 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f62869-5675-420b-962b-3e6a44095c77 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:04.352543 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f62869-5675-420b-962b-3e6a44095c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:04.352819 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f62869-5675-420b-962b-3e6a44095c77 admin admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:04.353531 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f62869-5675-420b-962b-3e6a44095c77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:04.355635 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f62869-5675-420b-962b-3e6a44095c77 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:04.383622 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1098/2236] 10.222.0.118 () {60 vars in 1157 bytes} [Thu Jul 14 15:39:04 2022] POST /identity/v3/projects => generated 382 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:39:04.403157 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d771f9d8-4a34-4ed4-9b3d-7c3345cbf43b admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:04.405392 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d771f9d8-4a34-4ed4-9b3d-7c3345cbf43b admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:04.409612 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:04.471025 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1d0952-1415-459d-b7cd-251166206f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:04.471713 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d0952-1415-459d-b7cd-251166206f15 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:04.471990 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d0952-1415-459d-b7cd-251166206f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:04.472290 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d0952-1415-459d-b7cd-251166206f15 admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:04.472995 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1d0952-1415-459d-b7cd-251166206f15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:04.474953 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1d0952-1415-459d-b7cd-251166206f15 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:04.501290 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1139/2237] 10.222.0.118 () {60 vars in 1148 bytes} [Thu Jul 14 15:39:04 2022] POST /identity/v3/users => generated 292 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:39:04.502523 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f62869-5675-420b-962b-3e6a44095c77 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:04.513551 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f62869-5675-420b-962b-3e6a44095c77 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:04.518379 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d481b53-6c47-4c4b-b761-b981cec31e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:04.519049 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d481b53-6c47-4c4b-b761-b981cec31e39 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:04.519330 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d481b53-6c47-4c4b-b761-b981cec31e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:04.519599 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d481b53-6c47-4c4b-b761-b981cec31e39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:04.520322 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d481b53-6c47-4c4b-b761-b981cec31e39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:04.521982 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d481b53-6c47-4c4b-b761-b981cec31e39 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:04.537095 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1099/2238] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:39:04 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:39:04.538983 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1d0952-1415-459d-b7cd-251166206f15 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:04.549562 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1d0952-1415-459d-b7cd-251166206f15 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:04.554173 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9d1f6d-b43a-455f-b6ac-1d4e7c576b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:04.554885 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9d1f6d-b43a-455f-b6ac-1d4e7c576b0d admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:04.555093 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9d1f6d-b43a-455f-b6ac-1d4e7c576b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:04.555364 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9d1f6d-b43a-455f-b6ac-1d4e7c576b0d admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:04.556267 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9d1f6d-b43a-455f-b6ac-1d4e7c576b0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:04.557987 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9d1f6d-b43a-455f-b6ac-1d4e7c576b0d admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:04.573856 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1140/2239] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:39:04 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:39:04.575084 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d481b53-6c47-4c4b-b761-b981cec31e39 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:04.585896 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d481b53-6c47-4c4b-b761-b981cec31e39 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:04.592136 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f38cca-788b-4367-b7ea-db5ab196a896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:04.593549 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f38cca-788b-4367-b7ea-db5ab196a896 admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:04.594048 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f38cca-788b-4367-b7ea-db5ab196a896 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:04.594651 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f38cca-788b-4367-b7ea-db5ab196a896 admin admin] PATH_INFO: `/v3/projects/6eb77a1b18ba44b5b2d3ff346d747857/users/c5564b64f20d4b62979cd0eef1b172be/roles/4abcf5e5e7cd4b53ae1828fec6550d53` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:04.616050 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f38cca-788b-4367-b7ea-db5ab196a896 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6eb77a1b18ba44b5b2d3ff346d747857, user_id=c5564b64f20d4b62979cd0eef1b172be, role_id=4abcf5e5e7cd4b53ae1828fec6550d53)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:04.619233 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f38cca-788b-4367-b7ea-db5ab196a896 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:04.644753 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1100/2240] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:39:04 2022] PUT /identity/v3/projects/6eb77a1b18ba44b5b2d3ff346d747857/users/c5564b64f20d4b62979cd0eef1b172be/roles/4abcf5e5e7cd4b53ae1828fec6550d53 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:39:04.649446 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0743a2fa-748c-48b5-bc0d-9cfd73ff65f5 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:04.649733 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0743a2fa-748c-48b5-bc0d-9cfd73ff65f5 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:04.650049 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0743a2fa-748c-48b5-bc0d-9cfd73ff65f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:04.688843 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-0743a2fa-748c-48b5-bc0d-9cfd73ff65f5 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:39:04.690102 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-0743a2fa-748c-48b5-bc0d-9cfd73ff65f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:39:04.789983 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1141/2241] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:39:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:39:04.818514 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f38cca-788b-4367-b7ea-db5ab196a896 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:04.821006 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-36f38cca-788b-4367-b7ea-db5ab196a896 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:39:04.911725 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f38cca-788b-4367-b7ea-db5ab196a896 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:04.917474 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e190c07-a7d0-4638-b7b4-338157c88745 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b650be8114b64df0ac88441f1c50b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:04.919027 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e190c07-a7d0-4638-b7b4-338157c88745 service neutron] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:04.919480 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e190c07-a7d0-4638-b7b4-338157c88745 service neutron] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:04.919765 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e190c07-a7d0-4638-b7b4-338157c88745 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:04.944961 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e190c07-a7d0-4638-b7b4-338157c88745 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:04.946516 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e190c07-a7d0-4638-b7b4-338157c88745 service neutron] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:04.958382 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1101/2242] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:39:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:39:06.684189 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60388a7b-5433-47ba-ace9-30bc6c8d73b5 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:06.684611 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60388a7b-5433-47ba-ace9-30bc6c8d73b5 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:06.684745 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60388a7b-5433-47ba-ace9-30bc6c8d73b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:06.707475 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-60388a7b-5433-47ba-ace9-30bc6c8d73b5 None None] MFA Rules not processed for user `4c4a0889c40248808900619987f7d6fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:39:06.709086 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-60388a7b-5433-47ba-ace9-30bc6c8d73b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:39:06.789734 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1142/2243] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:39:06 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:39:11.764822 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cc167f-3294-4455-a478-8837d49df9b9 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:11.765358 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cc167f-3294-4455-a478-8837d49df9b9 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:11.765358 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cc167f-3294-4455-a478-8837d49df9b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:11.796592 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-f9cc167f-3294-4455-a478-8837d49df9b9 None None] MFA Rules not processed for user `c5564b64f20d4b62979cd0eef1b172be`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:39:11.797824 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-f9cc167f-3294-4455-a478-8837d49df9b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:39:11.913821 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1102/2244] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:39:11 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:39:11.923694 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60388a7b-5433-47ba-ace9-30bc6c8d73b5 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:11.941059 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60388a7b-5433-47ba-ace9-30bc6c8d73b5 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:11.957249 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a30f7bb-4fa7-4af0-80ca-684e3dd599b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:11.958021 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a30f7bb-4fa7-4af0-80ca-684e3dd599b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:11.958314 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a30f7bb-4fa7-4af0-80ca-684e3dd599b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:11.958593 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a30f7bb-4fa7-4af0-80ca-684e3dd599b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:11.959360 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a30f7bb-4fa7-4af0-80ca-684e3dd599b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:11.961410 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a30f7bb-4fa7-4af0-80ca-684e3dd599b5 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:12.036209 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1143/2245] 10.222.0.118 () {60 vars in 1157 bytes} [Thu Jul 14 15:39:11 2022] POST /identity/v3/projects => generated 384 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:39:12.041717 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cc167f-3294-4455-a478-8837d49df9b9 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:12.056194 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cc167f-3294-4455-a478-8837d49df9b9 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:12.085542 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:12.222936 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb772d6-e26c-4c0d-b2c0-1c6e1e5e146a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:12.226633 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb772d6-e26c-4c0d-b2c0-1c6e1e5e146a admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:12.226981 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb772d6-e26c-4c0d-b2c0-1c6e1e5e146a admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:12.227265 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb772d6-e26c-4c0d-b2c0-1c6e1e5e146a admin admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:12.228050 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb772d6-e26c-4c0d-b2c0-1c6e1e5e146a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:12.232251 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb772d6-e26c-4c0d-b2c0-1c6e1e5e146a admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:12.312114 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a30f7bb-4fa7-4af0-80ca-684e3dd599b5 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:12.318644 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1103/2246] 10.222.0.118 () {60 vars in 1148 bytes} [Thu Jul 14 15:39:12 2022] POST /identity/v3/users => generated 299 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:39:12.327979 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a30f7bb-4fa7-4af0-80ca-684e3dd599b5 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:12.337836 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dacd4f-9217-4861-b299-745f8924a8c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:12.338652 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dacd4f-9217-4861-b299-745f8924a8c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:12.339090 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dacd4f-9217-4861-b299-745f8924a8c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:12.339272 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dacd4f-9217-4861-b299-745f8924a8c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:12.340017 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dacd4f-9217-4861-b299-745f8924a8c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:12.342346 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dacd4f-9217-4861-b299-745f8924a8c1 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:12.348996 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:12.386296 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1144/2247] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:39:12 2022] GET /identity/v3/roles => generated 1427 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:39:12.390884 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb772d6-e26c-4c0d-b2c0-1c6e1e5e146a admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:12.403403 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb772d6-e26c-4c0d-b2c0-1c6e1e5e146a admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:12.409081 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cb1bde-5bcd-41b7-bffb-048306f02f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:12.410036 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cb1bde-5bcd-41b7-bffb-048306f02f06 admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:12.410427 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cb1bde-5bcd-41b7-bffb-048306f02f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:12.410710 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cb1bde-5bcd-41b7-bffb-048306f02f06 admin admin] PATH_INFO: `/v3/projects/cfc1eeae448347c2aba4bda0489c4069/users/a550c98bfc824a71b9cbcf4ece937cbe/roles/3b880cef7dcf4baf87b50f8610c0c56e` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:12.442009 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cb1bde-5bcd-41b7-bffb-048306f02f06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfc1eeae448347c2aba4bda0489c4069, user_id=a550c98bfc824a71b9cbcf4ece937cbe, role_id=3b880cef7dcf4baf87b50f8610c0c56e)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:12.444671 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cb1bde-5bcd-41b7-bffb-048306f02f06 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:12.474255 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1104/2248] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:39:12 2022] PUT /identity/v3/projects/cfc1eeae448347c2aba4bda0489c4069/users/a550c98bfc824a71b9cbcf4ece937cbe/roles/3b880cef7dcf4baf87b50f8610c0c56e => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:39:12.475884 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dacd4f-9217-4861-b299-745f8924a8c1 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:12.497176 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dacd4f-9217-4861-b299-745f8924a8c1 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:12.594438 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd40acf-55cc-406c-ac75-9bef18b4eb0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:12.595119 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd40acf-55cc-406c-ac75-9bef18b4eb0f admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:12.595394 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd40acf-55cc-406c-ac75-9bef18b4eb0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:12.595666 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd40acf-55cc-406c-ac75-9bef18b4eb0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:12.596403 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd40acf-55cc-406c-ac75-9bef18b4eb0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:12.598212 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd40acf-55cc-406c-ac75-9bef18b4eb0f admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:12.609039 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1145/2249] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:39:12 2022] GET /identity/v3/roles => generated 1427 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:39:12.613303 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cb1bde-5bcd-41b7-bffb-048306f02f06 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:12.625745 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cb1bde-5bcd-41b7-bffb-048306f02f06 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:12.632364 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58310a97-89e2-4c44-a5f4-cc2c9666cbb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:12.633284 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58310a97-89e2-4c44-a5f4-cc2c9666cbb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:12.633566 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58310a97-89e2-4c44-a5f4-cc2c9666cbb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:12.633844 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58310a97-89e2-4c44-a5f4-cc2c9666cbb3 admin admin] PATH_INFO: `/v3/projects/cfc1eeae448347c2aba4bda0489c4069/users/a550c98bfc824a71b9cbcf4ece937cbe/roles/3b880cef7dcf4baf87b50f8610c0c56e` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:12.635971 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58310a97-89e2-4c44-a5f4-cc2c9666cbb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfc1eeae448347c2aba4bda0489c4069, user_id=a550c98bfc824a71b9cbcf4ece937cbe, role_id=3b880cef7dcf4baf87b50f8610c0c56e)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:12.639305 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58310a97-89e2-4c44-a5f4-cc2c9666cbb3 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:12.666232 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1105/2250] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:39:12 2022] PUT /identity/v3/projects/cfc1eeae448347c2aba4bda0489c4069/users/a550c98bfc824a71b9cbcf4ece937cbe/roles/3b880cef7dcf4baf87b50f8610c0c56e => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:39:12.843253 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09941f5a-0721-42fb-bc9a-fe538c980a4d None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:12.843613 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09941f5a-0721-42fb-bc9a-fe538c980a4d None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:12.843970 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09941f5a-0721-42fb-bc9a-fe538c980a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:12.875499 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-09941f5a-0721-42fb-bc9a-fe538c980a4d None None] MFA Rules not processed for user `f7ad5ae70939416e8157693e02997a58`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:39:12.876893 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-09941f5a-0721-42fb-bc9a-fe538c980a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:39:12.982670 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1146/2251] 10.222.0.118 () {58 vars in 1014 bytes} [Thu Jul 14 15:39:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:39:13.001570 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58310a97-89e2-4c44-a5f4-cc2c9666cbb3 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:13.003894 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-58310a97-89e2-4c44-a5f4-cc2c9666cbb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:39:13.146727 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58310a97-89e2-4c44-a5f4-cc2c9666cbb3 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:13.161907 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea5acd5-b1f0-44fa-be98-80a6b08b824b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b672a6a601584d2d826147069e90a10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:13.162623 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5acd5-b1f0-44fa-be98-80a6b08b824b service swift] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:13.162905 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5acd5-b1f0-44fa-be98-80a6b08b824b service swift] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:13.163175 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5acd5-b1f0-44fa-be98-80a6b08b824b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:13.185419 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea5acd5-b1f0-44fa-be98-80a6b08b824b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:13.193437 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea5acd5-b1f0-44fa-be98-80a6b08b824b service swift] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:13.205701 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1106/2252] 10.222.0.118 () {60 vars in 1389 bytes} [Thu Jul 14 15:39:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 15:39:16.447234 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09941f5a-0721-42fb-bc9a-fe538c980a4d None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:16.449350 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-09941f5a-0721-42fb-bc9a-fe538c980a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:39:16.549319 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09941f5a-0721-42fb-bc9a-fe538c980a4d None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:16.562756 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b34384-adb9-4440-ad58-3550a486aea1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea647438ea1c438987f28cbe39c3ff2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:16.565376 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b34384-adb9-4440-ad58-3550a486aea1 service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:16.565764 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b34384-adb9-4440-ad58-3550a486aea1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:16.566621 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b34384-adb9-4440-ad58-3550a486aea1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:16.569524 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-49b34384-adb9-4440-ad58-3550a486aea1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:39:16.677515 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:16.704710 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b34384-adb9-4440-ad58-3550a486aea1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:16.714876 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b34384-adb9-4440-ad58-3550a486aea1 service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:16.755050 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1147/2253] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:39:16 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:39:22.160273 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50c67c0-0419-44fb-93b5-99da9b99e769 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:22.160853 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50c67c0-0419-44fb-93b5-99da9b99e769 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:22.160853 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50c67c0-0419-44fb-93b5-99da9b99e769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:22.204093 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-d50c67c0-0419-44fb-93b5-99da9b99e769 None None] MFA Rules not processed for user `a550c98bfc824a71b9cbcf4ece937cbe`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:39:22.205350 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-d50c67c0-0419-44fb-93b5-99da9b99e769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:39:22.418132 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:22.476350 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1107/2254] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:39:22 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:39:22.491774 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b34384-adb9-4440-ad58-3550a486aea1 service cinder] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:22.496368 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-49b34384-adb9-4440-ad58-3550a486aea1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:39:22.632444 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b34384-adb9-4440-ad58-3550a486aea1 service cinder] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:22.644038 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42c1441-3d82-41bd-acf4-467e2bf61acb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4336c3d678a4d33b00885def42dfb1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:22.644631 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42c1441-3d82-41bd-acf4-467e2bf61acb service glance] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:22.644913 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42c1441-3d82-41bd-acf4-467e2bf61acb service glance] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:22.645191 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42c1441-3d82-41bd-acf4-467e2bf61acb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:22.760945 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42c1441-3d82-41bd-acf4-467e2bf61acb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:22.764234 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42c1441-3d82-41bd-acf4-467e2bf61acb service glance] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:22.795801 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1148/2255] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:39:22 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:39:22.961582 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7581a837-6087-4099-87ec-f4ba5f2fc00f None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:22.961840 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7581a837-6087-4099-87ec-f4ba5f2fc00f None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:22.962143 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7581a837-6087-4099-87ec-f4ba5f2fc00f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:23.011720 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-7581a837-6087-4099-87ec-f4ba5f2fc00f None None] MFA Rules not processed for user `f7ad5ae70939416e8157693e02997a58`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:39:23.017301 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-7581a837-6087-4099-87ec-f4ba5f2fc00f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:39:23.038527 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1108/2256] 10.222.0.118 () {58 vars in 1014 bytes} [Thu Jul 14 15:39:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:39:23.063260 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42c1441-3d82-41bd-acf4-467e2bf61acb service glance] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:23.089075 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42c1441-3d82-41bd-acf4-467e2bf61acb service glance] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:23.103670 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e922c54b-c674-4f00-9727-de63322f761c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b672a6a601584d2d826147069e90a10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:23.104801 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e922c54b-c674-4f00-9727-de63322f761c service swift] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:23.106027 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e922c54b-c674-4f00-9727-de63322f761c service swift] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:23.107499 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e922c54b-c674-4f00-9727-de63322f761c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:23.136498 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e922c54b-c674-4f00-9727-de63322f761c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:23.138752 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e922c54b-c674-4f00-9727-de63322f761c service swift] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:23.165875 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1149/2257] 10.222.0.118 () {60 vars in 1389 bytes} [Thu Jul 14 15:39:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 15:39:32.994772 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=11 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:33.164061 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=59 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:36.306375 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c701366f-dc18-4245-b14a-fc6900d173d6 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:36.306929 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c701366f-dc18-4245-b14a-fc6900d173d6 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:36.307026 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c701366f-dc18-4245-b14a-fc6900d173d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:36.325641 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-c701366f-dc18-4245-b14a-fc6900d173d6 None None] MFA Rules not processed for user `c5564b64f20d4b62979cd0eef1b172be`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:39:36.326897 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-c701366f-dc18-4245-b14a-fc6900d173d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:39:36.334409 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1109/2258] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:39:36 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:39:36.458739 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d29024a-cc14-429c-b34b-f2e3a29fb23d None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:36.459307 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d29024a-cc14-429c-b34b-f2e3a29fb23d None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:36.459307 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d29024a-cc14-429c-b34b-f2e3a29fb23d None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:36.460963 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1150/2259] 10.222.0.118 () {54 vars in 926 bytes} [Thu Jul 14 15:39:36 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:39:36.468925 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888d4e4b-5d00-47b2-8d01-e83bfd2d0294 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:36.469263 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888d4e4b-5d00-47b2-8d01-e83bfd2d0294 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:36.469567 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888d4e4b-5d00-47b2-8d01-e83bfd2d0294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:36.491990 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-888d4e4b-5d00-47b2-8d01-e83bfd2d0294 None None] MFA Rules not processed for user `f0177fc696ea40069902803da09f437c`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:39:36.493303 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-888d4e4b-5d00-47b2-8d01-e83bfd2d0294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:39:36.578117 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1110/2260] 10.222.0.118 () {58 vars in 1023 bytes} [Thu Jul 14 15:39:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:39:36.588393 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d29024a-cc14-429c-b34b-f2e3a29fb23d None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:36.590866 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-9d29024a-cc14-429c-b34b-f2e3a29fb23d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:39:36.605670 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d29024a-cc14-429c-b34b-f2e3a29fb23d None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:36.609866 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af1b5a0-b816-42c3-a050-753a2fba8372 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4336c3d678a4d33b00885def42dfb1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:36.610541 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af1b5a0-b816-42c3-a050-753a2fba8372 service glance] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:36.610822 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af1b5a0-b816-42c3-a050-753a2fba8372 service glance] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:36.611097 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af1b5a0-b816-42c3-a050-753a2fba8372 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:36.622379 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af1b5a0-b816-42c3-a050-753a2fba8372 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:36.623806 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af1b5a0-b816-42c3-a050-753a2fba8372 service glance] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:36.634858 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1151/2261] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:39:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:39:36.704608 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b923425-624f-413f-8924-23efbb09fb73 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:36.704929 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b923425-624f-413f-8924-23efbb09fb73 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:36.705208 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b923425-624f-413f-8924-23efbb09fb73 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:36.706841 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1111/2262] 10.222.0.118 () {54 vars in 926 bytes} [Thu Jul 14 15:39:36 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 14 15:39:36.716660 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98015a4d-8f80-43f9-9ccd-ce4d1948518b None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:36.716944 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98015a4d-8f80-43f9-9ccd-ce4d1948518b None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:36.717789 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98015a4d-8f80-43f9-9ccd-ce4d1948518b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:36.736554 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-98015a4d-8f80-43f9-9ccd-ce4d1948518b None None] MFA Rules not processed for user `b650be8114b64df0ac88441f1c50b2cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:39:36.737766 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-98015a4d-8f80-43f9-9ccd-ce4d1948518b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:39:36.790972 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1152/2263] 10.222.0.118 () {58 vars in 1023 bytes} [Thu Jul 14 15:39:36 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:39:36.802636 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b923425-624f-413f-8924-23efbb09fb73 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:36.813654 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b923425-624f-413f-8924-23efbb09fb73 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:36.817149 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851ce28a-7505-4552-8b1d-ee46ddb85676 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b650be8114b64df0ac88441f1c50b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:36.817865 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851ce28a-7505-4552-8b1d-ee46ddb85676 service neutron] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:36.818097 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851ce28a-7505-4552-8b1d-ee46ddb85676 service neutron] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:36.818374 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851ce28a-7505-4552-8b1d-ee46ddb85676 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:36.825922 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851ce28a-7505-4552-8b1d-ee46ddb85676 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:36.827376 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851ce28a-7505-4552-8b1d-ee46ddb85676 service neutron] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:36.835306 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1112/2264] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:39:36 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:39:36.924305 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c25e31f-cefc-4d4b-8343-410d7defafb0 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:36.924914 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c25e31f-cefc-4d4b-8343-410d7defafb0 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:36.925388 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c25e31f-cefc-4d4b-8343-410d7defafb0 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:36.936349 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1153/2265] 10.222.0.118 () {54 vars in 926 bytes} [Thu Jul 14 15:39:36 2022] GET /identity => generated 271 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:39:36.942073 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913668ca-bf57-4b88-8532-b5fc4bb51fe7 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:36.942631 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913668ca-bf57-4b88-8532-b5fc4bb51fe7 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:36.943140 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913668ca-bf57-4b88-8532-b5fc4bb51fe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:36.975877 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-913668ca-bf57-4b88-8532-b5fc4bb51fe7 None None] MFA Rules not processed for user `f0177fc696ea40069902803da09f437c`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:39:36.977333 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-913668ca-bf57-4b88-8532-b5fc4bb51fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:39:37.004838 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1113/2266] 10.222.0.118 () {58 vars in 1023 bytes} [Thu Jul 14 15:39:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:39:37.016113 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c25e31f-cefc-4d4b-8343-410d7defafb0 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:37.030211 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c25e31f-cefc-4d4b-8343-410d7defafb0 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:37.033921 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75470d12-236e-4af8-9bba-046e6cf19b27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b650be8114b64df0ac88441f1c50b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:37.034723 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75470d12-236e-4af8-9bba-046e6cf19b27 service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:37.035001 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75470d12-236e-4af8-9bba-046e6cf19b27 service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:37.035275 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75470d12-236e-4af8-9bba-046e6cf19b27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:37.046446 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75470d12-236e-4af8-9bba-046e6cf19b27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:37.047881 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75470d12-236e-4af8-9bba-046e6cf19b27 service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:37.059078 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1154/2267] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:39:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:39:38.320634 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9affd0-2d78-49d4-9d2e-a0a5a2488a07 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:38.321143 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9affd0-2d78-49d4-9d2e-a0a5a2488a07 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:38.321409 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9affd0-2d78-49d4-9d2e-a0a5a2488a07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:38.346929 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-eb9affd0-2d78-49d4-9d2e-a0a5a2488a07 None None] MFA Rules not processed for user `f7ad5ae70939416e8157693e02997a58`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:39:38.348323 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-eb9affd0-2d78-49d4-9d2e-a0a5a2488a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:39:38.362994 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1114/2268] 10.222.0.118 () {58 vars in 1014 bytes} [Thu Jul 14 15:39:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:39:38.377177 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75470d12-236e-4af8-9bba-046e6cf19b27 service neutron] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:38.393932 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75470d12-236e-4af8-9bba-046e6cf19b27 service neutron] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:38.406260 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acbe449-c0ac-4382-81c5-aeac83ccdb67 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b672a6a601584d2d826147069e90a10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:38.407850 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acbe449-c0ac-4382-81c5-aeac83ccdb67 service swift] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:38.408504 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acbe449-c0ac-4382-81c5-aeac83ccdb67 service swift] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:38.408933 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acbe449-c0ac-4382-81c5-aeac83ccdb67 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:38.423441 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acbe449-c0ac-4382-81c5-aeac83ccdb67 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:38.425538 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acbe449-c0ac-4382-81c5-aeac83ccdb67 service swift] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:38.440549 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1155/2269] 10.222.0.118 () {60 vars in 1389 bytes} [Thu Jul 14 15:39:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 15:39:44.089115 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9affd0-2d78-49d4-9d2e-a0a5a2488a07 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:44.091150 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-eb9affd0-2d78-49d4-9d2e-a0a5a2488a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:39:44.253423 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9affd0-2d78-49d4-9d2e-a0a5a2488a07 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:44.259076 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484cc425-c42e-405e-904e-91e699d5ef25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:44.260016 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484cc425-c42e-405e-904e-91e699d5ef25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:44.260308 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484cc425-c42e-405e-904e-91e699d5ef25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:44.260626 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484cc425-c42e-405e-904e-91e699d5ef25 admin admin] PATH_INFO: `/v3/users/350ecd5926a749c29476b2c4fabbd716` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:44.261912 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484cc425-c42e-405e-904e-91e699d5ef25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=350ecd5926a749c29476b2c4fabbd716)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:44.264258 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484cc425-c42e-405e-904e-91e699d5ef25 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:44.332573 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-484cc425-c42e-405e-904e-91e699d5ef25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '350ecd5926a749c29476b2c4fabbd716'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:44.340230 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-484cc425-c42e-405e-904e-91e699d5ef25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '350ecd5926a749c29476b2c4fabbd716'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:44.341128 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-484cc425-c42e-405e-904e-91e699d5ef25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '350ecd5926a749c29476b2c4fabbd716'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:44.341810 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-484cc425-c42e-405e-904e-91e699d5ef25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '350ecd5926a749c29476b2c4fabbd716'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:44.347370 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:44.357936 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-484cc425-c42e-405e-904e-91e699d5ef25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '350ecd5926a749c29476b2c4fabbd716'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:44.372101 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1115/2270] 10.222.0.118 () {58 vars in 1228 bytes} [Thu Jul 14 15:39:44 2022] DELETE /identity/v3/users/350ecd5926a749c29476b2c4fabbd716 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:39:44.593361 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acbe449-c0ac-4382-81c5-aeac83ccdb67 service swift] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:44.605364 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acbe449-c0ac-4382-81c5-aeac83ccdb67 service swift] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:44.696244 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74699af4-7dd5-4388-853a-84f1cb1586f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:44.697037 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74699af4-7dd5-4388-853a-84f1cb1586f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:44.697317 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74699af4-7dd5-4388-853a-84f1cb1586f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:44.697595 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74699af4-7dd5-4388-853a-84f1cb1586f0 admin admin] PATH_INFO: `/v3/projects/0738f614aba64ae187dc04aaa4fb46d4` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:44.698978 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74699af4-7dd5-4388-853a-84f1cb1586f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0738f614aba64ae187dc04aaa4fb46d4)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:44.700956 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74699af4-7dd5-4388-853a-84f1cb1586f0 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:44.762249 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-74699af4-7dd5-4388-853a-84f1cb1586f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0738f614aba64ae187dc04aaa4fb46d4', 'request_id': 'req-74699af4-7dd5-4388-853a-84f1cb1586f0'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:44.772276 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-74699af4-7dd5-4388-853a-84f1cb1586f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0738f614aba64ae187dc04aaa4fb46d4', 'request_id': 'req-74699af4-7dd5-4388-853a-84f1cb1586f0'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:44.789699 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-74699af4-7dd5-4388-853a-84f1cb1586f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0738f614aba64ae187dc04aaa4fb46d4', 'request_id': 'req-74699af4-7dd5-4388-853a-84f1cb1586f0'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:44.803580 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:44.810850 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-74699af4-7dd5-4388-853a-84f1cb1586f0 admin admin] The token cache is being invalidate because project 0738f614aba64ae187dc04aaa4fb46d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:39:44.811399 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-74699af4-7dd5-4388-853a-84f1cb1586f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:44.812537 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-74699af4-7dd5-4388-853a-84f1cb1586f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:44.817563 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1156/2271] 10.222.0.118 () {58 vars in 1237 bytes} [Thu Jul 14 15:39:44 2022] DELETE /identity/v3/projects/0738f614aba64ae187dc04aaa4fb46d4 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:39:44.818803 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484cc425-c42e-405e-904e-91e699d5ef25 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:44.820433 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-484cc425-c42e-405e-904e-91e699d5ef25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:39:44.836862 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484cc425-c42e-405e-904e-91e699d5ef25 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:44.914152 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d8963c-9831-401e-aa8f-582bd150be04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:44.915027 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d8963c-9831-401e-aa8f-582bd150be04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:44.915303 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d8963c-9831-401e-aa8f-582bd150be04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:44.915579 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d8963c-9831-401e-aa8f-582bd150be04 admin admin] PATH_INFO: `/v3/users/4c84446748054a5d96c7bab031c18184` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:44.916920 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d8963c-9831-401e-aa8f-582bd150be04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c84446748054a5d96c7bab031c18184)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:44.918909 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d8963c-9831-401e-aa8f-582bd150be04 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:44.970343 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-35d8963c-9831-401e-aa8f-582bd150be04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c84446748054a5d96c7bab031c18184'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:44.978676 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-35d8963c-9831-401e-aa8f-582bd150be04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c84446748054a5d96c7bab031c18184'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:44.979803 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-35d8963c-9831-401e-aa8f-582bd150be04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c84446748054a5d96c7bab031c18184'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:44.980588 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-35d8963c-9831-401e-aa8f-582bd150be04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c84446748054a5d96c7bab031c18184'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:44.998755 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-35d8963c-9831-401e-aa8f-582bd150be04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c84446748054a5d96c7bab031c18184'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:45.012559 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1116/2272] 10.222.0.118 () {58 vars in 1228 bytes} [Thu Jul 14 15:39:44 2022] DELETE /identity/v3/users/4c84446748054a5d96c7bab031c18184 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:39:45.217332 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74699af4-7dd5-4388-853a-84f1cb1586f0 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:45.219276 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-74699af4-7dd5-4388-853a-84f1cb1586f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:39:45.234980 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74699af4-7dd5-4388-853a-84f1cb1586f0 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:45.338728 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c39c5c3-f118-43ee-8fad-51addf813329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:45.339836 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c39c5c3-f118-43ee-8fad-51addf813329 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:45.340667 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c39c5c3-f118-43ee-8fad-51addf813329 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:45.341157 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c39c5c3-f118-43ee-8fad-51addf813329 admin admin] PATH_INFO: `/v3/projects/1a7f6bdc33164ba98473d3713eb5c6aa` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:45.343098 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c39c5c3-f118-43ee-8fad-51addf813329 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a7f6bdc33164ba98473d3713eb5c6aa)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:45.345154 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c39c5c3-f118-43ee-8fad-51addf813329 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:45.466180 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-9c39c5c3-f118-43ee-8fad-51addf813329 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a7f6bdc33164ba98473d3713eb5c6aa', 'request_id': 'req-9c39c5c3-f118-43ee-8fad-51addf813329'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:45.472257 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-9c39c5c3-f118-43ee-8fad-51addf813329 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a7f6bdc33164ba98473d3713eb5c6aa', 'request_id': 'req-9c39c5c3-f118-43ee-8fad-51addf813329'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:45.480157 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-9c39c5c3-f118-43ee-8fad-51addf813329 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a7f6bdc33164ba98473d3713eb5c6aa', 'request_id': 'req-9c39c5c3-f118-43ee-8fad-51addf813329'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:45.501887 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-9c39c5c3-f118-43ee-8fad-51addf813329 admin admin] The token cache is being invalidate because project 1a7f6bdc33164ba98473d3713eb5c6aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:39:45.502283 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-9c39c5c3-f118-43ee-8fad-51addf813329 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:45.503983 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-9c39c5c3-f118-43ee-8fad-51addf813329 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:45.506533 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1157/2273] 10.222.0.118 () {58 vars in 1237 bytes} [Thu Jul 14 15:39:45 2022] DELETE /identity/v3/projects/1a7f6bdc33164ba98473d3713eb5c6aa => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:39:45.511157 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd32ce72-2450-4593-af5d-fdcdbdf58c11 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:45.511773 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd32ce72-2450-4593-af5d-fdcdbdf58c11 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:45.511999 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd32ce72-2450-4593-af5d-fdcdbdf58c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:45.538293 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-fd32ce72-2450-4593-af5d-fdcdbdf58c11 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:39:45.539887 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-fd32ce72-2450-4593-af5d-fdcdbdf58c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:39:45.658274 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:45.676108 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1117/2274] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:39:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:39:45.744604 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60d1ecb-cb7f-4e7c-a1a3-81e9ecbe7be6 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:45.745551 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60d1ecb-cb7f-4e7c-a1a3-81e9ecbe7be6 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:45.746105 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60d1ecb-cb7f-4e7c-a1a3-81e9ecbe7be6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:45.768659 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-c60d1ecb-cb7f-4e7c-a1a3-81e9ecbe7be6 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:39:45.769829 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-c60d1ecb-cb7f-4e7c-a1a3-81e9ecbe7be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:39:45.781735 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1158/2275] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:39:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:39:45.783284 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd32ce72-2450-4593-af5d-fdcdbdf58c11 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:45.800333 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd32ce72-2450-4593-af5d-fdcdbdf58c11 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:45.805390 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5364e0ce-c690-4767-a4a4-cef671e11194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:45.806086 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5364e0ce-c690-4767-a4a4-cef671e11194 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:45.806394 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5364e0ce-c690-4767-a4a4-cef671e11194 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:45.806669 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5364e0ce-c690-4767-a4a4-cef671e11194 admin admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:45.807414 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5364e0ce-c690-4767-a4a4-cef671e11194 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:39:45.807719 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5364e0ce-c690-4767-a4a4-cef671e11194 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:45.809432 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5364e0ce-c690-4767-a4a4-cef671e11194 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:45.821909 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1118/2276] 10.222.0.118 () {58 vars in 1157 bytes} [Thu Jul 14 15:39:45 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:39:45.826869 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60d1ecb-cb7f-4e7c-a1a3-81e9ecbe7be6 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:45.836439 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60d1ecb-cb7f-4e7c-a1a3-81e9ecbe7be6 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:45.841858 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff42b2ae-3875-462e-9e41-da4481351b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:45.842571 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff42b2ae-3875-462e-9e41-da4481351b70 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:45.842853 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff42b2ae-3875-462e-9e41-da4481351b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:45.843124 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff42b2ae-3875-462e-9e41-da4481351b70 admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:45.843825 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff42b2ae-3875-462e-9e41-da4481351b70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:45.845739 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff42b2ae-3875-462e-9e41-da4481351b70 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:45.873227 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1159/2277] 10.222.0.118 () {60 vars in 1157 bytes} [Thu Jul 14 15:39:45 2022] POST /identity/v3/projects => generated 382 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:39:45.877489 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5364e0ce-c690-4767-a4a4-cef671e11194 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:45.888567 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5364e0ce-c690-4767-a4a4-cef671e11194 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:45.952230 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e1d688-ec17-49fb-b0c8-4df8a868306c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:45.952904 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e1d688-ec17-49fb-b0c8-4df8a868306c admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:45.953181 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e1d688-ec17-49fb-b0c8-4df8a868306c admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:45.953454 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e1d688-ec17-49fb-b0c8-4df8a868306c admin admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:45.954177 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e1d688-ec17-49fb-b0c8-4df8a868306c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:45.956150 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e1d688-ec17-49fb-b0c8-4df8a868306c admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:45.987942 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1119/2278] 10.222.0.118 () {60 vars in 1148 bytes} [Thu Jul 14 15:39:45 2022] POST /identity/v3/users => generated 292 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:39:45.988635 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff42b2ae-3875-462e-9e41-da4481351b70 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:46.000792 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff42b2ae-3875-462e-9e41-da4481351b70 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:46.005412 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a357032-a865-4d18-b8d3-7a243dc6a249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:46.006133 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a357032-a865-4d18-b8d3-7a243dc6a249 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:46.006410 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a357032-a865-4d18-b8d3-7a243dc6a249 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:46.006680 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a357032-a865-4d18-b8d3-7a243dc6a249 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:46.007403 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a357032-a865-4d18-b8d3-7a243dc6a249 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:46.008990 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a357032-a865-4d18-b8d3-7a243dc6a249 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:46.021888 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1160/2279] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:39:45 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:39:46.026254 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e1d688-ec17-49fb-b0c8-4df8a868306c admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:46.037440 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e1d688-ec17-49fb-b0c8-4df8a868306c admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:46.042129 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2fda72-de43-45a8-b89e-048eca98a34a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:46.042793 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2fda72-de43-45a8-b89e-048eca98a34a admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:46.043079 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2fda72-de43-45a8-b89e-048eca98a34a admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:46.043408 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2fda72-de43-45a8-b89e-048eca98a34a admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:46.044148 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2fda72-de43-45a8-b89e-048eca98a34a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:46.045769 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2fda72-de43-45a8-b89e-048eca98a34a admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:46.056803 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1120/2280] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:39:46 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:39:46.062282 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a357032-a865-4d18-b8d3-7a243dc6a249 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:46.075738 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a357032-a865-4d18-b8d3-7a243dc6a249 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:46.080740 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d4b930-09a9-4507-8f50-45ee9137f741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:46.081922 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d4b930-09a9-4507-8f50-45ee9137f741 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:46.082456 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d4b930-09a9-4507-8f50-45ee9137f741 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:46.083050 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d4b930-09a9-4507-8f50-45ee9137f741 admin admin] PATH_INFO: `/v3/projects/60609d474b2c47f597068596158670cf/users/0a16c4c6af304e1d95351905f454172f/roles/4abcf5e5e7cd4b53ae1828fec6550d53` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:46.100205 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d4b930-09a9-4507-8f50-45ee9137f741 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60609d474b2c47f597068596158670cf, user_id=0a16c4c6af304e1d95351905f454172f, role_id=4abcf5e5e7cd4b53ae1828fec6550d53)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:46.102982 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d4b930-09a9-4507-8f50-45ee9137f741 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:46.119503 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1161/2281] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:39:46 2022] PUT /identity/v3/projects/60609d474b2c47f597068596158670cf/users/0a16c4c6af304e1d95351905f454172f/roles/4abcf5e5e7cd4b53ae1828fec6550d53 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:39:46.125492 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd56577f-574b-40c0-a518-987a3483d5df None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:46.125822 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd56577f-574b-40c0-a518-987a3483d5df None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:46.126119 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd56577f-574b-40c0-a518-987a3483d5df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:46.145250 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-fd56577f-574b-40c0-a518-987a3483d5df None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:39:46.146501 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-fd56577f-574b-40c0-a518-987a3483d5df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:39:46.212262 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1121/2282] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:39:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:39:46.222215 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d4b930-09a9-4507-8f50-45ee9137f741 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:46.223936 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-78d4b930-09a9-4507-8f50-45ee9137f741 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:39:46.258608 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:46.288414 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d4b930-09a9-4507-8f50-45ee9137f741 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:46.292520 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c23e88c-264c-4ad8-b29b-f34aa79d5b5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b650be8114b64df0ac88441f1c50b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:46.293176 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c23e88c-264c-4ad8-b29b-f34aa79d5b5f service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:46.293486 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c23e88c-264c-4ad8-b29b-f34aa79d5b5f service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:46.293759 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c23e88c-264c-4ad8-b29b-f34aa79d5b5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:46.305564 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c23e88c-264c-4ad8-b29b-f34aa79d5b5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:46.307049 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c23e88c-264c-4ad8-b29b-f34aa79d5b5f service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:46.318808 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1162/2283] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:39:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:39:47.226744 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f17cda-64e5-410d-92e2-05b8440121c3 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:47.227387 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f17cda-64e5-410d-92e2-05b8440121c3 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:47.227387 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f17cda-64e5-410d-92e2-05b8440121c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:47.281169 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-64f17cda-64e5-410d-92e2-05b8440121c3 None None] MFA Rules not processed for user `0a16c4c6af304e1d95351905f454172f`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:39:47.283935 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-64f17cda-64e5-410d-92e2-05b8440121c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:39:47.399507 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:47.413047 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1122/2284] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:39:47 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:39:47.425262 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c23e88c-264c-4ad8-b29b-f34aa79d5b5f service neutron] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:47.426726 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-5c23e88c-264c-4ad8-b29b-f34aa79d5b5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:39:47.510395 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c23e88c-264c-4ad8-b29b-f34aa79d5b5f service neutron] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:47.515130 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195291a6-db1e-47e6-8194-0717c2d53103 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea647438ea1c438987f28cbe39c3ff2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:47.519910 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195291a6-db1e-47e6-8194-0717c2d53103 service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:47.520566 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195291a6-db1e-47e6-8194-0717c2d53103 service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:47.521023 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195291a6-db1e-47e6-8194-0717c2d53103 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:47.531428 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195291a6-db1e-47e6-8194-0717c2d53103 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:47.533190 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195291a6-db1e-47e6-8194-0717c2d53103 service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:47.544303 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1163/2285] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:39:47 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:39:49.047495 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7699d1-2fad-4c0e-920a-60575e4347a6 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:49.048042 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7699d1-2fad-4c0e-920a-60575e4347a6 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:49.048042 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7699d1-2fad-4c0e-920a-60575e4347a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:49.076228 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-6f7699d1-2fad-4c0e-920a-60575e4347a6 None None] MFA Rules not processed for user `0a16c4c6af304e1d95351905f454172f`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:39:49.077487 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-6f7699d1-2fad-4c0e-920a-60575e4347a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:39:49.088796 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1123/2286] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:39:49 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:39:50.381847 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195291a6-db1e-47e6-8194-0717c2d53103 service cinder] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:50.383380 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-195291a6-db1e-47e6-8194-0717c2d53103 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:39:50.473837 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195291a6-db1e-47e6-8194-0717c2d53103 service cinder] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:50.480277 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850fc7a1-560d-4cd4-baae-e0416ab4b04c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b0f8be7e04adca6e3f218fbe3a295', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:50.480940 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850fc7a1-560d-4cd4-baae-e0416ab4b04c service placement] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:50.481219 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850fc7a1-560d-4cd4-baae-e0416ab4b04c service placement] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:50.481552 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850fc7a1-560d-4cd4-baae-e0416ab4b04c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:50.484346 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-850fc7a1-560d-4cd4-baae-e0416ab4b04c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:39:50.505181 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850fc7a1-560d-4cd4-baae-e0416ab4b04c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:50.507015 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850fc7a1-560d-4cd4-baae-e0416ab4b04c service placement] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:50.526580 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1164/2287] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:39:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:39:50.849462 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfff8d7-cf48-4f95-a8a2-01c06d452da0 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:50.849939 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfff8d7-cf48-4f95-a8a2-01c06d452da0 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:50.851006 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfff8d7-cf48-4f95-a8a2-01c06d452da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:50.872755 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-2bfff8d7-cf48-4f95-a8a2-01c06d452da0 None None] MFA Rules not processed for user `f7ad5ae70939416e8157693e02997a58`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:39:50.874123 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-2bfff8d7-cf48-4f95-a8a2-01c06d452da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:39:50.930619 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1124/2288] 10.222.0.118 () {58 vars in 1014 bytes} [Thu Jul 14 15:39:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:39:50.942601 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850fc7a1-560d-4cd4-baae-e0416ab4b04c service placement] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:50.944152 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-850fc7a1-560d-4cd4-baae-e0416ab4b04c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:39:51.017768 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:51.022644 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850fc7a1-560d-4cd4-baae-e0416ab4b04c service placement] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:51.027971 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1639daf5-8870-437e-b659-05b24821a939 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b672a6a601584d2d826147069e90a10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:51.028627 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1639daf5-8870-437e-b659-05b24821a939 service swift] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:51.028907 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1639daf5-8870-437e-b659-05b24821a939 service swift] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:51.029806 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1639daf5-8870-437e-b659-05b24821a939 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:51.038185 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1639daf5-8870-437e-b659-05b24821a939 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:51.039803 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1639daf5-8870-437e-b659-05b24821a939 service swift] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:51.047900 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1165/2289] 10.222.0.118 () {60 vars in 1389 bytes} [Thu Jul 14 15:39:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 15:40:00.923817 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=31 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:40:01.044625 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=4 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:40:11.579373 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4331bf-694f-4e31-a9e0-86bcdded2134 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:11.580276 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4331bf-694f-4e31-a9e0-86bcdded2134 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:11.580706 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4331bf-694f-4e31-a9e0-86bcdded2134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:11.610177 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-dd4331bf-694f-4e31-a9e0-86bcdded2134 None None] MFA Rules not processed for user `f7ad5ae70939416e8157693e02997a58`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:40:11.611405 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-dd4331bf-694f-4e31-a9e0-86bcdded2134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:11.618966 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1125/2290] 10.222.0.118 () {58 vars in 972 bytes} [Thu Jul 14 15:40:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:40:11.632084 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1639daf5-8870-437e-b659-05b24821a939 service swift] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:11.644529 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1639daf5-8870-437e-b659-05b24821a939 service swift] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:11.649918 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f2a4ce-3e8c-4ea0-993e-5a7fab718d41 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b672a6a601584d2d826147069e90a10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:11.650590 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f2a4ce-3e8c-4ea0-993e-5a7fab718d41 service swift] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:11.651033 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f2a4ce-3e8c-4ea0-993e-5a7fab718d41 service swift] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:11.651313 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f2a4ce-3e8c-4ea0-993e-5a7fab718d41 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:11.665088 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f2a4ce-3e8c-4ea0-993e-5a7fab718d41 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:11.665088 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f2a4ce-3e8c-4ea0-993e-5a7fab718d41 service swift] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:11.685686 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1166/2291] 10.222.0.118 () {60 vars in 1389 bytes} [Thu Jul 14 15:40:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 15:40:13.784159 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4331bf-694f-4e31-a9e0-86bcdded2134 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:13.807673 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4331bf-694f-4e31-a9e0-86bcdded2134 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:13.820140 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcdec1d-15cd-423d-aef9-6aa45dddd584 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b650be8114b64df0ac88441f1c50b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:13.820991 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcdec1d-15cd-423d-aef9-6aa45dddd584 service neutron] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:13.821273 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcdec1d-15cd-423d-aef9-6aa45dddd584 service neutron] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:13.821551 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcdec1d-15cd-423d-aef9-6aa45dddd584 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:13.823921 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-1fcdec1d-15cd-423d-aef9-6aa45dddd584 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:13.951688 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcdec1d-15cd-423d-aef9-6aa45dddd584 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:13.953564 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcdec1d-15cd-423d-aef9-6aa45dddd584 service neutron] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:13.974966 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1126/2292] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:40:13 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:40:21.671758 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=6 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:40:23.960386 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=33 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:40:24.988489 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46902b99-4bc3-4ca0-8b7d-463b58739ff5 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:24.989030 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46902b99-4bc3-4ca0-8b7d-463b58739ff5 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:24.989030 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46902b99-4bc3-4ca0-8b7d-463b58739ff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:25.006960 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-46902b99-4bc3-4ca0-8b7d-463b58739ff5 None None] MFA Rules not processed for user `34f09b2afbe54a6ab1ba27292bc5a964`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:40:25.008166 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-46902b99-4bc3-4ca0-8b7d-463b58739ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:25.070026 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1167/2293] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:40:24 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:40:35.056717 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=25 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:40:37.439418 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adf9c25-aba5-4e05-8c18-a1496d043a2b None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:37.439987 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adf9c25-aba5-4e05-8c18-a1496d043a2b None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:37.439987 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adf9c25-aba5-4e05-8c18-a1496d043a2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:37.457221 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-6adf9c25-aba5-4e05-8c18-a1496d043a2b None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:40:37.458466 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-6adf9c25-aba5-4e05-8c18-a1496d043a2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:37.466326 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1127/2294] 10.222.0.55 () {58 vars in 1020 bytes} [Thu Jul 14 15:40:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:40:37.481597 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46902b99-4bc3-4ca0-8b7d-463b58739ff5 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:37.483191 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-46902b99-4bc3-4ca0-8b7d-463b58739ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:37.560080 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46902b99-4bc3-4ca0-8b7d-463b58739ff5 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:37.566386 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa79203-d073-44b6-ba2e-f6fc0d3e9919 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0177fc696ea40069902803da09f437c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:37.567709 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa79203-d073-44b6-ba2e-f6fc0d3e9919 service nova] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:37.567709 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa79203-d073-44b6-ba2e-f6fc0d3e9919 service nova] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:37.567954 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa79203-d073-44b6-ba2e-f6fc0d3e9919 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:37.576751 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa79203-d073-44b6-ba2e-f6fc0d3e9919 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:37.578471 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa79203-d073-44b6-ba2e-f6fc0d3e9919 service nova] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:37.588750 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1168/2295] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:40:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:40:41.518279 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d27d90-f371-4031-97be-4fae7c7ad36f None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:41.518833 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d27d90-f371-4031-97be-4fae7c7ad36f None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:41.518833 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d27d90-f371-4031-97be-4fae7c7ad36f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:41.536938 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-18d27d90-f371-4031-97be-4fae7c7ad36f None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:40:41.538197 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-18d27d90-f371-4031-97be-4fae7c7ad36f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:41.546259 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1128/2296] 10.222.0.55 () {58 vars in 1020 bytes} [Thu Jul 14 15:40:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:40:41.560581 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa79203-d073-44b6-ba2e-f6fc0d3e9919 service nova] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:41.572180 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa79203-d073-44b6-ba2e-f6fc0d3e9919 service nova] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:41.577699 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea23b1d-660f-40c1-a958-a740b10d5b23 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0177fc696ea40069902803da09f437c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:41.578383 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea23b1d-660f-40c1-a958-a740b10d5b23 service nova] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:41.578669 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea23b1d-660f-40c1-a958-a740b10d5b23 service nova] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:41.579589 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea23b1d-660f-40c1-a958-a740b10d5b23 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:41.587860 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea23b1d-660f-40c1-a958-a740b10d5b23 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:41.589442 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea23b1d-660f-40c1-a958-a740b10d5b23 service nova] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:41.600480 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1169/2297] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:40:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:40:42.113946 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5330c6-5d3e-4271-8ead-91d219b8b567 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:42.114368 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5330c6-5d3e-4271-8ead-91d219b8b567 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:42.114720 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5330c6-5d3e-4271-8ead-91d219b8b567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:42.135691 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-8c5330c6-5d3e-4271-8ead-91d219b8b567 None None] MFA Rules not processed for user `4c4a0889c40248808900619987f7d6fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:40:42.136995 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-8c5330c6-5d3e-4271-8ead-91d219b8b567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:42.194278 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1129/2298] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:40:42 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:40:45.801855 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df155c-054b-4729-8d76-fa3cbf65b487 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:45.802470 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df155c-054b-4729-8d76-fa3cbf65b487 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:45.802470 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df155c-054b-4729-8d76-fa3cbf65b487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:45.820846 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-e8df155c-054b-4729-8d76-fa3cbf65b487 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:40:45.822095 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-e8df155c-054b-4729-8d76-fa3cbf65b487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:45.829831 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1170/2299] 10.222.0.55 () {58 vars in 1020 bytes} [Thu Jul 14 15:40:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:40:45.846739 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5330c6-5d3e-4271-8ead-91d219b8b567 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:45.859588 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5330c6-5d3e-4271-8ead-91d219b8b567 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:45.865586 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11853443-ad72-47f6-97b4-932974abb68e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0177fc696ea40069902803da09f437c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:45.866260 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11853443-ad72-47f6-97b4-932974abb68e service nova] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:45.866548 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11853443-ad72-47f6-97b4-932974abb68e service nova] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:45.866825 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11853443-ad72-47f6-97b4-932974abb68e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:45.875296 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11853443-ad72-47f6-97b4-932974abb68e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:45.877499 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11853443-ad72-47f6-97b4-932974abb68e service nova] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:45.887375 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1130/2300] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:40:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:40:49.899067 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2427e69-b753-45d7-8e09-b89e98c428f0 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:49.899658 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2427e69-b753-45d7-8e09-b89e98c428f0 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:49.899658 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2427e69-b753-45d7-8e09-b89e98c428f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:49.921729 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-e2427e69-b753-45d7-8e09-b89e98c428f0 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:40:49.923658 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-e2427e69-b753-45d7-8e09-b89e98c428f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:49.934949 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1171/2301] 10.222.0.55 () {58 vars in 1020 bytes} [Thu Jul 14 15:40:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:40:49.950354 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11853443-ad72-47f6-97b4-932974abb68e service nova] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:49.962425 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11853443-ad72-47f6-97b4-932974abb68e service nova] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:49.971440 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8187828-8e94-4dc7-bf2e-995fd7e583f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0177fc696ea40069902803da09f437c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:49.972805 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8187828-8e94-4dc7-bf2e-995fd7e583f0 service nova] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:49.973170 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8187828-8e94-4dc7-bf2e-995fd7e583f0 service nova] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:49.973530 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8187828-8e94-4dc7-bf2e-995fd7e583f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:49.987583 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8187828-8e94-4dc7-bf2e-995fd7e583f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:49.989535 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8187828-8e94-4dc7-bf2e-995fd7e583f0 service nova] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:50.000602 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1131/2302] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:40:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:40:54.237229 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105dcc72-4bb1-44ac-8b1d-ca709a2fc2fd None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:54.237711 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105dcc72-4bb1-44ac-8b1d-ca709a2fc2fd None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:54.237711 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105dcc72-4bb1-44ac-8b1d-ca709a2fc2fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:54.256600 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-105dcc72-4bb1-44ac-8b1d-ca709a2fc2fd None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:40:54.257810 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-105dcc72-4bb1-44ac-8b1d-ca709a2fc2fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:54.265824 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1172/2303] 10.222.0.55 () {58 vars in 1020 bytes} [Thu Jul 14 15:40:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:40:54.290409 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8187828-8e94-4dc7-bf2e-995fd7e583f0 service nova] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:54.301997 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8187828-8e94-4dc7-bf2e-995fd7e583f0 service nova] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:54.307425 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fb154d-ad16-4485-ad20-f881e8733059 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0177fc696ea40069902803da09f437c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:54.308059 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb154d-ad16-4485-ad20-f881e8733059 service nova] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:54.308341 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb154d-ad16-4485-ad20-f881e8733059 service nova] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:54.308618 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb154d-ad16-4485-ad20-f881e8733059 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:54.317410 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fb154d-ad16-4485-ad20-f881e8733059 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:54.319056 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fb154d-ad16-4485-ad20-f881e8733059 service nova] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:54.328382 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1132/2304] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:40:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:40:57.407158 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2e345f-0a2d-4497-a8af-e2f4bb6278b4 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:57.407746 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2e345f-0a2d-4497-a8af-e2f4bb6278b4 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:57.407746 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2e345f-0a2d-4497-a8af-e2f4bb6278b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:57.425951 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-ab2e345f-0a2d-4497-a8af-e2f4bb6278b4 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:40:57.427181 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-ab2e345f-0a2d-4497-a8af-e2f4bb6278b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:57.434864 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1173/2305] 10.222.0.55 () {58 vars in 1020 bytes} [Thu Jul 14 15:40:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:40:57.450805 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fb154d-ad16-4485-ad20-f881e8733059 service nova] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:57.452187 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-b2fb154d-ad16-4485-ad20-f881e8733059 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:57.466688 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fb154d-ad16-4485-ad20-f881e8733059 service nova] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:57.473328 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5c50d2-dcb8-4faf-9c7b-552c856e3b69 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0177fc696ea40069902803da09f437c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:57.474083 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c50d2-dcb8-4faf-9c7b-552c856e3b69 service nova] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:57.474276 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c50d2-dcb8-4faf-9c7b-552c856e3b69 service nova] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:57.474549 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c50d2-dcb8-4faf-9c7b-552c856e3b69 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:57.482906 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5c50d2-dcb8-4faf-9c7b-552c856e3b69 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:57.484484 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5c50d2-dcb8-4faf-9c7b-552c856e3b69 service nova] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:57.495217 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1133/2306] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:40:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:41:07.420337 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=52 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:41:07.490069 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=55 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:41:16.103407 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cba1e1-59a3-4c6f-ba32-282650c3e520 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:41:16.103963 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cba1e1-59a3-4c6f-ba32-282650c3e520 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:41:16.104182 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cba1e1-59a3-4c6f-ba32-282650c3e520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:41:16.123573 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-e5cba1e1-59a3-4c6f-ba32-282650c3e520 None None] MFA Rules not processed for user `0a16c4c6af304e1d95351905f454172f`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:41:16.129438 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-e5cba1e1-59a3-4c6f-ba32-282650c3e520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:41:16.137129 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1174/2307] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:41:16 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:41:17.218808 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9309d9-787e-4dd6-a73c-86d19dcb6442 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:41:17.219330 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9309d9-787e-4dd6-a73c-86d19dcb6442 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:41:17.219591 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9309d9-787e-4dd6-a73c-86d19dcb6442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:41:17.238692 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-8b9309d9-787e-4dd6-a73c-86d19dcb6442 None None] MFA Rules not processed for user `bab083ba82d64af391d09c531b8647e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:41:17.240016 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-8b9309d9-787e-4dd6-a73c-86d19dcb6442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:41:17.297514 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1134/2308] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:41:17 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:41:26.117002 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=3 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:41:27.290853 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=25 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:41:30.394042 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e77b1c-de3b-4371-b6d9-5fd4bc5d94e9 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:41:30.395191 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e77b1c-de3b-4371-b6d9-5fd4bc5d94e9 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:41:30.395710 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e77b1c-de3b-4371-b6d9-5fd4bc5d94e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:41:30.415300 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-f1e77b1c-de3b-4371-b6d9-5fd4bc5d94e9 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:41:30.416875 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-f1e77b1c-de3b-4371-b6d9-5fd4bc5d94e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:41:30.425860 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1175/2309] 10.222.0.55 () {58 vars in 1020 bytes} [Thu Jul 14 15:41:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:41:30.447388 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9309d9-787e-4dd6-a73c-86d19dcb6442 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:41:30.473384 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9309d9-787e-4dd6-a73c-86d19dcb6442 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:41:30.479534 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f93868-6787-4c87-9193-2a3d7525d138 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0177fc696ea40069902803da09f437c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:41:30.480442 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f93868-6787-4c87-9193-2a3d7525d138 service nova] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:41:30.480906 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f93868-6787-4c87-9193-2a3d7525d138 service nova] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:41:30.481350 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f93868-6787-4c87-9193-2a3d7525d138 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:41:30.491118 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f93868-6787-4c87-9193-2a3d7525d138 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:41:30.492722 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f93868-6787-4c87-9193-2a3d7525d138 service nova] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:41:30.504732 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1135/2310] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:41:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:41:33.645188 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90efb5d4-59b9-4e50-be3a-d59f79c56dad None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:41:33.645738 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90efb5d4-59b9-4e50-be3a-d59f79c56dad None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:41:33.645738 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90efb5d4-59b9-4e50-be3a-d59f79c56dad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:41:33.664256 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-90efb5d4-59b9-4e50-be3a-d59f79c56dad None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:41:33.665439 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-90efb5d4-59b9-4e50-be3a-d59f79c56dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:41:33.673773 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1176/2311] 10.222.0.55 () {58 vars in 1020 bytes} [Thu Jul 14 15:41:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:41:33.691019 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f93868-6787-4c87-9193-2a3d7525d138 service nova] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:41:33.702690 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f93868-6787-4c87-9193-2a3d7525d138 service nova] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:41:33.708175 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1f14cb-d97c-4722-8c23-1a78cb80327d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0177fc696ea40069902803da09f437c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:41:33.708821 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1f14cb-d97c-4722-8c23-1a78cb80327d service nova] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:41:33.709105 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1f14cb-d97c-4722-8c23-1a78cb80327d service nova] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:41:33.709377 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1f14cb-d97c-4722-8c23-1a78cb80327d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:41:33.717798 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1f14cb-d97c-4722-8c23-1a78cb80327d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:41:33.719420 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1f14cb-d97c-4722-8c23-1a78cb80327d service nova] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:41:33.730052 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1136/2312] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:41:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:41:37.738366 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b78e4b5-5b65-4061-993e-006853fe6d00 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:41:37.738865 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b78e4b5-5b65-4061-993e-006853fe6d00 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:41:37.739041 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b78e4b5-5b65-4061-993e-006853fe6d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:41:37.759983 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-2b78e4b5-5b65-4061-993e-006853fe6d00 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:41:37.761354 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-2b78e4b5-5b65-4061-993e-006853fe6d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:41:37.770915 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1177/2313] 10.222.0.55 () {58 vars in 1020 bytes} [Thu Jul 14 15:41:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:41:37.797330 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1f14cb-d97c-4722-8c23-1a78cb80327d service nova] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:41:37.808802 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1f14cb-d97c-4722-8c23-1a78cb80327d service nova] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:41:37.814942 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b402cc9a-6726-46d7-8149-14ca5e8ce365 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0177fc696ea40069902803da09f437c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:41:37.815575 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b402cc9a-6726-46d7-8149-14ca5e8ce365 service nova] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:41:37.815852 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b402cc9a-6726-46d7-8149-14ca5e8ce365 service nova] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:41:37.816121 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b402cc9a-6726-46d7-8149-14ca5e8ce365 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:41:37.824419 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b402cc9a-6726-46d7-8149-14ca5e8ce365 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:41:37.826022 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b402cc9a-6726-46d7-8149-14ca5e8ce365 service nova] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:41:37.835737 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1137/2314] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:41:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:41:41.938987 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0ea75a-ae10-416b-95b2-5d452e88f004 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:41:41.939480 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0ea75a-ae10-416b-95b2-5d452e88f004 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:41:41.939676 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0ea75a-ae10-416b-95b2-5d452e88f004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:41:41.959695 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-8e0ea75a-ae10-416b-95b2-5d452e88f004 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:41:41.960916 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-8e0ea75a-ae10-416b-95b2-5d452e88f004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:41:41.969859 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1178/2315] 10.222.0.55 () {58 vars in 1020 bytes} [Thu Jul 14 15:41:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:41:41.983902 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b402cc9a-6726-46d7-8149-14ca5e8ce365 service nova] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:41:41.995508 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b402cc9a-6726-46d7-8149-14ca5e8ce365 service nova] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:41:42.002557 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef1437d-18b3-4830-98f9-5708551aa687 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0177fc696ea40069902803da09f437c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:41:42.003238 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef1437d-18b3-4830-98f9-5708551aa687 service nova] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:41:42.003607 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef1437d-18b3-4830-98f9-5708551aa687 service nova] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:41:42.003885 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef1437d-18b3-4830-98f9-5708551aa687 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:41:42.013682 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef1437d-18b3-4830-98f9-5708551aa687 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:41:42.015256 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef1437d-18b3-4830-98f9-5708551aa687 service nova] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:41:42.025981 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1138/2316] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:41:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:41:42.580283 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b50d1-e1f9-4f42-8d91-64fc12c551e4 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:41:42.580494 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b50d1-e1f9-4f42-8d91-64fc12c551e4 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:41:42.580883 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b50d1-e1f9-4f42-8d91-64fc12c551e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:41:42.598535 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-815b50d1-e1f9-4f42-8d91-64fc12c551e4 None None] MFA Rules not processed for user `d1f95427c9ff4d8287c6ecd33a1a0d2c`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:41:42.599806 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-815b50d1-e1f9-4f42-8d91-64fc12c551e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:41:42.656605 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1179/2317] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:41:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:41:48.191969 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd40d4-0fd1-46d2-9633-5f84cd9eb53b None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:41:48.192433 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd40d4-0fd1-46d2-9633-5f84cd9eb53b None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:41:48.192551 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd40d4-0fd1-46d2-9633-5f84cd9eb53b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:41:48.212008 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-abfd40d4-0fd1-46d2-9633-5f84cd9eb53b None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:41:48.213211 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-abfd40d4-0fd1-46d2-9633-5f84cd9eb53b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:41:48.221637 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1139/2318] 10.222.0.55 () {58 vars in 1020 bytes} [Thu Jul 14 15:41:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:41:48.238168 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815b50d1-e1f9-4f42-8d91-64fc12c551e4 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:41:48.250780 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815b50d1-e1f9-4f42-8d91-64fc12c551e4 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:41:48.256337 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a048a5e-7015-440b-83f9-6a2728fbee37 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0177fc696ea40069902803da09f437c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:41:48.256974 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a048a5e-7015-440b-83f9-6a2728fbee37 service nova] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:41:48.257251 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a048a5e-7015-440b-83f9-6a2728fbee37 service nova] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:41:48.257577 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a048a5e-7015-440b-83f9-6a2728fbee37 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:41:48.265868 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a048a5e-7015-440b-83f9-6a2728fbee37 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:41:48.268071 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a048a5e-7015-440b-83f9-6a2728fbee37 service nova] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:41:48.278194 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1180/2319] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:41:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:41:51.263014 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfd40d4-0fd1-46d2-9633-5f84cd9eb53b None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:41:51.264516 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-abfd40d4-0fd1-46d2-9633-5f84cd9eb53b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:41:51.277244 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfd40d4-0fd1-46d2-9633-5f84cd9eb53b None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:41:51.280772 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4325697c-aac8-4c5b-863e-21e77d3f29a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b650be8114b64df0ac88441f1c50b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:41:51.281414 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4325697c-aac8-4c5b-863e-21e77d3f29a2 service neutron] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:41:51.281756 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4325697c-aac8-4c5b-863e-21e77d3f29a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:41:51.282055 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4325697c-aac8-4c5b-863e-21e77d3f29a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:41:51.283840 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-4325697c-aac8-4c5b-863e-21e77d3f29a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:41:51.299711 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4325697c-aac8-4c5b-863e-21e77d3f29a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:41:51.301242 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4325697c-aac8-4c5b-863e-21e77d3f29a2 service neutron] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:41:51.313879 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1140/2320] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:41:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:41:53.476715 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a048a5e-7015-440b-83f9-6a2728fbee37 service nova] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:41:53.486355 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a048a5e-7015-440b-83f9-6a2728fbee37 service nova] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:41:53.489883 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3ba018-d407-4415-9ff0-bc1c1ab463fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b650be8114b64df0ac88441f1c50b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:41:53.490553 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3ba018-d407-4415-9ff0-bc1c1ab463fb service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:41:53.490831 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3ba018-d407-4415-9ff0-bc1c1ab463fb service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:41:53.491103 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3ba018-d407-4415-9ff0-bc1c1ab463fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:41:53.493110 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-6e3ba018-d407-4415-9ff0-bc1c1ab463fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:41:53.507139 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3ba018-d407-4415-9ff0-bc1c1ab463fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:41:53.508547 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3ba018-d407-4415-9ff0-bc1c1ab463fb service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:41:53.519461 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1181/2321] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:41:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:41:58.575687 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93fd565-a164-4aa1-8d24-8225f4e8caaf None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:41:58.576166 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93fd565-a164-4aa1-8d24-8225f4e8caaf None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:41:58.576301 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93fd565-a164-4aa1-8d24-8225f4e8caaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:41:58.582893 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=34 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:41:58.595509 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-a93fd565-a164-4aa1-8d24-8225f4e8caaf None None] MFA Rules not processed for user `34f09b2afbe54a6ab1ba27292bc5a964`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:41:58.596714 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-a93fd565-a164-4aa1-8d24-8225f4e8caaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:41:58.603563 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1141/2322] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:41:58 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:41:59.518600 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3ba018-d407-4415-9ff0-bc1c1ab463fb service neutron] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:41:59.525276 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=50 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:41:59.532319 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3ba018-d407-4415-9ff0-bc1c1ab463fb service neutron] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:41:59.538677 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c21b56-2f81-4dc6-a938-8fe12b2e48a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0177fc696ea40069902803da09f437c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:41:59.539381 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c21b56-2f81-4dc6-a938-8fe12b2e48a5 service nova] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:41:59.539815 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c21b56-2f81-4dc6-a938-8fe12b2e48a5 service nova] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:41:59.540114 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c21b56-2f81-4dc6-a938-8fe12b2e48a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:41:59.542076 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-75c21b56-2f81-4dc6-a938-8fe12b2e48a5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:41:59.554624 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c21b56-2f81-4dc6-a938-8fe12b2e48a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:41:59.556225 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c21b56-2f81-4dc6-a938-8fe12b2e48a5 service nova] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:41:59.568118 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1182/2323] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:41:59 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:42:06.251092 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c21b56-2f81-4dc6-a938-8fe12b2e48a5 service nova] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:42:06.251800 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93fd565-a164-4aa1-8d24-8225f4e8caaf None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:42:06.266235 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93fd565-a164-4aa1-8d24-8225f4e8caaf None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:42:06.272662 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c21b56-2f81-4dc6-a938-8fe12b2e48a5 service nova] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:42:06.274876 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b51b903-de8a-4a5a-ac1c-adbbdd34d2e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b650be8114b64df0ac88441f1c50b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:42:06.276728 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8c3a7e-9634-4a98-86bc-67095536a191 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b650be8114b64df0ac88441f1c50b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:42:06.277257 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c3a7e-9634-4a98-86bc-67095536a191 service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:06.277547 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c3a7e-9634-4a98-86bc-67095536a191 service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:06.277824 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c3a7e-9634-4a98-86bc-67095536a191 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:06.278037 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b51b903-de8a-4a5a-ac1c-adbbdd34d2e9 service neutron] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:06.278598 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b51b903-de8a-4a5a-ac1c-adbbdd34d2e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:06.284209 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-fd8c3a7e-9634-4a98-86bc-67095536a191 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:42:06.284497 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b51b903-de8a-4a5a-ac1c-adbbdd34d2e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:06.288750 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-2b51b903-de8a-4a5a-ac1c-adbbdd34d2e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:42:06.307286 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8c3a7e-9634-4a98-86bc-67095536a191 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:42:06.309398 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8c3a7e-9634-4a98-86bc-67095536a191 service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:42:06.325550 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b51b903-de8a-4a5a-ac1c-adbbdd34d2e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:42:06.327861 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b51b903-de8a-4a5a-ac1c-adbbdd34d2e9 service neutron] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:42:06.339484 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1183/2324] 10.222.0.118 () {60 vars in 1401 bytes} [Thu Jul 14 15:42:06 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3270 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:42:06.345562 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1142/2325] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:42:06 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:42:08.869156 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8c3a7e-9634-4a98-86bc-67095536a191 service neutron] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:42:08.877882 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8c3a7e-9634-4a98-86bc-67095536a191 service neutron] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:42:08.881645 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596864c1-b556-44af-ad56-3c0a5c60c082 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b650be8114b64df0ac88441f1c50b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:42:08.882315 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596864c1-b556-44af-ad56-3c0a5c60c082 service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:08.882597 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596864c1-b556-44af-ad56-3c0a5c60c082 service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:08.882875 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596864c1-b556-44af-ad56-3c0a5c60c082 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:08.884631 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-596864c1-b556-44af-ad56-3c0a5c60c082 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:42:08.898191 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596864c1-b556-44af-ad56-3c0a5c60c082 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:42:08.899643 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596864c1-b556-44af-ad56-3c0a5c60c082 service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:42:08.917256 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1184/2326] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:42:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:42:12.340789 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd52b2c6-d66d-42bd-82af-ea669a56f654 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:12.341392 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd52b2c6-d66d-42bd-82af-ea669a56f654 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:12.341392 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd52b2c6-d66d-42bd-82af-ea669a56f654 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:12.344151 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1143/2327] 10.222.0.118 () {54 vars in 926 bytes} [Thu Jul 14 15:42:12 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:42:12.358230 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ba3a06-c5c6-4955-9032-d728558a6544 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:12.358835 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ba3a06-c5c6-4955-9032-d728558a6544 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:12.359116 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ba3a06-c5c6-4955-9032-d728558a6544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:12.388850 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd52b2c6-d66d-42bd-82af-ea669a56f654 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:42:12.391562 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-d7ba3a06-c5c6-4955-9032-d728558a6544 None None] MFA Rules not processed for user `e70b0f8be7e04adca6e3f218fbe3a295`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:42:12.393488 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-d7ba3a06-c5c6-4955-9032-d728558a6544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:42:12.403662 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1185/2328] 10.222.0.118 () {58 vars in 1023 bytes} [Thu Jul 14 15:42:12 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:42:12.409064 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd52b2c6-d66d-42bd-82af-ea669a56f654 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:42:12.415461 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936a449e-0444-4f7c-8e2e-203dbba865c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0177fc696ea40069902803da09f437c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:42:12.416522 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936a449e-0444-4f7c-8e2e-203dbba865c3 service nova] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:12.417033 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936a449e-0444-4f7c-8e2e-203dbba865c3 service nova] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:12.417519 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936a449e-0444-4f7c-8e2e-203dbba865c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:12.419900 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-936a449e-0444-4f7c-8e2e-203dbba865c3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:42:12.436638 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936a449e-0444-4f7c-8e2e-203dbba865c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:42:12.438697 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936a449e-0444-4f7c-8e2e-203dbba865c3 service nova] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:42:12.451811 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1144/2329] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:42:12 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:42:12.680038 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ba3a06-c5c6-4955-9032-d728558a6544 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:42:12.681743 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-d7ba3a06-c5c6-4955-9032-d728558a6544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:42:12.695597 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ba3a06-c5c6-4955-9032-d728558a6544 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:42:12.701195 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dc11d6-3fb5-4ca0-b2e7-eaf6f4873d41 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b0f8be7e04adca6e3f218fbe3a295', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:42:12.702123 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dc11d6-3fb5-4ca0-b2e7-eaf6f4873d41 service placement] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:12.702531 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dc11d6-3fb5-4ca0-b2e7-eaf6f4873d41 service placement] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:12.702978 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dc11d6-3fb5-4ca0-b2e7-eaf6f4873d41 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:12.713375 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dc11d6-3fb5-4ca0-b2e7-eaf6f4873d41 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:42:12.715581 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dc11d6-3fb5-4ca0-b2e7-eaf6f4873d41 service placement] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:42:12.731670 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1186/2330] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:42:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:42:12.757162 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936a449e-0444-4f7c-8e2e-203dbba865c3 service nova] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:42:12.758650 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-936a449e-0444-4f7c-8e2e-203dbba865c3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:42:12.773493 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936a449e-0444-4f7c-8e2e-203dbba865c3 service nova] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:42:12.780072 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828c1464-8b0a-41b5-b232-869a764e5505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:42:12.781788 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c1464-8b0a-41b5-b232-869a764e5505 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:12.782115 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c1464-8b0a-41b5-b232-869a764e5505 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:12.782400 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c1464-8b0a-41b5-b232-869a764e5505 admin admin] PATH_INFO: `/v3/users/4c4a0889c40248808900619987f7d6fe` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:12.783705 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828c1464-8b0a-41b5-b232-869a764e5505 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c4a0889c40248808900619987f7d6fe)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:42:12.785688 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828c1464-8b0a-41b5-b232-869a764e5505 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:42:12.836802 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-828c1464-8b0a-41b5-b232-869a764e5505 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c4a0889c40248808900619987f7d6fe'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:12.844926 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-828c1464-8b0a-41b5-b232-869a764e5505 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c4a0889c40248808900619987f7d6fe'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:12.845661 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-828c1464-8b0a-41b5-b232-869a764e5505 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c4a0889c40248808900619987f7d6fe'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:12.846299 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-828c1464-8b0a-41b5-b232-869a764e5505 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c4a0889c40248808900619987f7d6fe'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:12.857829 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-828c1464-8b0a-41b5-b232-869a764e5505 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c4a0889c40248808900619987f7d6fe'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:12.871777 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1145/2331] 10.222.0.118 () {58 vars in 1228 bytes} [Thu Jul 14 15:42:12 2022] DELETE /identity/v3/users/4c4a0889c40248808900619987f7d6fe => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:42:13.045208 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dc11d6-3fb5-4ca0-b2e7-eaf6f4873d41 service placement] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:42:13.056120 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dc11d6-3fb5-4ca0-b2e7-eaf6f4873d41 service placement] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:42:13.113001 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f9d50a-4d0a-480e-802a-58e10625cb2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:42:13.113866 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f9d50a-4d0a-480e-802a-58e10625cb2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:13.114177 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f9d50a-4d0a-480e-802a-58e10625cb2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:13.114456 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f9d50a-4d0a-480e-802a-58e10625cb2c admin admin] PATH_INFO: `/v3/projects/d47519e5256047a292363db0ac0fdcbc` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:13.115637 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f9d50a-4d0a-480e-802a-58e10625cb2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d47519e5256047a292363db0ac0fdcbc)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:42:13.117808 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f9d50a-4d0a-480e-802a-58e10625cb2c admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:42:13.164191 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-a8f9d50a-4d0a-480e-802a-58e10625cb2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd47519e5256047a292363db0ac0fdcbc', 'request_id': 'req-a8f9d50a-4d0a-480e-802a-58e10625cb2c'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:13.169507 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-a8f9d50a-4d0a-480e-802a-58e10625cb2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd47519e5256047a292363db0ac0fdcbc', 'request_id': 'req-a8f9d50a-4d0a-480e-802a-58e10625cb2c'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:13.175443 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-a8f9d50a-4d0a-480e-802a-58e10625cb2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd47519e5256047a292363db0ac0fdcbc', 'request_id': 'req-a8f9d50a-4d0a-480e-802a-58e10625cb2c'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:13.188538 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-a8f9d50a-4d0a-480e-802a-58e10625cb2c admin admin] The token cache is being invalidate because project d47519e5256047a292363db0ac0fdcbc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:42:13.188823 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-a8f9d50a-4d0a-480e-802a-58e10625cb2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:13.189429 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-a8f9d50a-4d0a-480e-802a-58e10625cb2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:13.191198 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1187/2332] 10.222.0.118 () {58 vars in 1237 bytes} [Thu Jul 14 15:42:13 2022] DELETE /identity/v3/projects/d47519e5256047a292363db0ac0fdcbc => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:42:13.196950 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adf2770-39f7-437b-9e28-61cd9e664150 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:13.197264 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adf2770-39f7-437b-9e28-61cd9e664150 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:13.197538 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adf2770-39f7-437b-9e28-61cd9e664150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:13.215372 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-4adf2770-39f7-437b-9e28-61cd9e664150 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:42:13.216578 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-4adf2770-39f7-437b-9e28-61cd9e664150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:42:13.275361 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1146/2333] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:42:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:42:13.283284 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76dc3b5-5fc5-4b94-bd82-b01ba400f11b None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:13.283568 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76dc3b5-5fc5-4b94-bd82-b01ba400f11b None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:13.284128 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76dc3b5-5fc5-4b94-bd82-b01ba400f11b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:13.302009 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-c76dc3b5-5fc5-4b94-bd82-b01ba400f11b None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:42:13.303197 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-c76dc3b5-5fc5-4b94-bd82-b01ba400f11b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:42:13.314648 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1188/2334] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:42:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:42:13.315810 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adf2770-39f7-437b-9e28-61cd9e664150 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:42:13.325669 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adf2770-39f7-437b-9e28-61cd9e664150 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:42:13.330959 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fd6c0d-673a-418a-b3dc-03e309763f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:42:13.331625 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fd6c0d-673a-418a-b3dc-03e309763f5d admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:13.331904 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fd6c0d-673a-418a-b3dc-03e309763f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:13.332178 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fd6c0d-673a-418a-b3dc-03e309763f5d admin admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:13.332911 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fd6c0d-673a-418a-b3dc-03e309763f5d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:42:13.333507 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fd6c0d-673a-418a-b3dc-03e309763f5d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:42:13.334845 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fd6c0d-673a-418a-b3dc-03e309763f5d admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:42:13.347999 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1147/2335] 10.222.0.118 () {58 vars in 1157 bytes} [Thu Jul 14 15:42:13 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:42:13.352488 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76dc3b5-5fc5-4b94-bd82-b01ba400f11b None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:42:13.361612 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76dc3b5-5fc5-4b94-bd82-b01ba400f11b None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:42:13.366323 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef48104f-2c99-4551-9c4d-d533052e7d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:42:13.367223 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef48104f-2c99-4551-9c4d-d533052e7d3b admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:13.367503 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef48104f-2c99-4551-9c4d-d533052e7d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:13.367777 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef48104f-2c99-4551-9c4d-d533052e7d3b admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:13.368467 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef48104f-2c99-4551-9c4d-d533052e7d3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:42:13.370403 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef48104f-2c99-4551-9c4d-d533052e7d3b admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:42:13.401043 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1189/2336] 10.222.0.118 () {60 vars in 1157 bytes} [Thu Jul 14 15:42:13 2022] POST /identity/v3/projects => generated 376 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:42:13.402328 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fd6c0d-673a-418a-b3dc-03e309763f5d admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:42:13.412767 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fd6c0d-673a-418a-b3dc-03e309763f5d admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:42:13.440727 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:42:13.480390 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739a4a3d-318b-43e3-8aa3-027ba199e767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:42:13.481141 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739a4a3d-318b-43e3-8aa3-027ba199e767 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:13.481475 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739a4a3d-318b-43e3-8aa3-027ba199e767 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:13.481951 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739a4a3d-318b-43e3-8aa3-027ba199e767 admin admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:13.482576 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739a4a3d-318b-43e3-8aa3-027ba199e767 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:42:13.484977 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739a4a3d-318b-43e3-8aa3-027ba199e767 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:42:13.513306 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1148/2337] 10.222.0.118 () {60 vars in 1148 bytes} [Thu Jul 14 15:42:13 2022] POST /identity/v3/users => generated 289 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:42:13.517992 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef48104f-2c99-4551-9c4d-d533052e7d3b admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:42:13.525038 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:42:13.529241 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef48104f-2c99-4551-9c4d-d533052e7d3b admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:42:13.534959 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a483d1e6-57e5-49a6-9d33-4ad37f130274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:42:13.535776 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a483d1e6-57e5-49a6-9d33-4ad37f130274 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:13.536245 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a483d1e6-57e5-49a6-9d33-4ad37f130274 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:13.536560 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a483d1e6-57e5-49a6-9d33-4ad37f130274 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:13.537432 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a483d1e6-57e5-49a6-9d33-4ad37f130274 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:42:13.539176 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a483d1e6-57e5-49a6-9d33-4ad37f130274 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:42:13.549662 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1190/2338] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:42:13 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:42:13.553707 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739a4a3d-318b-43e3-8aa3-027ba199e767 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:42:13.564374 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739a4a3d-318b-43e3-8aa3-027ba199e767 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:42:13.569280 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04872229-aee2-46e4-9b5c-83adf3d4bea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:42:13.569978 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04872229-aee2-46e4-9b5c-83adf3d4bea6 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:13.570276 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04872229-aee2-46e4-9b5c-83adf3d4bea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:13.570556 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04872229-aee2-46e4-9b5c-83adf3d4bea6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:13.571405 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04872229-aee2-46e4-9b5c-83adf3d4bea6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:42:13.573253 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04872229-aee2-46e4-9b5c-83adf3d4bea6 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:42:13.585550 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1149/2339] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:42:13 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:42:13.589865 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a483d1e6-57e5-49a6-9d33-4ad37f130274 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:42:13.600035 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a483d1e6-57e5-49a6-9d33-4ad37f130274 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:42:13.604518 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc09fd8d-6325-425a-805d-3d01d597bf2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:42:13.605383 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc09fd8d-6325-425a-805d-3d01d597bf2f admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:13.605664 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc09fd8d-6325-425a-805d-3d01d597bf2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:13.605934 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc09fd8d-6325-425a-805d-3d01d597bf2f admin admin] PATH_INFO: `/v3/projects/9f08786f7a1745d19084f923a5c39b73/users/b505851dacb2464db8486dfbc429cf01/roles/4abcf5e5e7cd4b53ae1828fec6550d53` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:13.621202 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc09fd8d-6325-425a-805d-3d01d597bf2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f08786f7a1745d19084f923a5c39b73, user_id=b505851dacb2464db8486dfbc429cf01, role_id=4abcf5e5e7cd4b53ae1828fec6550d53)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:42:13.624576 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc09fd8d-6325-425a-805d-3d01d597bf2f admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:42:13.638200 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1191/2340] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:42:13 2022] PUT /identity/v3/projects/9f08786f7a1745d19084f923a5c39b73/users/b505851dacb2464db8486dfbc429cf01/roles/4abcf5e5e7cd4b53ae1828fec6550d53 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:42:13.650353 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92dd762-cb9b-415a-96e8-8be0837ad8dc None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:13.650643 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92dd762-cb9b-415a-96e8-8be0837ad8dc None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:13.650921 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92dd762-cb9b-415a-96e8-8be0837ad8dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:13.677519 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-b92dd762-cb9b-415a-96e8-8be0837ad8dc None None] MFA Rules not processed for user `b505851dacb2464db8486dfbc429cf01`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:42:13.678782 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-b92dd762-cb9b-415a-96e8-8be0837ad8dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:42:13.743530 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1150/2341] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:42:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:42:13.755593 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc09fd8d-6325-425a-805d-3d01d597bf2f admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:42:13.757280 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-cc09fd8d-6325-425a-805d-3d01d597bf2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:42:13.830532 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc09fd8d-6325-425a-805d-3d01d597bf2f admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:42:13.836673 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a36fdf-d781-4f27-aeb8-3957cd1442eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0177fc696ea40069902803da09f437c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:42:13.837351 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a36fdf-d781-4f27-aeb8-3957cd1442eb service nova] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:13.837634 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a36fdf-d781-4f27-aeb8-3957cd1442eb service nova] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:13.837908 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a36fdf-d781-4f27-aeb8-3957cd1442eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:13.846939 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a36fdf-d781-4f27-aeb8-3957cd1442eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:42:13.848562 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a36fdf-d781-4f27-aeb8-3957cd1442eb service nova] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:42:13.859927 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1192/2342] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:42:13 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:42:14.087473 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92dd762-cb9b-415a-96e8-8be0837ad8dc None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:42:14.149411 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92dd762-cb9b-415a-96e8-8be0837ad8dc None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:42:14.153772 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2bddf7-0af7-4e4c-9bb2-6ba408042fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:42:14.154662 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2bddf7-0af7-4e4c-9bb2-6ba408042fa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:14.154937 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2bddf7-0af7-4e4c-9bb2-6ba408042fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:14.155203 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2bddf7-0af7-4e4c-9bb2-6ba408042fa7 admin admin] PATH_INFO: `/v3/users/b505851dacb2464db8486dfbc429cf01` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:14.156912 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2bddf7-0af7-4e4c-9bb2-6ba408042fa7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b505851dacb2464db8486dfbc429cf01)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:42:14.158864 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2bddf7-0af7-4e4c-9bb2-6ba408042fa7 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:42:14.198858 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:42:14.205934 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-1e2bddf7-0af7-4e4c-9bb2-6ba408042fa7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b505851dacb2464db8486dfbc429cf01'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:14.213475 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-1e2bddf7-0af7-4e4c-9bb2-6ba408042fa7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b505851dacb2464db8486dfbc429cf01'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:14.214186 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-1e2bddf7-0af7-4e4c-9bb2-6ba408042fa7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b505851dacb2464db8486dfbc429cf01'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:14.214799 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-1e2bddf7-0af7-4e4c-9bb2-6ba408042fa7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b505851dacb2464db8486dfbc429cf01'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:14.227142 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-1e2bddf7-0af7-4e4c-9bb2-6ba408042fa7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b505851dacb2464db8486dfbc429cf01'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:14.240139 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1151/2343] 10.222.0.118 () {58 vars in 1228 bytes} [Thu Jul 14 15:42:14 2022] DELETE /identity/v3/users/b505851dacb2464db8486dfbc429cf01 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:42:14.244999 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2f0f1b-c075-475e-9338-9ddb145f2261 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:14.245274 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2f0f1b-c075-475e-9338-9ddb145f2261 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:14.245550 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2f0f1b-c075-475e-9338-9ddb145f2261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:14.262263 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-7e2f0f1b-c075-475e-9338-9ddb145f2261 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:42:14.264429 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-7e2f0f1b-c075-475e-9338-9ddb145f2261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:42:14.325803 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1193/2344] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:42:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:42:14.335588 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2bddf7-0af7-4e4c-9bb2-6ba408042fa7 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:42:14.336962 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-1e2bddf7-0af7-4e4c-9bb2-6ba408042fa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:42:14.394773 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2bddf7-0af7-4e4c-9bb2-6ba408042fa7 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:42:14.398438 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e745fdfe-a4ee-430f-b880-4c6173b59a56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b650be8114b64df0ac88441f1c50b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:42:14.399069 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e745fdfe-a4ee-430f-b880-4c6173b59a56 service neutron] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:14.399344 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e745fdfe-a4ee-430f-b880-4c6173b59a56 service neutron] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:14.399612 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e745fdfe-a4ee-430f-b880-4c6173b59a56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:14.409146 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e745fdfe-a4ee-430f-b880-4c6173b59a56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:42:14.410612 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e745fdfe-a4ee-430f-b880-4c6173b59a56 service neutron] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:42:14.419828 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1152/2345] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:42:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:42:14.712068 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2f0f1b-c075-475e-9338-9ddb145f2261 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:42:14.713738 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-7e2f0f1b-c075-475e-9338-9ddb145f2261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:42:14.733992 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2f0f1b-c075-475e-9338-9ddb145f2261 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:42:14.741386 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7125774-ca71-40b0-b8cd-cc8f0446a261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:42:14.742542 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7125774-ca71-40b0-b8cd-cc8f0446a261 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:14.742808 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7125774-ca71-40b0-b8cd-cc8f0446a261 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:14.743085 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7125774-ca71-40b0-b8cd-cc8f0446a261 admin admin] PATH_INFO: `/v3/projects/9f08786f7a1745d19084f923a5c39b73` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:14.745036 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7125774-ca71-40b0-b8cd-cc8f0446a261 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f08786f7a1745d19084f923a5c39b73)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:42:14.747383 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7125774-ca71-40b0-b8cd-cc8f0446a261 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:42:14.815825 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-f7125774-ca71-40b0-b8cd-cc8f0446a261 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f08786f7a1745d19084f923a5c39b73', 'request_id': 'req-f7125774-ca71-40b0-b8cd-cc8f0446a261'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:14.817482 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:42:14.830621 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-f7125774-ca71-40b0-b8cd-cc8f0446a261 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f08786f7a1745d19084f923a5c39b73', 'request_id': 'req-f7125774-ca71-40b0-b8cd-cc8f0446a261'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:14.837602 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-f7125774-ca71-40b0-b8cd-cc8f0446a261 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f08786f7a1745d19084f923a5c39b73', 'request_id': 'req-f7125774-ca71-40b0-b8cd-cc8f0446a261'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:14.852715 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-f7125774-ca71-40b0-b8cd-cc8f0446a261 admin admin] The token cache is being invalidate because project 9f08786f7a1745d19084f923a5c39b73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:42:14.853077 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-f7125774-ca71-40b0-b8cd-cc8f0446a261 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:14.853947 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-f7125774-ca71-40b0-b8cd-cc8f0446a261 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:14.857796 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1194/2346] 10.222.0.118 () {58 vars in 1237 bytes} [Thu Jul 14 15:42:14 2022] DELETE /identity/v3/projects/9f08786f7a1745d19084f923a5c39b73 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:42:14.862067 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402068f4-0aed-40b7-ab24-50d5a18e63fe None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:14.862449 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402068f4-0aed-40b7-ab24-50d5a18e63fe None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:14.862701 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402068f4-0aed-40b7-ab24-50d5a18e63fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:14.882518 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-402068f4-0aed-40b7-ab24-50d5a18e63fe None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:42:14.883941 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-402068f4-0aed-40b7-ab24-50d5a18e63fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:42:14.946842 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1153/2347] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:42:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:42:14.956158 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed01c5-cb96-4fe3-b3d6-7db14c980b5e None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:14.956555 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed01c5-cb96-4fe3-b3d6-7db14c980b5e None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:14.956844 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed01c5-cb96-4fe3-b3d6-7db14c980b5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:14.975040 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-71ed01c5-cb96-4fe3-b3d6-7db14c980b5e None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:42:14.976235 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-71ed01c5-cb96-4fe3-b3d6-7db14c980b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:42:14.984044 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1195/2348] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:42:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:42:14.988250 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402068f4-0aed-40b7-ab24-50d5a18e63fe None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:42:14.998454 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402068f4-0aed-40b7-ab24-50d5a18e63fe None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:42:15.004166 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1224f933-b9f1-4d21-8324-321dcf9ee32f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:42:15.004827 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1224f933-b9f1-4d21-8324-321dcf9ee32f admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:15.005110 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1224f933-b9f1-4d21-8324-321dcf9ee32f admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:15.005393 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1224f933-b9f1-4d21-8324-321dcf9ee32f admin admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:15.006158 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1224f933-b9f1-4d21-8324-321dcf9ee32f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:42:15.006467 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1224f933-b9f1-4d21-8324-321dcf9ee32f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:42:15.008068 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1224f933-b9f1-4d21-8324-321dcf9ee32f admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:42:15.024868 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1154/2349] 10.222.0.118 () {58 vars in 1157 bytes} [Thu Jul 14 15:42:14 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:42:15.029418 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ed01c5-cb96-4fe3-b3d6-7db14c980b5e None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:42:15.038989 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ed01c5-cb96-4fe3-b3d6-7db14c980b5e None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:42:15.043670 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826e2518-6f5f-4dd9-aab2-245f6c74d65c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:42:15.044441 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826e2518-6f5f-4dd9-aab2-245f6c74d65c admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:15.044738 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826e2518-6f5f-4dd9-aab2-245f6c74d65c admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:15.045066 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826e2518-6f5f-4dd9-aab2-245f6c74d65c admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:15.045763 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826e2518-6f5f-4dd9-aab2-245f6c74d65c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:42:15.048154 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826e2518-6f5f-4dd9-aab2-245f6c74d65c admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:42:15.079013 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1196/2350] 10.222.0.118 () {60 vars in 1157 bytes} [Thu Jul 14 15:42:15 2022] POST /identity/v3/projects => generated 388 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:42:15.080345 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1224f933-b9f1-4d21-8324-321dcf9ee32f admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:42:15.090424 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1224f933-b9f1-4d21-8324-321dcf9ee32f admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:42:15.134491 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:42:15.157006 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991ca237-1cda-4bbf-b658-554c3a34c7cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:42:15.157799 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ca237-1cda-4bbf-b658-554c3a34c7cd admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:15.158114 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ca237-1cda-4bbf-b658-554c3a34c7cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:15.158392 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ca237-1cda-4bbf-b658-554c3a34c7cd admin admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:15.159085 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991ca237-1cda-4bbf-b658-554c3a34c7cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:42:15.161143 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991ca237-1cda-4bbf-b658-554c3a34c7cd admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:42:15.184793 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1155/2351] 10.222.0.118 () {60 vars in 1148 bytes} [Thu Jul 14 15:42:15 2022] POST /identity/v3/users => generated 295 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:42:15.189060 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826e2518-6f5f-4dd9-aab2-245f6c74d65c admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:42:15.200551 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826e2518-6f5f-4dd9-aab2-245f6c74d65c admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:42:15.210559 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcbf38f-5304-4538-90b0-f7bd3c215859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:42:15.211374 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcbf38f-5304-4538-90b0-f7bd3c215859 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:15.211903 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcbf38f-5304-4538-90b0-f7bd3c215859 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:15.212316 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcbf38f-5304-4538-90b0-f7bd3c215859 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:15.213229 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcbf38f-5304-4538-90b0-f7bd3c215859 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:42:15.214969 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcbf38f-5304-4538-90b0-f7bd3c215859 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:42:15.227248 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1197/2352] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:42:15 2022] GET /identity/v3/roles => generated 1427 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:42:15.232147 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991ca237-1cda-4bbf-b658-554c3a34c7cd admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:42:15.244775 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991ca237-1cda-4bbf-b658-554c3a34c7cd admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:42:15.250117 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d1b2e3-9194-4238-bbcb-7b56cc60ec9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:42:15.250785 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d1b2e3-9194-4238-bbcb-7b56cc60ec9b admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:15.251064 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d1b2e3-9194-4238-bbcb-7b56cc60ec9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:15.251337 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d1b2e3-9194-4238-bbcb-7b56cc60ec9b admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:15.252072 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d1b2e3-9194-4238-bbcb-7b56cc60ec9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:42:15.253688 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d1b2e3-9194-4238-bbcb-7b56cc60ec9b admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:42:15.267015 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1156/2353] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:42:15 2022] GET /identity/v3/roles => generated 1427 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:42:15.271311 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcbf38f-5304-4538-90b0-f7bd3c215859 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:42:15.281811 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcbf38f-5304-4538-90b0-f7bd3c215859 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:42:15.286487 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1d2390-8de2-4f98-9606-3c54e01dfdf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:42:15.287383 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1d2390-8de2-4f98-9606-3c54e01dfdf2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:15.287668 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1d2390-8de2-4f98-9606-3c54e01dfdf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:15.287944 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1d2390-8de2-4f98-9606-3c54e01dfdf2 admin admin] PATH_INFO: `/v3/projects/f3bcb857dcd1473081db71d82743f2d4/users/ea629004a23c4ba3b97978bce030ecb8/roles/4abcf5e5e7cd4b53ae1828fec6550d53` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:15.303669 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1d2390-8de2-4f98-9606-3c54e01dfdf2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3bcb857dcd1473081db71d82743f2d4, user_id=ea629004a23c4ba3b97978bce030ecb8, role_id=4abcf5e5e7cd4b53ae1828fec6550d53)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:42:15.306355 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1d2390-8de2-4f98-9606-3c54e01dfdf2 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:42:15.324570 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1198/2354] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:42:15 2022] PUT /identity/v3/projects/f3bcb857dcd1473081db71d82743f2d4/users/ea629004a23c4ba3b97978bce030ecb8/roles/4abcf5e5e7cd4b53ae1828fec6550d53 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:42:15.334805 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a619adf-73d1-48f3-819e-8e0cfb75acd1 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:15.335087 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a619adf-73d1-48f3-819e-8e0cfb75acd1 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:15.335359 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a619adf-73d1-48f3-819e-8e0cfb75acd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:15.363284 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-5a619adf-73d1-48f3-819e-8e0cfb75acd1 None None] MFA Rules not processed for user `ea629004a23c4ba3b97978bce030ecb8`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:42:15.364505 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-5a619adf-73d1-48f3-819e-8e0cfb75acd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:42:15.429405 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1157/2355] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:42:15 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:42:15.433996 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1d2390-8de2-4f98-9606-3c54e01dfdf2 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:42:15.508175 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1d2390-8de2-4f98-9606-3c54e01dfdf2 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:42:15.513040 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e437d2-f06e-4911-9b06-063c126d6683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:42:15.513698 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e437d2-f06e-4911-9b06-063c126d6683 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:15.514001 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e437d2-f06e-4911-9b06-063c126d6683 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:15.514311 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e437d2-f06e-4911-9b06-063c126d6683 admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:15.515017 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e437d2-f06e-4911-9b06-063c126d6683 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:42:15.516930 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e437d2-f06e-4911-9b06-063c126d6683 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:42:15.549705 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1199/2356] 10.222.0.118 () {60 vars in 1157 bytes} [Thu Jul 14 15:42:15 2022] POST /identity/v3/projects => generated 388 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:42:15.554341 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a619adf-73d1-48f3-819e-8e0cfb75acd1 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:42:15.565605 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a619adf-73d1-48f3-819e-8e0cfb75acd1 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:42:15.625082 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc0ee7a-f203-44ff-8d0b-e7a05de6295e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:42:15.625750 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc0ee7a-f203-44ff-8d0b-e7a05de6295e admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:15.626056 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc0ee7a-f203-44ff-8d0b-e7a05de6295e admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:15.626326 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc0ee7a-f203-44ff-8d0b-e7a05de6295e admin admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:15.627027 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc0ee7a-f203-44ff-8d0b-e7a05de6295e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:42:15.628947 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc0ee7a-f203-44ff-8d0b-e7a05de6295e admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:42:15.649434 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1158/2357] 10.222.0.118 () {60 vars in 1148 bytes} [Thu Jul 14 15:42:15 2022] POST /identity/v3/users => generated 301 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:42:15.653548 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e437d2-f06e-4911-9b06-063c126d6683 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:42:15.664864 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e437d2-f06e-4911-9b06-063c126d6683 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:42:15.669708 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce34318-6d64-4266-be92-7ea0de995945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:42:15.670428 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce34318-6d64-4266-be92-7ea0de995945 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:15.670705 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce34318-6d64-4266-be92-7ea0de995945 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:15.671555 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce34318-6d64-4266-be92-7ea0de995945 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:15.673025 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce34318-6d64-4266-be92-7ea0de995945 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:42:15.674441 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce34318-6d64-4266-be92-7ea0de995945 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:42:15.686539 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1200/2358] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:42:15 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:42:15.690679 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc0ee7a-f203-44ff-8d0b-e7a05de6295e admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:42:15.700807 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc0ee7a-f203-44ff-8d0b-e7a05de6295e admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:42:15.705683 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb09281-731b-4fe9-8ae9-077603dd4e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:42:15.706624 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb09281-731b-4fe9-8ae9-077603dd4e03 admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:15.706907 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb09281-731b-4fe9-8ae9-077603dd4e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:15.707183 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb09281-731b-4fe9-8ae9-077603dd4e03 admin admin] PATH_INFO: `/v3/projects/c87f99c331be4b1081bcef3278fc45a3/users/2f8070eba13f47ebac264b16c455c60e/roles/3b880cef7dcf4baf87b50f8610c0c56e` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:15.725546 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb09281-731b-4fe9-8ae9-077603dd4e03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c87f99c331be4b1081bcef3278fc45a3, user_id=2f8070eba13f47ebac264b16c455c60e, role_id=3b880cef7dcf4baf87b50f8610c0c56e)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:42:15.728267 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb09281-731b-4fe9-8ae9-077603dd4e03 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:42:15.743609 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1159/2359] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:42:15 2022] PUT /identity/v3/projects/c87f99c331be4b1081bcef3278fc45a3/users/2f8070eba13f47ebac264b16c455c60e/roles/3b880cef7dcf4baf87b50f8610c0c56e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:42:15.747580 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce34318-6d64-4266-be92-7ea0de995945 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:42:15.757749 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce34318-6d64-4266-be92-7ea0de995945 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:42:15.807082 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:42:15.822041 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee4eedb-c327-4924-91e4-32fa75b481fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:42:15.822716 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee4eedb-c327-4924-91e4-32fa75b481fb admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:15.822995 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee4eedb-c327-4924-91e4-32fa75b481fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:15.823269 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee4eedb-c327-4924-91e4-32fa75b481fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:15.824008 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee4eedb-c327-4924-91e4-32fa75b481fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:42:15.825953 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee4eedb-c327-4924-91e4-32fa75b481fb admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:42:15.837226 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1201/2360] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:42:15 2022] GET /identity/v3/roles => generated 1427 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:42:15.841453 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb09281-731b-4fe9-8ae9-077603dd4e03 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:42:15.853194 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb09281-731b-4fe9-8ae9-077603dd4e03 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:42:15.857859 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5915bd4f-bdf1-43b0-b343-a222fcf05cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:42:15.859380 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5915bd4f-bdf1-43b0-b343-a222fcf05cd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:15.859695 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5915bd4f-bdf1-43b0-b343-a222fcf05cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:15.860118 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5915bd4f-bdf1-43b0-b343-a222fcf05cd7 admin admin] PATH_INFO: `/v3/projects/c87f99c331be4b1081bcef3278fc45a3/users/2f8070eba13f47ebac264b16c455c60e/roles/3b880cef7dcf4baf87b50f8610c0c56e` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:15.862269 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5915bd4f-bdf1-43b0-b343-a222fcf05cd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c87f99c331be4b1081bcef3278fc45a3, user_id=2f8070eba13f47ebac264b16c455c60e, role_id=3b880cef7dcf4baf87b50f8610c0c56e)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:42:15.864935 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5915bd4f-bdf1-43b0-b343-a222fcf05cd7 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:42:15.877201 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1160/2361] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:42:15 2022] PUT /identity/v3/projects/c87f99c331be4b1081bcef3278fc45a3/users/2f8070eba13f47ebac264b16c455c60e/roles/3b880cef7dcf4baf87b50f8610c0c56e => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:42:15.888942 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8a32ac-e7ad-4ceb-a690-d7f1fc49ad18 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:15.889441 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8a32ac-e7ad-4ceb-a690-d7f1fc49ad18 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:15.890330 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8a32ac-e7ad-4ceb-a690-d7f1fc49ad18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:15.922488 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-6c8a32ac-e7ad-4ceb-a690-d7f1fc49ad18 None None] MFA Rules not processed for user `2f8070eba13f47ebac264b16c455c60e`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:42:15.924309 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-6c8a32ac-e7ad-4ceb-a690-d7f1fc49ad18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:42:16.018707 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1202/2362] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:42:15 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:42:16.030862 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5915bd4f-bdf1-43b0-b343-a222fcf05cd7 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:42:16.032835 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-5915bd4f-bdf1-43b0-b343-a222fcf05cd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:42:16.048372 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:42:16.108222 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5915bd4f-bdf1-43b0-b343-a222fcf05cd7 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:42:16.112311 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419e8693-b0e1-486a-9095-fcec6d9066bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea647438ea1c438987f28cbe39c3ff2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:42:16.113096 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419e8693-b0e1-486a-9095-fcec6d9066bf service cinder] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:16.113420 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419e8693-b0e1-486a-9095-fcec6d9066bf service cinder] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:16.113694 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419e8693-b0e1-486a-9095-fcec6d9066bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:16.123659 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419e8693-b0e1-486a-9095-fcec6d9066bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:42:16.125250 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419e8693-b0e1-486a-9095-fcec6d9066bf service cinder] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:42:16.135485 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1161/2363] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:42:16 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:42:16.165337 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8a32ac-e7ad-4ceb-a690-d7f1fc49ad18 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:42:16.231509 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8a32ac-e7ad-4ceb-a690-d7f1fc49ad18 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:42:16.236447 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0064796-c5ab-426f-abb3-03e58684ec7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:42:16.237318 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0064796-c5ab-426f-abb3-03e58684ec7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:16.237593 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0064796-c5ab-426f-abb3-03e58684ec7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:16.237862 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0064796-c5ab-426f-abb3-03e58684ec7a admin admin] PATH_INFO: `/v3/users/ea629004a23c4ba3b97978bce030ecb8` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:16.239208 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0064796-c5ab-426f-abb3-03e58684ec7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea629004a23c4ba3b97978bce030ecb8)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:42:16.241270 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0064796-c5ab-426f-abb3-03e58684ec7a admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:42:16.298208 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-c0064796-c5ab-426f-abb3-03e58684ec7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea629004a23c4ba3b97978bce030ecb8'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:16.310456 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-c0064796-c5ab-426f-abb3-03e58684ec7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea629004a23c4ba3b97978bce030ecb8'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:16.313589 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-c0064796-c5ab-426f-abb3-03e58684ec7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea629004a23c4ba3b97978bce030ecb8'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:16.314359 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-c0064796-c5ab-426f-abb3-03e58684ec7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea629004a23c4ba3b97978bce030ecb8'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:16.334417 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419e8693-b0e1-486a-9095-fcec6d9066bf service cinder] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:42:16.336122 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-419e8693-b0e1-486a-9095-fcec6d9066bf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:42:16.338497 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-c0064796-c5ab-426f-abb3-03e58684ec7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea629004a23c4ba3b97978bce030ecb8'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:16.341303 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:42:16.358388 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1203/2364] 10.222.0.118 () {58 vars in 1228 bytes} [Thu Jul 14 15:42:16 2022] DELETE /identity/v3/users/ea629004a23c4ba3b97978bce030ecb8 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:42:16.363361 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb6cc3-b812-43c0-8776-c3f8ddc283d0 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:16.363886 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb6cc3-b812-43c0-8776-c3f8ddc283d0 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:16.364386 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb6cc3-b812-43c0-8776-c3f8ddc283d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:16.386557 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-37fb6cc3-b812-43c0-8776-c3f8ddc283d0 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:42:16.387880 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-37fb6cc3-b812-43c0-8776-c3f8ddc283d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:42:16.448597 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419e8693-b0e1-486a-9095-fcec6d9066bf service cinder] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:42:16.480176 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1204/2365] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:42:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:42:16.481681 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fb6cc3-b812-43c0-8776-c3f8ddc283d0 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:42:16.483973 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-37fb6cc3-b812-43c0-8776-c3f8ddc283d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:42:16.537426 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0067573a-6fef-4fe9-94fd-42ff157dec77 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0177fc696ea40069902803da09f437c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:42:16.538262 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0067573a-6fef-4fe9-94fd-42ff157dec77 service nova] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:16.538649 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0067573a-6fef-4fe9-94fd-42ff157dec77 service nova] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:16.538994 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0067573a-6fef-4fe9-94fd-42ff157dec77 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:16.540908 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-0067573a-6fef-4fe9-94fd-42ff157dec77 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:42:16.565642 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fb6cc3-b812-43c0-8776-c3f8ddc283d0 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:42:16.576162 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0b5b83-ae39-4ab3-aea2-2b790bcf3964 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b650be8114b64df0ac88441f1c50b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:42:16.578164 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0b5b83-ae39-4ab3-aea2-2b790bcf3964 service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:16.578754 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0b5b83-ae39-4ab3-aea2-2b790bcf3964 service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:16.579376 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0b5b83-ae39-4ab3-aea2-2b790bcf3964 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:16.594477 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0b5b83-ae39-4ab3-aea2-2b790bcf3964 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:42:16.597337 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0b5b83-ae39-4ab3-aea2-2b790bcf3964 service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:42:16.599815 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:42:16.608776 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1205/2366] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:42:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:42:16.636034 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0067573a-6fef-4fe9-94fd-42ff157dec77 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:42:16.638382 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0067573a-6fef-4fe9-94fd-42ff157dec77 service nova] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:42:16.657829 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1162/2367] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:42:16 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:42:17.130696 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0b5b83-ae39-4ab3-aea2-2b790bcf3964 service neutron] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:42:17.134304 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-db0b5b83-ae39-4ab3-aea2-2b790bcf3964 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:42:17.168416 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0b5b83-ae39-4ab3-aea2-2b790bcf3964 service neutron] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:42:17.174785 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f75a1e9-67a2-4070-b451-050cd83cfdf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:42:17.175628 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f75a1e9-67a2-4070-b451-050cd83cfdf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:17.175915 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f75a1e9-67a2-4070-b451-050cd83cfdf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:17.176086 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f75a1e9-67a2-4070-b451-050cd83cfdf8 admin admin] PATH_INFO: `/v3/projects/f3bcb857dcd1473081db71d82743f2d4` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:17.177369 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f75a1e9-67a2-4070-b451-050cd83cfdf8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3bcb857dcd1473081db71d82743f2d4)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:42:17.180046 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f75a1e9-67a2-4070-b451-050cd83cfdf8 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:42:17.247798 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-0f75a1e9-67a2-4070-b451-050cd83cfdf8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3bcb857dcd1473081db71d82743f2d4', 'request_id': 'req-0f75a1e9-67a2-4070-b451-050cd83cfdf8'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:17.255975 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-0f75a1e9-67a2-4070-b451-050cd83cfdf8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3bcb857dcd1473081db71d82743f2d4', 'request_id': 'req-0f75a1e9-67a2-4070-b451-050cd83cfdf8'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:17.266699 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-0f75a1e9-67a2-4070-b451-050cd83cfdf8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3bcb857dcd1473081db71d82743f2d4', 'request_id': 'req-0f75a1e9-67a2-4070-b451-050cd83cfdf8'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:17.292525 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-0f75a1e9-67a2-4070-b451-050cd83cfdf8 admin admin] The token cache is being invalidate because project f3bcb857dcd1473081db71d82743f2d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:42:17.292943 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-0f75a1e9-67a2-4070-b451-050cd83cfdf8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:17.293568 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-0f75a1e9-67a2-4070-b451-050cd83cfdf8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:17.295133 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1206/2368] 10.222.0.118 () {58 vars in 1237 bytes} [Thu Jul 14 15:42:17 2022] DELETE /identity/v3/projects/f3bcb857dcd1473081db71d82743f2d4 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:42:17.299600 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0067573a-6fef-4fe9-94fd-42ff157dec77 service nova] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:42:17.311603 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0067573a-6fef-4fe9-94fd-42ff157dec77 service nova] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:42:17.373308 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1962d511-1445-49f9-8b28-4d3e91814197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:42:17.374368 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1962d511-1445-49f9-8b28-4d3e91814197 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:17.374719 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1962d511-1445-49f9-8b28-4d3e91814197 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:17.375165 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1962d511-1445-49f9-8b28-4d3e91814197 admin admin] PATH_INFO: `/v3/users/2f8070eba13f47ebac264b16c455c60e` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:17.376585 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1962d511-1445-49f9-8b28-4d3e91814197 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f8070eba13f47ebac264b16c455c60e)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:42:17.378701 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1962d511-1445-49f9-8b28-4d3e91814197 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:42:17.431926 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-1962d511-1445-49f9-8b28-4d3e91814197 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f8070eba13f47ebac264b16c455c60e'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:17.441317 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-1962d511-1445-49f9-8b28-4d3e91814197 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f8070eba13f47ebac264b16c455c60e'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:17.442199 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-1962d511-1445-49f9-8b28-4d3e91814197 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f8070eba13f47ebac264b16c455c60e'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:17.442778 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-1962d511-1445-49f9-8b28-4d3e91814197 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f8070eba13f47ebac264b16c455c60e'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:17.461528 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-1962d511-1445-49f9-8b28-4d3e91814197 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f8070eba13f47ebac264b16c455c60e'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:17.480145 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1163/2369] 10.222.0.118 () {58 vars in 1228 bytes} [Thu Jul 14 15:42:17 2022] DELETE /identity/v3/users/2f8070eba13f47ebac264b16c455c60e => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:42:17.928401 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f75a1e9-67a2-4070-b451-050cd83cfdf8 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:42:17.930021 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-0f75a1e9-67a2-4070-b451-050cd83cfdf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:42:17.946372 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f75a1e9-67a2-4070-b451-050cd83cfdf8 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:42:17.962264 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:42:18.009917 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2e7d88-c7a9-4ed7-97bc-cb6004e9c5a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:42:18.010826 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2e7d88-c7a9-4ed7-97bc-cb6004e9c5a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:18.011524 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2e7d88-c7a9-4ed7-97bc-cb6004e9c5a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:18.011524 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2e7d88-c7a9-4ed7-97bc-cb6004e9c5a6 admin admin] PATH_INFO: `/v3/projects/c87f99c331be4b1081bcef3278fc45a3` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:18.012574 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2e7d88-c7a9-4ed7-97bc-cb6004e9c5a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c87f99c331be4b1081bcef3278fc45a3)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:42:18.015173 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2e7d88-c7a9-4ed7-97bc-cb6004e9c5a6 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:42:18.076445 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-df2e7d88-c7a9-4ed7-97bc-cb6004e9c5a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c87f99c331be4b1081bcef3278fc45a3', 'request_id': 'req-df2e7d88-c7a9-4ed7-97bc-cb6004e9c5a6'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:18.087077 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-df2e7d88-c7a9-4ed7-97bc-cb6004e9c5a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c87f99c331be4b1081bcef3278fc45a3', 'request_id': 'req-df2e7d88-c7a9-4ed7-97bc-cb6004e9c5a6'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:18.092958 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-df2e7d88-c7a9-4ed7-97bc-cb6004e9c5a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c87f99c331be4b1081bcef3278fc45a3', 'request_id': 'req-df2e7d88-c7a9-4ed7-97bc-cb6004e9c5a6'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:18.122202 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-df2e7d88-c7a9-4ed7-97bc-cb6004e9c5a6 admin admin] The token cache is being invalidate because project c87f99c331be4b1081bcef3278fc45a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:42:18.122564 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-df2e7d88-c7a9-4ed7-97bc-cb6004e9c5a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:18.129259 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-df2e7d88-c7a9-4ed7-97bc-cb6004e9c5a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:18.132153 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1207/2370] 10.222.0.118 () {58 vars in 1237 bytes} [Thu Jul 14 15:42:17 2022] DELETE /identity/v3/projects/c87f99c331be4b1081bcef3278fc45a3 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:42:18.136938 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc40655-3982-402f-b7b0-e4a68f205026 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:18.137228 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc40655-3982-402f-b7b0-e4a68f205026 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:18.137509 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc40655-3982-402f-b7b0-e4a68f205026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:18.187882 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-9cc40655-3982-402f-b7b0-e4a68f205026 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:42:18.189339 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-9cc40655-3982-402f-b7b0-e4a68f205026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:42:18.366249 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1164/2371] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:42:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:42:18.374970 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d486c4a-2380-4eed-bcb1-01142d9f9303 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:18.375490 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d486c4a-2380-4eed-bcb1-01142d9f9303 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:18.376031 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d486c4a-2380-4eed-bcb1-01142d9f9303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:18.430508 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-7d486c4a-2380-4eed-bcb1-01142d9f9303 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:42:18.432117 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-7d486c4a-2380-4eed-bcb1-01142d9f9303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:42:18.442447 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1208/2372] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:42:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:42:18.447580 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc40655-3982-402f-b7b0-e4a68f205026 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:42:18.462460 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:42:18.474168 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc40655-3982-402f-b7b0-e4a68f205026 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:42:18.484434 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a0aaa9-4dbd-4b6c-a4f6-4af1114568d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:42:18.486466 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a0aaa9-4dbd-4b6c-a4f6-4af1114568d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:18.487224 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a0aaa9-4dbd-4b6c-a4f6-4af1114568d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:18.487583 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a0aaa9-4dbd-4b6c-a4f6-4af1114568d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:18.488790 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a0aaa9-4dbd-4b6c-a4f6-4af1114568d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:42:18.489519 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a0aaa9-4dbd-4b6c-a4f6-4af1114568d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:42:18.491756 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a0aaa9-4dbd-4b6c-a4f6-4af1114568d4 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:42:18.510015 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1165/2373] 10.222.0.118 () {58 vars in 1157 bytes} [Thu Jul 14 15:42:18 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:42:18.512102 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d486c4a-2380-4eed-bcb1-01142d9f9303 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:42:18.524797 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d486c4a-2380-4eed-bcb1-01142d9f9303 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:42:18.532023 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c8cd56-7d2b-4555-ba77-399f126599f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:42:18.533444 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c8cd56-7d2b-4555-ba77-399f126599f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:18.533953 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c8cd56-7d2b-4555-ba77-399f126599f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:18.535008 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c8cd56-7d2b-4555-ba77-399f126599f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:18.535853 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c8cd56-7d2b-4555-ba77-399f126599f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:42:18.538006 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c8cd56-7d2b-4555-ba77-399f126599f8 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:42:18.578199 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1209/2374] 10.222.0.118 () {60 vars in 1157 bytes} [Thu Jul 14 15:42:18 2022] POST /identity/v3/projects => generated 366 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:42:18.579036 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a0aaa9-4dbd-4b6c-a4f6-4af1114568d4 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:42:18.590243 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a0aaa9-4dbd-4b6c-a4f6-4af1114568d4 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:42:18.669228 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746e20f8-3b34-49d2-9872-4a81da39e627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:42:18.670421 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e20f8-3b34-49d2-9872-4a81da39e627 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:18.671325 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e20f8-3b34-49d2-9872-4a81da39e627 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:18.672391 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e20f8-3b34-49d2-9872-4a81da39e627 admin admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:18.672510 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746e20f8-3b34-49d2-9872-4a81da39e627 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:42:18.675306 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746e20f8-3b34-49d2-9872-4a81da39e627 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:42:18.697833 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1166/2375] 10.222.0.118 () {60 vars in 1148 bytes} [Thu Jul 14 15:42:18 2022] POST /identity/v3/users => generated 284 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:42:18.702146 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c8cd56-7d2b-4555-ba77-399f126599f8 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:42:18.713714 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c8cd56-7d2b-4555-ba77-399f126599f8 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:42:18.720597 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71137cc9-d367-406b-bb64-eb79670fd4c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:42:18.721358 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71137cc9-d367-406b-bb64-eb79670fd4c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:18.721643 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71137cc9-d367-406b-bb64-eb79670fd4c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:18.721897 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71137cc9-d367-406b-bb64-eb79670fd4c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:18.722695 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71137cc9-d367-406b-bb64-eb79670fd4c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:42:18.726981 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71137cc9-d367-406b-bb64-eb79670fd4c6 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:42:18.742276 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1210/2376] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:42:18 2022] GET /identity/v3/roles => generated 1427 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:42:18.745990 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746e20f8-3b34-49d2-9872-4a81da39e627 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:42:18.757478 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746e20f8-3b34-49d2-9872-4a81da39e627 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:42:18.763005 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323bb299-2fd6-40df-8e31-9f6c2447aa86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:42:18.763817 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323bb299-2fd6-40df-8e31-9f6c2447aa86 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:18.764170 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323bb299-2fd6-40df-8e31-9f6c2447aa86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:18.764566 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323bb299-2fd6-40df-8e31-9f6c2447aa86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:18.765370 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323bb299-2fd6-40df-8e31-9f6c2447aa86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:42:18.767566 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323bb299-2fd6-40df-8e31-9f6c2447aa86 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:42:18.779378 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1167/2377] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:42:18 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:42:18.784450 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71137cc9-d367-406b-bb64-eb79670fd4c6 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:42:18.796653 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71137cc9-d367-406b-bb64-eb79670fd4c6 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:42:18.803140 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3c7913-3b20-4634-8d61-f72792d7586b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:42:18.804046 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3c7913-3b20-4634-8d61-f72792d7586b admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:18.804485 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3c7913-3b20-4634-8d61-f72792d7586b admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:18.804763 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3c7913-3b20-4634-8d61-f72792d7586b admin admin] PATH_INFO: `/v3/projects/86633856901542bc8dab3746f7aae356/users/a7a3608cc8cc4ca4810b3c3d0f425142/roles/4abcf5e5e7cd4b53ae1828fec6550d53` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:18.824439 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3c7913-3b20-4634-8d61-f72792d7586b admin admin] RBAC: Authorizing `identity:create_grant(project_id=86633856901542bc8dab3746f7aae356, user_id=a7a3608cc8cc4ca4810b3c3d0f425142, role_id=4abcf5e5e7cd4b53ae1828fec6550d53)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:42:18.827405 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3c7913-3b20-4634-8d61-f72792d7586b admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:42:18.847024 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1211/2378] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:42:18 2022] PUT /identity/v3/projects/86633856901542bc8dab3746f7aae356/users/a7a3608cc8cc4ca4810b3c3d0f425142/roles/4abcf5e5e7cd4b53ae1828fec6550d53 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:42:18.859650 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881afc26-9f75-4b67-a30a-a0e6df7b850c None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:18.860135 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881afc26-9f75-4b67-a30a-a0e6df7b850c None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:18.860489 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881afc26-9f75-4b67-a30a-a0e6df7b850c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:18.893098 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-881afc26-9f75-4b67-a30a-a0e6df7b850c None None] MFA Rules not processed for user `a7a3608cc8cc4ca4810b3c3d0f425142`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:42:18.894642 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-881afc26-9f75-4b67-a30a-a0e6df7b850c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:42:18.983746 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1168/2379] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:42:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:42:18.988175 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3c7913-3b20-4634-8d61-f72792d7586b admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:42:19.052686 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:42:19.079002 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3c7913-3b20-4634-8d61-f72792d7586b admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:42:19.084440 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3efc61-f7fa-41dd-8b7a-209538ebcd96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:42:19.085406 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3efc61-f7fa-41dd-8b7a-209538ebcd96 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:19.085843 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3efc61-f7fa-41dd-8b7a-209538ebcd96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:19.086302 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3efc61-f7fa-41dd-8b7a-209538ebcd96 admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:19.087191 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3efc61-f7fa-41dd-8b7a-209538ebcd96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:42:19.089685 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3efc61-f7fa-41dd-8b7a-209538ebcd96 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:42:19.120441 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1212/2380] 10.222.0.118 () {60 vars in 1157 bytes} [Thu Jul 14 15:42:18 2022] POST /identity/v3/projects => generated 368 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:42:19.125786 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881afc26-9f75-4b67-a30a-a0e6df7b850c None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:42:19.145899 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881afc26-9f75-4b67-a30a-a0e6df7b850c None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:42:19.209333 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086da7d6-eb4e-49a3-b895-17774dfd30bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:42:19.210064 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086da7d6-eb4e-49a3-b895-17774dfd30bd admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:19.210378 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086da7d6-eb4e-49a3-b895-17774dfd30bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:19.210652 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086da7d6-eb4e-49a3-b895-17774dfd30bd admin admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:19.211350 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086da7d6-eb4e-49a3-b895-17774dfd30bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:42:19.213283 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086da7d6-eb4e-49a3-b895-17774dfd30bd admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:42:19.220880 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:42:19.238627 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1169/2381] 10.222.0.118 () {60 vars in 1148 bytes} [Thu Jul 14 15:42:19 2022] POST /identity/v3/users => generated 291 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:42:19.240175 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3efc61-f7fa-41dd-8b7a-209538ebcd96 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:42:19.251924 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3efc61-f7fa-41dd-8b7a-209538ebcd96 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:42:19.256509 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310eca7e-621b-4be3-97dc-b3b5a484b119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:42:19.257164 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310eca7e-621b-4be3-97dc-b3b5a484b119 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:19.257439 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310eca7e-621b-4be3-97dc-b3b5a484b119 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:19.257706 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310eca7e-621b-4be3-97dc-b3b5a484b119 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:19.258462 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310eca7e-621b-4be3-97dc-b3b5a484b119 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:42:19.260059 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310eca7e-621b-4be3-97dc-b3b5a484b119 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:42:19.272263 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1213/2382] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:42:19 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:42:19.276500 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086da7d6-eb4e-49a3-b895-17774dfd30bd admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:42:19.286560 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086da7d6-eb4e-49a3-b895-17774dfd30bd admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:42:19.291159 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c55980-fdef-4b45-93b5-7bc74fb78dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:42:19.292071 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c55980-fdef-4b45-93b5-7bc74fb78dcc admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:19.292343 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c55980-fdef-4b45-93b5-7bc74fb78dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:19.292614 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c55980-fdef-4b45-93b5-7bc74fb78dcc admin admin] PATH_INFO: `/v3/projects/0d7022c67bc94ea2b0ef2d8eae438859/users/85cdfbc9404a47a8872723ed18c28ff4/roles/3b880cef7dcf4baf87b50f8610c0c56e` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:19.308713 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c55980-fdef-4b45-93b5-7bc74fb78dcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d7022c67bc94ea2b0ef2d8eae438859, user_id=85cdfbc9404a47a8872723ed18c28ff4, role_id=3b880cef7dcf4baf87b50f8610c0c56e)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:42:19.311930 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c55980-fdef-4b45-93b5-7bc74fb78dcc admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:42:19.326432 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1170/2383] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:42:19 2022] PUT /identity/v3/projects/0d7022c67bc94ea2b0ef2d8eae438859/users/85cdfbc9404a47a8872723ed18c28ff4/roles/3b880cef7dcf4baf87b50f8610c0c56e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:42:19.331077 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310eca7e-621b-4be3-97dc-b3b5a484b119 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:42:19.341086 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310eca7e-621b-4be3-97dc-b3b5a484b119 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:42:19.363882 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c55980-fdef-4b45-93b5-7bc74fb78dcc admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:42:19.365728 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-19c55980-fdef-4b45-93b5-7bc74fb78dcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:42:19.405460 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c913b9a-b325-4f1a-9bb0-0f6cb98b7c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:42:19.411645 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c913b9a-b325-4f1a-9bb0-0f6cb98b7c74 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:19.411645 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c913b9a-b325-4f1a-9bb0-0f6cb98b7c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:19.411645 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c913b9a-b325-4f1a-9bb0-0f6cb98b7c74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:19.411645 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c913b9a-b325-4f1a-9bb0-0f6cb98b7c74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:42:19.413337 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c913b9a-b325-4f1a-9bb0-0f6cb98b7c74 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:42:19.425774 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1214/2384] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:42:19 2022] GET /identity/v3/roles => generated 1427 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:42:19.428360 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c55980-fdef-4b45-93b5-7bc74fb78dcc admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:42:19.430060 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c913b9a-b325-4f1a-9bb0-0f6cb98b7c74 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:42:19.432629 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352e71e4-0e07-49b5-82bb-3261fa3bc34a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b650be8114b64df0ac88441f1c50b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:42:19.433363 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352e71e4-0e07-49b5-82bb-3261fa3bc34a service neutron] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:19.433744 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352e71e4-0e07-49b5-82bb-3261fa3bc34a service neutron] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:19.434108 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352e71e4-0e07-49b5-82bb-3261fa3bc34a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:19.436739 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-352e71e4-0e07-49b5-82bb-3261fa3bc34a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:42:19.441210 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c913b9a-b325-4f1a-9bb0-0f6cb98b7c74 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:42:19.446143 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ef0a50-0e85-49ac-b78f-5e7342925743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:42:19.447350 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ef0a50-0e85-49ac-b78f-5e7342925743 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:19.447471 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ef0a50-0e85-49ac-b78f-5e7342925743 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:19.448317 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ef0a50-0e85-49ac-b78f-5e7342925743 admin admin] PATH_INFO: `/v3/projects/0d7022c67bc94ea2b0ef2d8eae438859/users/85cdfbc9404a47a8872723ed18c28ff4/roles/3b880cef7dcf4baf87b50f8610c0c56e` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:19.448830 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352e71e4-0e07-49b5-82bb-3261fa3bc34a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:42:19.450560 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ef0a50-0e85-49ac-b78f-5e7342925743 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d7022c67bc94ea2b0ef2d8eae438859, user_id=85cdfbc9404a47a8872723ed18c28ff4, role_id=3b880cef7dcf4baf87b50f8610c0c56e)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:42:19.452572 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352e71e4-0e07-49b5-82bb-3261fa3bc34a service neutron] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:42:19.454585 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ef0a50-0e85-49ac-b78f-5e7342925743 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:42:19.463719 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1171/2385] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:42:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:42:19.467056 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1215/2386] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:42:19 2022] PUT /identity/v3/projects/0d7022c67bc94ea2b0ef2d8eae438859/users/85cdfbc9404a47a8872723ed18c28ff4/roles/3b880cef7dcf4baf87b50f8610c0c56e => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:42:19.477457 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5e9fb9-a3ef-4827-8d8a-c2f6944ff86c None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:19.477742 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5e9fb9-a3ef-4827-8d8a-c2f6944ff86c None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:19.478048 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5e9fb9-a3ef-4827-8d8a-c2f6944ff86c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:19.509680 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-4e5e9fb9-a3ef-4827-8d8a-c2f6944ff86c None None] MFA Rules not processed for user `85cdfbc9404a47a8872723ed18c28ff4`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:42:19.511015 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-4e5e9fb9-a3ef-4827-8d8a-c2f6944ff86c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:42:19.607175 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1172/2387] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:42:19 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:42:19.624771 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ef0a50-0e85-49ac-b78f-5e7342925743 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:42:19.627036 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-80ef0a50-0e85-49ac-b78f-5e7342925743 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:42:19.714950 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ef0a50-0e85-49ac-b78f-5e7342925743 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:42:19.718688 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c97960-ee42-4eab-a1b5-93c9227065c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea647438ea1c438987f28cbe39c3ff2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:42:19.719342 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c97960-ee42-4eab-a1b5-93c9227065c7 service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:19.719627 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c97960-ee42-4eab-a1b5-93c9227065c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:19.719904 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c97960-ee42-4eab-a1b5-93c9227065c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:19.730287 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c97960-ee42-4eab-a1b5-93c9227065c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:42:19.731788 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c97960-ee42-4eab-a1b5-93c9227065c7 service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:42:19.743550 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1216/2388] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:42:19 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:42:19.823325 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5e9fb9-a3ef-4827-8d8a-c2f6944ff86c None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:42:19.834514 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5e9fb9-a3ef-4827-8d8a-c2f6944ff86c None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:42:19.838306 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d115c642-72e4-452a-806b-781462e4b245 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea647438ea1c438987f28cbe39c3ff2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:42:19.839026 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d115c642-72e4-452a-806b-781462e4b245 service cinder] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:19.839851 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d115c642-72e4-452a-806b-781462e4b245 service cinder] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:19.839851 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d115c642-72e4-452a-806b-781462e4b245 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:19.894179 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:42:19.904798 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d115c642-72e4-452a-806b-781462e4b245 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:42:19.906643 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d115c642-72e4-452a-806b-781462e4b245 service cinder] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:42:19.917465 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1173/2389] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:42:19 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:42:24.786393 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c97960-ee42-4eab-a1b5-93c9227065c7 service cinder] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:42:24.789518 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-f0c97960-ee42-4eab-a1b5-93c9227065c7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:42:24.851254 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:42:24.876400 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c97960-ee42-4eab-a1b5-93c9227065c7 service cinder] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:42:24.882705 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56be3ef0-3b0d-413a-a357-fe2c32f6deb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:42:24.883719 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56be3ef0-3b0d-413a-a357-fe2c32f6deb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:24.884130 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56be3ef0-3b0d-413a-a357-fe2c32f6deb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:24.884582 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56be3ef0-3b0d-413a-a357-fe2c32f6deb7 admin admin] PATH_INFO: `/v3/users/0a16c4c6af304e1d95351905f454172f` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:24.886184 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56be3ef0-3b0d-413a-a357-fe2c32f6deb7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a16c4c6af304e1d95351905f454172f)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:42:24.888812 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56be3ef0-3b0d-413a-a357-fe2c32f6deb7 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:42:24.915763 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d115c642-72e4-452a-806b-781462e4b245 service cinder] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:42:24.928242 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d115c642-72e4-452a-806b-781462e4b245 service cinder] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:42:24.934018 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fd35ff-caf3-4c97-b0b3-ca33f3eb5139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:42:24.934878 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fd35ff-caf3-4c97-b0b3-ca33f3eb5139 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:24.935160 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fd35ff-caf3-4c97-b0b3-ca33f3eb5139 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:24.935446 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fd35ff-caf3-4c97-b0b3-ca33f3eb5139 admin admin] PATH_INFO: `/v3/users/a7a3608cc8cc4ca4810b3c3d0f425142` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:24.936897 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fd35ff-caf3-4c97-b0b3-ca33f3eb5139 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7a3608cc8cc4ca4810b3c3d0f425142)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:42:24.939703 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fd35ff-caf3-4c97-b0b3-ca33f3eb5139 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:42:24.955473 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-56be3ef0-3b0d-413a-a357-fe2c32f6deb7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a16c4c6af304e1d95351905f454172f'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:24.964571 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-56be3ef0-3b0d-413a-a357-fe2c32f6deb7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a16c4c6af304e1d95351905f454172f'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:24.965739 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-56be3ef0-3b0d-413a-a357-fe2c32f6deb7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a16c4c6af304e1d95351905f454172f'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:24.966667 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-56be3ef0-3b0d-413a-a357-fe2c32f6deb7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a16c4c6af304e1d95351905f454172f'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:24.992240 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-56be3ef0-3b0d-413a-a357-fe2c32f6deb7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a16c4c6af304e1d95351905f454172f'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:25.014887 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1217/2390] 10.222.0.118 () {58 vars in 1228 bytes} [Thu Jul 14 15:42:24 2022] DELETE /identity/v3/users/0a16c4c6af304e1d95351905f454172f => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:42:25.059350 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-e7fd35ff-caf3-4c97-b0b3-ca33f3eb5139 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7a3608cc8cc4ca4810b3c3d0f425142'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:25.094899 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-e7fd35ff-caf3-4c97-b0b3-ca33f3eb5139 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7a3608cc8cc4ca4810b3c3d0f425142'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:25.095960 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-e7fd35ff-caf3-4c97-b0b3-ca33f3eb5139 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7a3608cc8cc4ca4810b3c3d0f425142'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:25.097630 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-e7fd35ff-caf3-4c97-b0b3-ca33f3eb5139 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7a3608cc8cc4ca4810b3c3d0f425142'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:25.112854 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-e7fd35ff-caf3-4c97-b0b3-ca33f3eb5139 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7a3608cc8cc4ca4810b3c3d0f425142'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:25.155445 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1174/2391] 10.222.0.118 () {58 vars in 1228 bytes} [Thu Jul 14 15:42:24 2022] DELETE /identity/v3/users/a7a3608cc8cc4ca4810b3c3d0f425142 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:42:25.163769 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b33a3c2-8c69-4583-b314-05a288dba36c None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:25.164065 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b33a3c2-8c69-4583-b314-05a288dba36c None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:25.164355 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b33a3c2-8c69-4583-b314-05a288dba36c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:25.195565 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-5b33a3c2-8c69-4583-b314-05a288dba36c None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:42:25.196721 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-5b33a3c2-8c69-4583-b314-05a288dba36c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:42:25.264750 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1218/2392] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:42:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:42:25.275525 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fd35ff-caf3-4c97-b0b3-ca33f3eb5139 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:42:25.277014 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-e7fd35ff-caf3-4c97-b0b3-ca33f3eb5139 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:42:25.304540 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b33a3c2-8c69-4583-b314-05a288dba36c None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:42:25.306340 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-5b33a3c2-8c69-4583-b314-05a288dba36c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:42:25.325384 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b33a3c2-8c69-4583-b314-05a288dba36c None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:42:25.331161 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828406ed-b180-4e6a-8146-80605f01a374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:42:25.332160 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828406ed-b180-4e6a-8146-80605f01a374 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:25.332439 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828406ed-b180-4e6a-8146-80605f01a374 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:25.332752 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828406ed-b180-4e6a-8146-80605f01a374 admin admin] PATH_INFO: `/v3/projects/60609d474b2c47f597068596158670cf` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:25.333985 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828406ed-b180-4e6a-8146-80605f01a374 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60609d474b2c47f597068596158670cf)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:42:25.335886 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828406ed-b180-4e6a-8146-80605f01a374 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:42:25.361219 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fd35ff-caf3-4c97-b0b3-ca33f3eb5139 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:42:25.365667 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aac004-e509-42e7-8a7e-2fddadbed30d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b650be8114b64df0ac88441f1c50b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:42:25.366550 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aac004-e509-42e7-8a7e-2fddadbed30d service neutron] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:25.367152 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aac004-e509-42e7-8a7e-2fddadbed30d service neutron] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:25.367496 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aac004-e509-42e7-8a7e-2fddadbed30d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:25.379268 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aac004-e509-42e7-8a7e-2fddadbed30d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:42:25.381026 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aac004-e509-42e7-8a7e-2fddadbed30d service neutron] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:42:25.390865 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-828406ed-b180-4e6a-8146-80605f01a374 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60609d474b2c47f597068596158670cf', 'request_id': 'req-828406ed-b180-4e6a-8146-80605f01a374'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:25.392498 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1175/2393] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:42:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:42:25.398706 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:42:25.400400 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-828406ed-b180-4e6a-8146-80605f01a374 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60609d474b2c47f597068596158670cf', 'request_id': 'req-828406ed-b180-4e6a-8146-80605f01a374'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:25.410726 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-828406ed-b180-4e6a-8146-80605f01a374 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60609d474b2c47f597068596158670cf', 'request_id': 'req-828406ed-b180-4e6a-8146-80605f01a374'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:25.431957 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-828406ed-b180-4e6a-8146-80605f01a374 admin admin] The token cache is being invalidate because project 60609d474b2c47f597068596158670cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:42:25.432524 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-828406ed-b180-4e6a-8146-80605f01a374 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:25.433591 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-828406ed-b180-4e6a-8146-80605f01a374 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:25.435677 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1219/2394] 10.222.0.118 () {58 vars in 1237 bytes} [Thu Jul 14 15:42:25 2022] DELETE /identity/v3/projects/60609d474b2c47f597068596158670cf => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:42:25.757540 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aac004-e509-42e7-8a7e-2fddadbed30d service neutron] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:42:25.759226 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-c2aac004-e509-42e7-8a7e-2fddadbed30d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:42:25.774557 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aac004-e509-42e7-8a7e-2fddadbed30d service neutron] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:42:25.848461 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babac3ea-95f1-4fb0-a26b-dd28dff4b6db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:42:25.849598 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babac3ea-95f1-4fb0-a26b-dd28dff4b6db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:25.849879 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babac3ea-95f1-4fb0-a26b-dd28dff4b6db admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:25.850184 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babac3ea-95f1-4fb0-a26b-dd28dff4b6db admin admin] PATH_INFO: `/v3/projects/86633856901542bc8dab3746f7aae356` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:25.851379 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babac3ea-95f1-4fb0-a26b-dd28dff4b6db admin admin] RBAC: Authorizing `identity:delete_project(project_id=86633856901542bc8dab3746f7aae356)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:42:25.853282 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babac3ea-95f1-4fb0-a26b-dd28dff4b6db admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:42:25.861297 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:42:25.902483 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-babac3ea-95f1-4fb0-a26b-dd28dff4b6db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86633856901542bc8dab3746f7aae356', 'request_id': 'req-babac3ea-95f1-4fb0-a26b-dd28dff4b6db'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:25.909162 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-babac3ea-95f1-4fb0-a26b-dd28dff4b6db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86633856901542bc8dab3746f7aae356', 'request_id': 'req-babac3ea-95f1-4fb0-a26b-dd28dff4b6db'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:25.915497 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-babac3ea-95f1-4fb0-a26b-dd28dff4b6db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86633856901542bc8dab3746f7aae356', 'request_id': 'req-babac3ea-95f1-4fb0-a26b-dd28dff4b6db'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:25.927746 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-babac3ea-95f1-4fb0-a26b-dd28dff4b6db admin admin] The token cache is being invalidate because project 86633856901542bc8dab3746f7aae356 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:42:25.928376 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-babac3ea-95f1-4fb0-a26b-dd28dff4b6db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:25.928682 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-babac3ea-95f1-4fb0-a26b-dd28dff4b6db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:25.930332 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1176/2395] 10.222.0.118 () {58 vars in 1237 bytes} [Thu Jul 14 15:42:25 2022] DELETE /identity/v3/projects/86633856901542bc8dab3746f7aae356 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:42:25.934588 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828406ed-b180-4e6a-8146-80605f01a374 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:42:25.936081 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-828406ed-b180-4e6a-8146-80605f01a374 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:42:25.948926 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828406ed-b180-4e6a-8146-80605f01a374 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:42:26.006797 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca270165-e4e1-4cb1-8e3a-808fa0aebfc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:42:26.007668 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca270165-e4e1-4cb1-8e3a-808fa0aebfc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:26.007965 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca270165-e4e1-4cb1-8e3a-808fa0aebfc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:26.008235 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca270165-e4e1-4cb1-8e3a-808fa0aebfc1 admin admin] PATH_INFO: `/v3/users/85cdfbc9404a47a8872723ed18c28ff4` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:26.009400 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca270165-e4e1-4cb1-8e3a-808fa0aebfc1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85cdfbc9404a47a8872723ed18c28ff4)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:42:26.011367 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca270165-e4e1-4cb1-8e3a-808fa0aebfc1 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:42:26.057533 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-ca270165-e4e1-4cb1-8e3a-808fa0aebfc1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85cdfbc9404a47a8872723ed18c28ff4'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:26.064987 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-ca270165-e4e1-4cb1-8e3a-808fa0aebfc1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85cdfbc9404a47a8872723ed18c28ff4'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:26.065652 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-ca270165-e4e1-4cb1-8e3a-808fa0aebfc1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85cdfbc9404a47a8872723ed18c28ff4'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:26.066281 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-ca270165-e4e1-4cb1-8e3a-808fa0aebfc1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85cdfbc9404a47a8872723ed18c28ff4'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:26.078549 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-ca270165-e4e1-4cb1-8e3a-808fa0aebfc1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85cdfbc9404a47a8872723ed18c28ff4'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:26.091107 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1220/2396] 10.222.0.118 () {58 vars in 1228 bytes} [Thu Jul 14 15:42:25 2022] DELETE /identity/v3/users/85cdfbc9404a47a8872723ed18c28ff4 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:42:26.266583 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9fad56-d91d-4c95-b330-0b9de3948287 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:26.266853 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9fad56-d91d-4c95-b330-0b9de3948287 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:26.267127 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9fad56-d91d-4c95-b330-0b9de3948287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:26.285083 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-aa9fad56-d91d-4c95-b330-0b9de3948287 None None] MFA Rules not processed for user `f7ad5ae70939416e8157693e02997a58`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:42:26.286256 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-aa9fad56-d91d-4c95-b330-0b9de3948287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:42:26.345370 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1177/2397] 10.222.0.118 () {58 vars in 972 bytes} [Thu Jul 14 15:42:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:42:26.400149 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca270165-e4e1-4cb1-8e3a-808fa0aebfc1 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:42:26.401583 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-ca270165-e4e1-4cb1-8e3a-808fa0aebfc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:42:26.439732 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9fad56-d91d-4c95-b330-0b9de3948287 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:42:26.441117 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-aa9fad56-d91d-4c95-b330-0b9de3948287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:42:26.489160 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca270165-e4e1-4cb1-8e3a-808fa0aebfc1 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:42:26.494369 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0c445a-5578-41ab-a3eb-e9cc67976865 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b672a6a601584d2d826147069e90a10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:42:26.495017 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c445a-5578-41ab-a3eb-e9cc67976865 service swift] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:26.495293 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c445a-5578-41ab-a3eb-e9cc67976865 service swift] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:26.495568 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c445a-5578-41ab-a3eb-e9cc67976865 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:26.502181 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:42:26.506586 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0c445a-5578-41ab-a3eb-e9cc67976865 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:42:26.509740 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0c445a-5578-41ab-a3eb-e9cc67976865 service swift] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:42:26.520056 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1221/2398] 10.222.0.118 () {60 vars in 1389 bytes} [Thu Jul 14 15:42:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 15:42:26.544031 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9fad56-d91d-4c95-b330-0b9de3948287 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:42:26.549236 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d59290f-b2c0-4a7f-9a9d-bd14e657aaa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:42:26.550134 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d59290f-b2c0-4a7f-9a9d-bd14e657aaa4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:26.550542 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d59290f-b2c0-4a7f-9a9d-bd14e657aaa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:26.550679 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d59290f-b2c0-4a7f-9a9d-bd14e657aaa4 admin admin] PATH_INFO: `/v3/projects/0d7022c67bc94ea2b0ef2d8eae438859` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:26.552342 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d59290f-b2c0-4a7f-9a9d-bd14e657aaa4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d7022c67bc94ea2b0ef2d8eae438859)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:42:26.554515 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d59290f-b2c0-4a7f-9a9d-bd14e657aaa4 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:42:26.603161 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:42:26.608368 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-0d59290f-b2c0-4a7f-9a9d-bd14e657aaa4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d7022c67bc94ea2b0ef2d8eae438859', 'request_id': 'req-0d59290f-b2c0-4a7f-9a9d-bd14e657aaa4'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:26.617142 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-0d59290f-b2c0-4a7f-9a9d-bd14e657aaa4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d7022c67bc94ea2b0ef2d8eae438859', 'request_id': 'req-0d59290f-b2c0-4a7f-9a9d-bd14e657aaa4'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:26.623219 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-0d59290f-b2c0-4a7f-9a9d-bd14e657aaa4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d7022c67bc94ea2b0ef2d8eae438859', 'request_id': 'req-0d59290f-b2c0-4a7f-9a9d-bd14e657aaa4'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:26.638761 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-0d59290f-b2c0-4a7f-9a9d-bd14e657aaa4 admin admin] The token cache is being invalidate because project 0d7022c67bc94ea2b0ef2d8eae438859 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:42:26.639130 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-0d59290f-b2c0-4a7f-9a9d-bd14e657aaa4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:26.639811 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-0d59290f-b2c0-4a7f-9a9d-bd14e657aaa4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:26.641725 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1178/2399] 10.222.0.118 () {58 vars in 1237 bytes} [Thu Jul 14 15:42:26 2022] DELETE /identity/v3/projects/0d7022c67bc94ea2b0ef2d8eae438859 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:42:26.646745 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc218d-c351-44ed-ac8d-95ea2b3ca73a None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:26.647034 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc218d-c351-44ed-ac8d-95ea2b3ca73a None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:26.647392 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc218d-c351-44ed-ac8d-95ea2b3ca73a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:26.665461 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-57bc218d-c351-44ed-ac8d-95ea2b3ca73a None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:42:26.666800 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-57bc218d-c351-44ed-ac8d-95ea2b3ca73a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:42:26.732975 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1222/2400] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:42:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:42:26.741500 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e96848-b453-4f09-9714-90788a1efc54 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:26.742647 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e96848-b453-4f09-9714-90788a1efc54 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:26.742972 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e96848-b453-4f09-9714-90788a1efc54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:26.763514 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-f9e96848-b453-4f09-9714-90788a1efc54 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:42:26.765129 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-f9e96848-b453-4f09-9714-90788a1efc54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:42:26.774613 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1179/2401] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:42:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:42:26.778979 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bc218d-c351-44ed-ac8d-95ea2b3ca73a None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:42:26.789983 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bc218d-c351-44ed-ac8d-95ea2b3ca73a None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:42:26.794801 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab0fd84-9141-4ad2-a207-b8d7fd67581f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:42:26.795464 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab0fd84-9141-4ad2-a207-b8d7fd67581f admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:26.795746 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab0fd84-9141-4ad2-a207-b8d7fd67581f admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:26.796023 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab0fd84-9141-4ad2-a207-b8d7fd67581f admin admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:26.797319 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab0fd84-9141-4ad2-a207-b8d7fd67581f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:42:26.797631 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab0fd84-9141-4ad2-a207-b8d7fd67581f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:42:26.799283 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab0fd84-9141-4ad2-a207-b8d7fd67581f admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:42:26.811336 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1223/2402] 10.222.0.118 () {58 vars in 1157 bytes} [Thu Jul 14 15:42:26 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:42:26.815771 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e96848-b453-4f09-9714-90788a1efc54 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:42:26.825265 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e96848-b453-4f09-9714-90788a1efc54 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:42:26.829937 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46595c6-7da8-4bcf-900c-6bf74f131e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:42:26.830635 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46595c6-7da8-4bcf-900c-6bf74f131e21 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:26.830915 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46595c6-7da8-4bcf-900c-6bf74f131e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:26.831195 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46595c6-7da8-4bcf-900c-6bf74f131e21 admin admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:26.831892 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46595c6-7da8-4bcf-900c-6bf74f131e21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:42:26.833795 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46595c6-7da8-4bcf-900c-6bf74f131e21 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:42:26.866431 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1180/2403] 10.222.0.118 () {60 vars in 1157 bytes} [Thu Jul 14 15:42:26 2022] POST /identity/v3/projects => generated 378 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:42:26.868162 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab0fd84-9141-4ad2-a207-b8d7fd67581f admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:42:26.878461 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab0fd84-9141-4ad2-a207-b8d7fd67581f admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:42:26.939420 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c018854-8fae-4da4-acbf-c8ce4d79bc46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:42:26.940091 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c018854-8fae-4da4-acbf-c8ce4d79bc46 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:26.940357 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c018854-8fae-4da4-acbf-c8ce4d79bc46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:26.940618 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c018854-8fae-4da4-acbf-c8ce4d79bc46 admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:26.941316 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c018854-8fae-4da4-acbf-c8ce4d79bc46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:42:26.943265 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c018854-8fae-4da4-acbf-c8ce4d79bc46 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:42:26.963954 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1224/2404] 10.222.0.118 () {60 vars in 1148 bytes} [Thu Jul 14 15:42:26 2022] POST /identity/v3/users => generated 290 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:42:26.968056 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46595c6-7da8-4bcf-900c-6bf74f131e21 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:42:26.979291 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46595c6-7da8-4bcf-900c-6bf74f131e21 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:42:26.985250 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16546943-06b1-49ef-9573-cac51da0a829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:42:26.985945 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16546943-06b1-49ef-9573-cac51da0a829 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:26.986244 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16546943-06b1-49ef-9573-cac51da0a829 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:26.986516 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16546943-06b1-49ef-9573-cac51da0a829 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:26.987235 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16546943-06b1-49ef-9573-cac51da0a829 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:42:26.988866 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16546943-06b1-49ef-9573-cac51da0a829 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:42:26.999944 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1181/2405] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:42:26 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:42:27.003918 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c018854-8fae-4da4-acbf-c8ce4d79bc46 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:42:27.013891 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c018854-8fae-4da4-acbf-c8ce4d79bc46 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:42:27.018803 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b63371-9a58-4b50-9a03-c33333961cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:42:27.019585 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b63371-9a58-4b50-9a03-c33333961cc4 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:27.019870 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b63371-9a58-4b50-9a03-c33333961cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:27.020148 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b63371-9a58-4b50-9a03-c33333961cc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:27.020887 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b63371-9a58-4b50-9a03-c33333961cc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:42:27.022526 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b63371-9a58-4b50-9a03-c33333961cc4 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:42:27.033411 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1225/2406] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:42:27 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:42:27.037715 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16546943-06b1-49ef-9573-cac51da0a829 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:42:27.049670 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16546943-06b1-49ef-9573-cac51da0a829 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:42:27.054549 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e543596a-d8b3-47a5-996a-cec9a9329383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:42:27.055438 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e543596a-d8b3-47a5-996a-cec9a9329383 admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:27.055720 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e543596a-d8b3-47a5-996a-cec9a9329383 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:27.056020 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e543596a-d8b3-47a5-996a-cec9a9329383 admin admin] PATH_INFO: `/v3/projects/2653326932de4c3980c2843dee25e1ee/users/3098878e338148bd89d854f7f1692644/roles/4abcf5e5e7cd4b53ae1828fec6550d53` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:27.071413 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e543596a-d8b3-47a5-996a-cec9a9329383 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2653326932de4c3980c2843dee25e1ee, user_id=3098878e338148bd89d854f7f1692644, role_id=4abcf5e5e7cd4b53ae1828fec6550d53)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:42:27.074245 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e543596a-d8b3-47a5-996a-cec9a9329383 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:42:27.087958 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1182/2407] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:42:27 2022] PUT /identity/v3/projects/2653326932de4c3980c2843dee25e1ee/users/3098878e338148bd89d854f7f1692644/roles/4abcf5e5e7cd4b53ae1828fec6550d53 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:42:27.100159 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8c0a2d-5a8e-4315-8364-e8db61f02b98 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:27.100469 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8c0a2d-5a8e-4315-8364-e8db61f02b98 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:27.100754 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8c0a2d-5a8e-4315-8364-e8db61f02b98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:27.128574 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-7b8c0a2d-5a8e-4315-8364-e8db61f02b98 None None] MFA Rules not processed for user `3098878e338148bd89d854f7f1692644`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:42:27.129718 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-7b8c0a2d-5a8e-4315-8364-e8db61f02b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:42:27.182222 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:42:27.201793 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1226/2408] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:42:27 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:42:27.213597 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e543596a-d8b3-47a5-996a-cec9a9329383 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:42:27.215320 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-e543596a-d8b3-47a5-996a-cec9a9329383 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:42:27.273442 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e543596a-d8b3-47a5-996a-cec9a9329383 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:42:27.277174 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332b0e98-ee8e-4810-b015-a2a9e505a038 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea647438ea1c438987f28cbe39c3ff2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:42:27.278191 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332b0e98-ee8e-4810-b015-a2a9e505a038 service cinder] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:27.278191 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332b0e98-ee8e-4810-b015-a2a9e505a038 service cinder] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:27.278416 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332b0e98-ee8e-4810-b015-a2a9e505a038 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:27.289084 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332b0e98-ee8e-4810-b015-a2a9e505a038 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:42:27.290686 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332b0e98-ee8e-4810-b015-a2a9e505a038 service cinder] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:42:27.300872 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1183/2409] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:42:27 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:42:33.809122 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8c0a2d-5a8e-4315-8364-e8db61f02b98 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:42:33.810563 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-7b8c0a2d-5a8e-4315-8364-e8db61f02b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:42:33.891971 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8c0a2d-5a8e-4315-8364-e8db61f02b98 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:42:33.901801 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b191451c-7a27-4111-82f5-ffab81f3aa95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:42:33.902975 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b191451c-7a27-4111-82f5-ffab81f3aa95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:33.903248 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b191451c-7a27-4111-82f5-ffab81f3aa95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:33.903529 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b191451c-7a27-4111-82f5-ffab81f3aa95 admin admin] PATH_INFO: `/v3/users/c5564b64f20d4b62979cd0eef1b172be` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:33.904772 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b191451c-7a27-4111-82f5-ffab81f3aa95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5564b64f20d4b62979cd0eef1b172be)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:42:33.907030 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b191451c-7a27-4111-82f5-ffab81f3aa95 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:42:33.974399 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-b191451c-7a27-4111-82f5-ffab81f3aa95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5564b64f20d4b62979cd0eef1b172be'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:34.000528 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-b191451c-7a27-4111-82f5-ffab81f3aa95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5564b64f20d4b62979cd0eef1b172be'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:34.003247 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-b191451c-7a27-4111-82f5-ffab81f3aa95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5564b64f20d4b62979cd0eef1b172be'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:34.006753 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-b191451c-7a27-4111-82f5-ffab81f3aa95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5564b64f20d4b62979cd0eef1b172be'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:34.026563 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-b191451c-7a27-4111-82f5-ffab81f3aa95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5564b64f20d4b62979cd0eef1b172be'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:34.042299 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1227/2410] 10.222.0.118 () {58 vars in 1228 bytes} [Thu Jul 14 15:42:33 2022] DELETE /identity/v3/users/c5564b64f20d4b62979cd0eef1b172be => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:42:34.243742 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332b0e98-ee8e-4810-b015-a2a9e505a038 service cinder] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:42:34.256280 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332b0e98-ee8e-4810-b015-a2a9e505a038 service cinder] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:42:34.316000 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31febb44-86fb-4e32-83a2-7a9a9e1689a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:42:34.316864 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31febb44-86fb-4e32-83a2-7a9a9e1689a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:34.317143 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31febb44-86fb-4e32-83a2-7a9a9e1689a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:34.317417 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31febb44-86fb-4e32-83a2-7a9a9e1689a5 admin admin] PATH_INFO: `/v3/projects/6eb77a1b18ba44b5b2d3ff346d747857` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:34.318685 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31febb44-86fb-4e32-83a2-7a9a9e1689a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6eb77a1b18ba44b5b2d3ff346d747857)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:42:34.320609 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31febb44-86fb-4e32-83a2-7a9a9e1689a5 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:42:34.331882 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:42:34.369455 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-31febb44-86fb-4e32-83a2-7a9a9e1689a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6eb77a1b18ba44b5b2d3ff346d747857', 'request_id': 'req-31febb44-86fb-4e32-83a2-7a9a9e1689a5'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:34.375904 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-31febb44-86fb-4e32-83a2-7a9a9e1689a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6eb77a1b18ba44b5b2d3ff346d747857', 'request_id': 'req-31febb44-86fb-4e32-83a2-7a9a9e1689a5'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:34.381520 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-31febb44-86fb-4e32-83a2-7a9a9e1689a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6eb77a1b18ba44b5b2d3ff346d747857', 'request_id': 'req-31febb44-86fb-4e32-83a2-7a9a9e1689a5'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:34.394118 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-31febb44-86fb-4e32-83a2-7a9a9e1689a5 admin admin] The token cache is being invalidate because project 6eb77a1b18ba44b5b2d3ff346d747857 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:42:34.394405 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-31febb44-86fb-4e32-83a2-7a9a9e1689a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:34.395062 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-31febb44-86fb-4e32-83a2-7a9a9e1689a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:34.396655 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1184/2411] 10.222.0.118 () {58 vars in 1237 bytes} [Thu Jul 14 15:42:34 2022] DELETE /identity/v3/projects/6eb77a1b18ba44b5b2d3ff346d747857 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:42:34.401019 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b191451c-7a27-4111-82f5-ffab81f3aa95 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:42:34.402674 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-b191451c-7a27-4111-82f5-ffab81f3aa95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:42:34.416184 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b191451c-7a27-4111-82f5-ffab81f3aa95 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:42:34.472000 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52657fa0-0b02-4b0b-89b0-ec0ec5a431df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:42:34.472873 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52657fa0-0b02-4b0b-89b0-ec0ec5a431df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:34.473163 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52657fa0-0b02-4b0b-89b0-ec0ec5a431df admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:34.473439 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52657fa0-0b02-4b0b-89b0-ec0ec5a431df admin admin] PATH_INFO: `/v3/users/a550c98bfc824a71b9cbcf4ece937cbe` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:34.474683 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52657fa0-0b02-4b0b-89b0-ec0ec5a431df admin admin] RBAC: Authorizing `identity:delete_user(user_id=a550c98bfc824a71b9cbcf4ece937cbe)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:42:34.476681 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52657fa0-0b02-4b0b-89b0-ec0ec5a431df admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:42:34.487636 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:42:34.525938 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-52657fa0-0b02-4b0b-89b0-ec0ec5a431df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a550c98bfc824a71b9cbcf4ece937cbe'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:34.533302 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-52657fa0-0b02-4b0b-89b0-ec0ec5a431df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a550c98bfc824a71b9cbcf4ece937cbe'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:34.533977 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-52657fa0-0b02-4b0b-89b0-ec0ec5a431df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a550c98bfc824a71b9cbcf4ece937cbe'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:34.534592 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-52657fa0-0b02-4b0b-89b0-ec0ec5a431df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a550c98bfc824a71b9cbcf4ece937cbe'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:34.547221 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-52657fa0-0b02-4b0b-89b0-ec0ec5a431df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a550c98bfc824a71b9cbcf4ece937cbe'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:34.560990 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1228/2412] 10.222.0.118 () {58 vars in 1228 bytes} [Thu Jul 14 15:42:34 2022] DELETE /identity/v3/users/a550c98bfc824a71b9cbcf4ece937cbe => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:42:34.734377 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31febb44-86fb-4e32-83a2-7a9a9e1689a5 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:42:34.735841 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-31febb44-86fb-4e32-83a2-7a9a9e1689a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:42:34.750323 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31febb44-86fb-4e32-83a2-7a9a9e1689a5 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:42:34.809100 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8578031e-8b18-4a8f-b49c-763385cfb878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:42:34.809888 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8578031e-8b18-4a8f-b49c-763385cfb878 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:34.810196 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8578031e-8b18-4a8f-b49c-763385cfb878 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:34.810472 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8578031e-8b18-4a8f-b49c-763385cfb878 admin admin] PATH_INFO: `/v3/projects/cfc1eeae448347c2aba4bda0489c4069` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:34.811650 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8578031e-8b18-4a8f-b49c-763385cfb878 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfc1eeae448347c2aba4bda0489c4069)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:42:34.813580 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8578031e-8b18-4a8f-b49c-763385cfb878 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:42:34.860366 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-8578031e-8b18-4a8f-b49c-763385cfb878 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfc1eeae448347c2aba4bda0489c4069', 'request_id': 'req-8578031e-8b18-4a8f-b49c-763385cfb878'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:34.866744 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-8578031e-8b18-4a8f-b49c-763385cfb878 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfc1eeae448347c2aba4bda0489c4069', 'request_id': 'req-8578031e-8b18-4a8f-b49c-763385cfb878'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:34.872155 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-8578031e-8b18-4a8f-b49c-763385cfb878 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfc1eeae448347c2aba4bda0489c4069', 'request_id': 'req-8578031e-8b18-4a8f-b49c-763385cfb878'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:34.884321 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-8578031e-8b18-4a8f-b49c-763385cfb878 admin admin] The token cache is being invalidate because project cfc1eeae448347c2aba4bda0489c4069 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:42:34.884712 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-8578031e-8b18-4a8f-b49c-763385cfb878 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:34.885331 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-8578031e-8b18-4a8f-b49c-763385cfb878 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:34.886917 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1185/2413] 10.222.0.118 () {58 vars in 1237 bytes} [Thu Jul 14 15:42:34 2022] DELETE /identity/v3/projects/cfc1eeae448347c2aba4bda0489c4069 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:42:39.012891 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52657fa0-0b02-4b0b-89b0-ec0ec5a431df admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:42:39.015126 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-52657fa0-0b02-4b0b-89b0-ec0ec5a431df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:42:39.027621 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52657fa0-0b02-4b0b-89b0-ec0ec5a431df admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:42:39.082875 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61e33a2-d0a5-44e6-97f0-f392271282ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:42:39.083736 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61e33a2-d0a5-44e6-97f0-f392271282ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:39.084013 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61e33a2-d0a5-44e6-97f0-f392271282ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:39.084282 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61e33a2-d0a5-44e6-97f0-f392271282ae admin admin] PATH_INFO: `/v3/users/3098878e338148bd89d854f7f1692644` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:39.085448 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61e33a2-d0a5-44e6-97f0-f392271282ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=3098878e338148bd89d854f7f1692644)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:42:39.087405 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61e33a2-d0a5-44e6-97f0-f392271282ae admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:42:39.133557 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-a61e33a2-d0a5-44e6-97f0-f392271282ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3098878e338148bd89d854f7f1692644'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:39.140347 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-a61e33a2-d0a5-44e6-97f0-f392271282ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3098878e338148bd89d854f7f1692644'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:39.141025 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-a61e33a2-d0a5-44e6-97f0-f392271282ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3098878e338148bd89d854f7f1692644'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:39.141641 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-a61e33a2-d0a5-44e6-97f0-f392271282ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3098878e338148bd89d854f7f1692644'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:39.153327 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-a61e33a2-d0a5-44e6-97f0-f392271282ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3098878e338148bd89d854f7f1692644'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:39.166365 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1229/2414] 10.222.0.118 () {58 vars in 1228 bytes} [Thu Jul 14 15:42:39 2022] DELETE /identity/v3/users/3098878e338148bd89d854f7f1692644 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:42:39.171532 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f5b035-54fc-4566-8a93-fedc0508d173 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:39.172000 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f5b035-54fc-4566-8a93-fedc0508d173 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:39.172097 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f5b035-54fc-4566-8a93-fedc0508d173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:39.190465 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-c1f5b035-54fc-4566-8a93-fedc0508d173 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:42:39.191686 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-c1f5b035-54fc-4566-8a93-fedc0508d173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:42:39.216586 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:42:39.254575 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1186/2415] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:42:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:42:39.264143 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61e33a2-d0a5-44e6-97f0-f392271282ae admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:42:39.265547 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-a61e33a2-d0a5-44e6-97f0-f392271282ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:42:39.275556 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:DELETE=20,keystone:SELECT=78,keystone:INSERT=2 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:42:39.325863 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61e33a2-d0a5-44e6-97f0-f392271282ae admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:42:39.329530 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce03a55-dbd3-4308-a1c2-8ed6edcde10b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b650be8114b64df0ac88441f1c50b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:42:39.330220 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce03a55-dbd3-4308-a1c2-8ed6edcde10b service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:39.330501 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce03a55-dbd3-4308-a1c2-8ed6edcde10b service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:39.330774 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce03a55-dbd3-4308-a1c2-8ed6edcde10b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:39.339674 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce03a55-dbd3-4308-a1c2-8ed6edcde10b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:42:39.341098 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce03a55-dbd3-4308-a1c2-8ed6edcde10b service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:42:39.350548 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1230/2416] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:42:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:42:39.622270 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f5b035-54fc-4566-8a93-fedc0508d173 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:42:39.623814 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-c1f5b035-54fc-4566-8a93-fedc0508d173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:42:39.636569 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f5b035-54fc-4566-8a93-fedc0508d173 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:42:39.641398 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d6ee93-0102-4031-8e93-1a9d9a7aa943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:42:39.642295 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d6ee93-0102-4031-8e93-1a9d9a7aa943 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:39.643172 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d6ee93-0102-4031-8e93-1a9d9a7aa943 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:39.643480 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d6ee93-0102-4031-8e93-1a9d9a7aa943 admin admin] PATH_INFO: `/v3/projects/2653326932de4c3980c2843dee25e1ee` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:39.644862 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d6ee93-0102-4031-8e93-1a9d9a7aa943 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2653326932de4c3980c2843dee25e1ee)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:42:39.646894 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d6ee93-0102-4031-8e93-1a9d9a7aa943 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:42:39.694776 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-24d6ee93-0102-4031-8e93-1a9d9a7aa943 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2653326932de4c3980c2843dee25e1ee', 'request_id': 'req-24d6ee93-0102-4031-8e93-1a9d9a7aa943'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:39.701334 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-24d6ee93-0102-4031-8e93-1a9d9a7aa943 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2653326932de4c3980c2843dee25e1ee', 'request_id': 'req-24d6ee93-0102-4031-8e93-1a9d9a7aa943'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:39.708242 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-24d6ee93-0102-4031-8e93-1a9d9a7aa943 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2653326932de4c3980c2843dee25e1ee', 'request_id': 'req-24d6ee93-0102-4031-8e93-1a9d9a7aa943'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:39.722679 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-24d6ee93-0102-4031-8e93-1a9d9a7aa943 admin admin] The token cache is being invalidate because project 2653326932de4c3980c2843dee25e1ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:42:39.722973 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-24d6ee93-0102-4031-8e93-1a9d9a7aa943 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:39.723616 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-24d6ee93-0102-4031-8e93-1a9d9a7aa943 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:39.725214 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1187/2417] 10.222.0.118 () {58 vars in 1237 bytes} [Thu Jul 14 15:42:39 2022] DELETE /identity/v3/projects/2653326932de4c3980c2843dee25e1ee => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:42:39.730118 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0d2b13-d8a7-43dc-867f-9229bca78316 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:39.730403 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0d2b13-d8a7-43dc-867f-9229bca78316 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:39.730705 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0d2b13-d8a7-43dc-867f-9229bca78316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:39.748930 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-5b0d2b13-d8a7-43dc-867f-9229bca78316 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:42:39.750187 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-5b0d2b13-d8a7-43dc-867f-9229bca78316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:42:39.812419 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1231/2418] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:42:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:42:39.820073 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abb06cc-efc9-41cc-8a43-a2a084fae158 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:39.820363 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abb06cc-efc9-41cc-8a43-a2a084fae158 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:39.820641 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abb06cc-efc9-41cc-8a43-a2a084fae158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:39.839177 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-9abb06cc-efc9-41cc-8a43-a2a084fae158 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:42:39.840408 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-9abb06cc-efc9-41cc-8a43-a2a084fae158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:42:39.848901 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1188/2419] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:42:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:42:39.853259 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0d2b13-d8a7-43dc-867f-9229bca78316 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:42:39.863811 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0d2b13-d8a7-43dc-867f-9229bca78316 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:42:39.868721 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3ab700-1d5c-4f59-af9a-61975a50d3de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:42:39.869379 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3ab700-1d5c-4f59-af9a-61975a50d3de admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:39.869656 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3ab700-1d5c-4f59-af9a-61975a50d3de admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:39.870029 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3ab700-1d5c-4f59-af9a-61975a50d3de admin admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:39.870831 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3ab700-1d5c-4f59-af9a-61975a50d3de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:42:39.871134 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3ab700-1d5c-4f59-af9a-61975a50d3de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:42:39.872749 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3ab700-1d5c-4f59-af9a-61975a50d3de admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:42:39.897728 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1232/2420] 10.222.0.118 () {58 vars in 1157 bytes} [Thu Jul 14 15:42:39 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:42:39.901860 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abb06cc-efc9-41cc-8a43-a2a084fae158 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:42:39.911782 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abb06cc-efc9-41cc-8a43-a2a084fae158 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:42:39.916444 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06956e5-83df-44f3-a4ac-686da543ec44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:42:39.917092 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06956e5-83df-44f3-a4ac-686da543ec44 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:39.917371 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06956e5-83df-44f3-a4ac-686da543ec44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:39.917643 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06956e5-83df-44f3-a4ac-686da543ec44 admin admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:39.918368 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06956e5-83df-44f3-a4ac-686da543ec44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:42:39.920249 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06956e5-83df-44f3-a4ac-686da543ec44 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:42:39.945319 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1189/2421] 10.222.0.118 () {60 vars in 1157 bytes} [Thu Jul 14 15:42:39 2022] POST /identity/v3/projects => generated 376 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:42:39.949364 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3ab700-1d5c-4f59-af9a-61975a50d3de admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:42:39.959791 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3ab700-1d5c-4f59-af9a-61975a50d3de admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:42:40.015314 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05768526-e2ea-47ba-bbe6-7066f847f9ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:42:40.015978 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05768526-e2ea-47ba-bbe6-7066f847f9ea admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:40.016255 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05768526-e2ea-47ba-bbe6-7066f847f9ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:40.016528 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05768526-e2ea-47ba-bbe6-7066f847f9ea admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:40.017209 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05768526-e2ea-47ba-bbe6-7066f847f9ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:42:40.019234 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05768526-e2ea-47ba-bbe6-7066f847f9ea admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:42:40.047312 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1233/2422] 10.222.0.118 () {60 vars in 1148 bytes} [Thu Jul 14 15:42:39 2022] POST /identity/v3/users => generated 289 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:42:40.051552 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06956e5-83df-44f3-a4ac-686da543ec44 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:42:40.062281 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06956e5-83df-44f3-a4ac-686da543ec44 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:42:40.067077 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ad7671-6e38-4157-992e-fce3277d35cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:42:40.067764 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ad7671-6e38-4157-992e-fce3277d35cf admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:40.068042 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ad7671-6e38-4157-992e-fce3277d35cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:40.068310 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ad7671-6e38-4157-992e-fce3277d35cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:40.069029 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ad7671-6e38-4157-992e-fce3277d35cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:42:40.070829 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ad7671-6e38-4157-992e-fce3277d35cf admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:42:40.082171 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1190/2423] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:42:40 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:42:40.086173 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05768526-e2ea-47ba-bbe6-7066f847f9ea admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:42:40.096716 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05768526-e2ea-47ba-bbe6-7066f847f9ea admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:42:40.101498 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cf18ed-bb1d-4648-8ae7-fd1422566673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:42:40.102184 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf18ed-bb1d-4648-8ae7-fd1422566673 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:40.102462 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf18ed-bb1d-4648-8ae7-fd1422566673 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:40.102734 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf18ed-bb1d-4648-8ae7-fd1422566673 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:40.103458 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cf18ed-bb1d-4648-8ae7-fd1422566673 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:42:40.105081 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cf18ed-bb1d-4648-8ae7-fd1422566673 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:42:40.114912 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1234/2424] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:42:40 2022] GET /identity/v3/roles => generated 1427 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:42:40.119068 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ad7671-6e38-4157-992e-fce3277d35cf admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:42:40.129689 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ad7671-6e38-4157-992e-fce3277d35cf admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:42:40.134361 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f07ec8-63df-4b5c-a423-22d7345bcea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:42:40.135233 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f07ec8-63df-4b5c-a423-22d7345bcea0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:40.135513 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f07ec8-63df-4b5c-a423-22d7345bcea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:40.135786 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f07ec8-63df-4b5c-a423-22d7345bcea0 admin admin] PATH_INFO: `/v3/projects/346c9b487dee4dcc9ad7f939247ae74c/users/3e35a682b4654d2b871c8c1a0848b424/roles/4abcf5e5e7cd4b53ae1828fec6550d53` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:40.151617 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f07ec8-63df-4b5c-a423-22d7345bcea0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=346c9b487dee4dcc9ad7f939247ae74c, user_id=3e35a682b4654d2b871c8c1a0848b424, role_id=4abcf5e5e7cd4b53ae1828fec6550d53)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:42:40.154338 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f07ec8-63df-4b5c-a423-22d7345bcea0 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:42:40.169233 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1191/2425] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:42:40 2022] PUT /identity/v3/projects/346c9b487dee4dcc9ad7f939247ae74c/users/3e35a682b4654d2b871c8c1a0848b424/roles/4abcf5e5e7cd4b53ae1828fec6550d53 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:42:40.180051 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a69088-35cf-4b5d-9e4b-22c55559ca25 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:40.180337 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a69088-35cf-4b5d-9e4b-22c55559ca25 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:40.180640 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a69088-35cf-4b5d-9e4b-22c55559ca25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:40.208439 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-13a69088-35cf-4b5d-9e4b-22c55559ca25 None None] MFA Rules not processed for user `3e35a682b4654d2b871c8c1a0848b424`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:42:40.209605 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-13a69088-35cf-4b5d-9e4b-22c55559ca25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:42:40.213623 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:42:40.277990 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1235/2426] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:42:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:42:40.282464 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f07ec8-63df-4b5c-a423-22d7345bcea0 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:42:40.334506 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:42:40.347825 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f07ec8-63df-4b5c-a423-22d7345bcea0 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:42:40.353091 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990890ec-e4e7-4f71-b7fe-dfc2c513a2ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:42:40.353747 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990890ec-e4e7-4f71-b7fe-dfc2c513a2ec admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:40.354052 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990890ec-e4e7-4f71-b7fe-dfc2c513a2ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:40.354325 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990890ec-e4e7-4f71-b7fe-dfc2c513a2ec admin admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:40.355022 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990890ec-e4e7-4f71-b7fe-dfc2c513a2ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:42:40.356919 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990890ec-e4e7-4f71-b7fe-dfc2c513a2ec admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:42:40.384492 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1192/2427] 10.222.0.118 () {60 vars in 1157 bytes} [Thu Jul 14 15:42:40 2022] POST /identity/v3/projects => generated 376 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:42:40.388473 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a69088-35cf-4b5d-9e4b-22c55559ca25 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:42:40.400649 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a69088-35cf-4b5d-9e4b-22c55559ca25 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:42:40.461986 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620dfc8f-8213-4076-a670-289e84f756a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:42:40.462569 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620dfc8f-8213-4076-a670-289e84f756a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:40.462848 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620dfc8f-8213-4076-a670-289e84f756a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:40.463128 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620dfc8f-8213-4076-a670-289e84f756a7 admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:40.463828 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620dfc8f-8213-4076-a670-289e84f756a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:42:40.465797 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620dfc8f-8213-4076-a670-289e84f756a7 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:42:40.489107 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1236/2428] 10.222.0.118 () {60 vars in 1148 bytes} [Thu Jul 14 15:42:40 2022] POST /identity/v3/users => generated 289 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:42:40.490300 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990890ec-e4e7-4f71-b7fe-dfc2c513a2ec admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:42:40.501329 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990890ec-e4e7-4f71-b7fe-dfc2c513a2ec admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:42:40.515479 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81699e90-5e64-4d4d-82db-adc5947d3ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:42:40.515981 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81699e90-5e64-4d4d-82db-adc5947d3ce2 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:40.516264 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81699e90-5e64-4d4d-82db-adc5947d3ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:40.516539 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81699e90-5e64-4d4d-82db-adc5947d3ce2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:40.517280 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81699e90-5e64-4d4d-82db-adc5947d3ce2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:42:40.518928 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81699e90-5e64-4d4d-82db-adc5947d3ce2 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:42:40.530496 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1193/2429] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:42:40 2022] GET /identity/v3/roles => generated 1427 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:42:40.534453 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620dfc8f-8213-4076-a670-289e84f756a7 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:42:40.545308 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620dfc8f-8213-4076-a670-289e84f756a7 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:42:40.550094 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623f97cf-9c0f-4997-a904-bdbe01729e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:42:40.550766 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623f97cf-9c0f-4997-a904-bdbe01729e3f admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:40.551074 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623f97cf-9c0f-4997-a904-bdbe01729e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:40.551324 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623f97cf-9c0f-4997-a904-bdbe01729e3f admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:40.552176 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623f97cf-9c0f-4997-a904-bdbe01729e3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:42:40.554775 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623f97cf-9c0f-4997-a904-bdbe01729e3f admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:42:40.566883 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1237/2430] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:42:40 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:42:40.571515 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81699e90-5e64-4d4d-82db-adc5947d3ce2 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:42:40.582902 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81699e90-5e64-4d4d-82db-adc5947d3ce2 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:42:40.587711 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c61773d-d9f1-4863-936b-3d8df871f3fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:42:40.588607 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c61773d-d9f1-4863-936b-3d8df871f3fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:40.589020 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c61773d-d9f1-4863-936b-3d8df871f3fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:40.589304 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c61773d-d9f1-4863-936b-3d8df871f3fe admin admin] PATH_INFO: `/v3/projects/b8f0253b5c524256841c18794d616c8e/users/f8874ea492894dba87b045cb41b0be14/roles/4abcf5e5e7cd4b53ae1828fec6550d53` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:40.604437 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c61773d-d9f1-4863-936b-3d8df871f3fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8f0253b5c524256841c18794d616c8e, user_id=f8874ea492894dba87b045cb41b0be14, role_id=4abcf5e5e7cd4b53ae1828fec6550d53)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:42:40.607150 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c61773d-d9f1-4863-936b-3d8df871f3fe admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:42:40.622956 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1194/2431] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:42:40 2022] PUT /identity/v3/projects/b8f0253b5c524256841c18794d616c8e/users/f8874ea492894dba87b045cb41b0be14/roles/4abcf5e5e7cd4b53ae1828fec6550d53 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:42:40.634619 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6942ed07-7beb-4dd2-8a47-535d948abbcd None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:40.634986 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6942ed07-7beb-4dd2-8a47-535d948abbcd None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:40.635268 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6942ed07-7beb-4dd2-8a47-535d948abbcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:40.661747 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-6942ed07-7beb-4dd2-8a47-535d948abbcd None None] MFA Rules not processed for user `f8874ea492894dba87b045cb41b0be14`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:42:40.663026 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-6942ed07-7beb-4dd2-8a47-535d948abbcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:42:40.726875 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1238/2432] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:42:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:42:40.731334 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c61773d-d9f1-4863-936b-3d8df871f3fe admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:42:40.791847 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c61773d-d9f1-4863-936b-3d8df871f3fe admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:42:40.797036 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66f4ed8-c431-4353-a889-daecaae2a7b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:42:40.797690 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f4ed8-c431-4353-a889-daecaae2a7b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:40.797987 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f4ed8-c431-4353-a889-daecaae2a7b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:40.798266 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f4ed8-c431-4353-a889-daecaae2a7b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:40.798951 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66f4ed8-c431-4353-a889-daecaae2a7b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:42:40.800861 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66f4ed8-c431-4353-a889-daecaae2a7b6 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:42:40.826643 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1195/2433] 10.222.0.118 () {60 vars in 1157 bytes} [Thu Jul 14 15:42:40 2022] POST /identity/v3/projects => generated 376 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:42:40.830278 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6942ed07-7beb-4dd2-8a47-535d948abbcd None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:42:40.841367 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6942ed07-7beb-4dd2-8a47-535d948abbcd None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:42:40.850467 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:42:40.900464 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e02ef17-bf24-4f02-8754-b13e7cbf63ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:42:40.901170 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e02ef17-bf24-4f02-8754-b13e7cbf63ca admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:40.901452 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e02ef17-bf24-4f02-8754-b13e7cbf63ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:40.901726 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e02ef17-bf24-4f02-8754-b13e7cbf63ca admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:40.902460 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e02ef17-bf24-4f02-8754-b13e7cbf63ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:42:40.904413 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e02ef17-bf24-4f02-8754-b13e7cbf63ca admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:42:40.929349 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1239/2434] 10.222.0.118 () {60 vars in 1148 bytes} [Thu Jul 14 15:42:40 2022] POST /identity/v3/users => generated 295 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:42:40.930566 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66f4ed8-c431-4353-a889-daecaae2a7b6 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:42:40.943136 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66f4ed8-c431-4353-a889-daecaae2a7b6 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:42:40.947814 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc60839-63c4-48f8-af78-ed6d26451139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:42:40.948488 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc60839-63c4-48f8-af78-ed6d26451139 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:40.948772 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc60839-63c4-48f8-af78-ed6d26451139 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:40.949051 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc60839-63c4-48f8-af78-ed6d26451139 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:40.949813 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc60839-63c4-48f8-af78-ed6d26451139 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:42:40.951462 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc60839-63c4-48f8-af78-ed6d26451139 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:42:40.963252 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1196/2435] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:42:40 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:42:40.967440 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e02ef17-bf24-4f02-8754-b13e7cbf63ca admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:42:40.978540 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e02ef17-bf24-4f02-8754-b13e7cbf63ca admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:42:40.983636 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd23e381-f16c-4f8b-b072-2fe7cb8e8806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:42:40.985049 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd23e381-f16c-4f8b-b072-2fe7cb8e8806 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:40.985326 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd23e381-f16c-4f8b-b072-2fe7cb8e8806 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:40.985598 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd23e381-f16c-4f8b-b072-2fe7cb8e8806 admin admin] PATH_INFO: `/v3/projects/af22e5721d81442b8c3c074c984fc879/users/c155ce1aa8b8411f876ab3b69c7ece5a/roles/3b880cef7dcf4baf87b50f8610c0c56e` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:41.001986 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd23e381-f16c-4f8b-b072-2fe7cb8e8806 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af22e5721d81442b8c3c074c984fc879, user_id=c155ce1aa8b8411f876ab3b69c7ece5a, role_id=3b880cef7dcf4baf87b50f8610c0c56e)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:42:41.004811 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd23e381-f16c-4f8b-b072-2fe7cb8e8806 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:42:41.019184 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1240/2436] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:42:40 2022] PUT /identity/v3/projects/af22e5721d81442b8c3c074c984fc879/users/c155ce1aa8b8411f876ab3b69c7ece5a/roles/3b880cef7dcf4baf87b50f8610c0c56e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:42:41.023132 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc60839-63c4-48f8-af78-ed6d26451139 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:42:41.033708 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc60839-63c4-48f8-af78-ed6d26451139 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:42:41.090591 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9c8063-2f44-4587-a836-c0e81ada4dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:42:41.091258 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9c8063-2f44-4587-a836-c0e81ada4dae admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:41.091540 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9c8063-2f44-4587-a836-c0e81ada4dae admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:41.091815 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9c8063-2f44-4587-a836-c0e81ada4dae admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:41.092539 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9c8063-2f44-4587-a836-c0e81ada4dae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:42:41.094670 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9c8063-2f44-4587-a836-c0e81ada4dae admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:42:41.104339 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1197/2437] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:42:41 2022] GET /identity/v3/roles => generated 1427 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:42:41.108597 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd23e381-f16c-4f8b-b072-2fe7cb8e8806 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:42:41.119650 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd23e381-f16c-4f8b-b072-2fe7cb8e8806 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:42:41.124252 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bbbb71-378a-4b73-8cdb-7128f0663347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:42:41.125140 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bbbb71-378a-4b73-8cdb-7128f0663347 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:41.125454 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bbbb71-378a-4b73-8cdb-7128f0663347 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:41.125689 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bbbb71-378a-4b73-8cdb-7128f0663347 admin admin] PATH_INFO: `/v3/projects/af22e5721d81442b8c3c074c984fc879/users/c155ce1aa8b8411f876ab3b69c7ece5a/roles/3b880cef7dcf4baf87b50f8610c0c56e` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:41.127690 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bbbb71-378a-4b73-8cdb-7128f0663347 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af22e5721d81442b8c3c074c984fc879, user_id=c155ce1aa8b8411f876ab3b69c7ece5a, role_id=3b880cef7dcf4baf87b50f8610c0c56e)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:42:41.130352 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bbbb71-378a-4b73-8cdb-7128f0663347 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:42:41.140322 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1241/2438] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:42:41 2022] PUT /identity/v3/projects/af22e5721d81442b8c3c074c984fc879/users/c155ce1aa8b8411f876ab3b69c7ece5a/roles/3b880cef7dcf4baf87b50f8610c0c56e => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:42:41.150260 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d647f93a-f835-4327-b3af-7e911444aaa6 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:41.150625 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d647f93a-f835-4327-b3af-7e911444aaa6 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:41.150910 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d647f93a-f835-4327-b3af-7e911444aaa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:41.171071 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:42:41.182202 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-d647f93a-f835-4327-b3af-7e911444aaa6 None None] MFA Rules not processed for user `c155ce1aa8b8411f876ab3b69c7ece5a`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:42:41.183548 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-d647f93a-f835-4327-b3af-7e911444aaa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:42:41.250738 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1198/2439] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:42:41 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:42:41.261782 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bbbb71-378a-4b73-8cdb-7128f0663347 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:42:41.263502 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-c1bbbb71-378a-4b73-8cdb-7128f0663347 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:42:41.319539 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bbbb71-378a-4b73-8cdb-7128f0663347 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:42:41.323071 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785e71a9-ac0a-4228-8c6d-7035d2811a73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea647438ea1c438987f28cbe39c3ff2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:42:41.323724 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785e71a9-ac0a-4228-8c6d-7035d2811a73 service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:41.324001 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785e71a9-ac0a-4228-8c6d-7035d2811a73 service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:41.324275 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785e71a9-ac0a-4228-8c6d-7035d2811a73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:41.382122 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785e71a9-ac0a-4228-8c6d-7035d2811a73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:42:41.383560 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785e71a9-ac0a-4228-8c6d-7035d2811a73 service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:42:41.393288 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1242/2440] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:42:41 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:42:42.392071 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d647f93a-f835-4327-b3af-7e911444aaa6 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:42:42.393612 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-d647f93a-f835-4327-b3af-7e911444aaa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:42:42.474793 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d647f93a-f835-4327-b3af-7e911444aaa6 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:42:42.480743 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2db9f1e-5e28-43ba-a040-98cef3c08c66 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0177fc696ea40069902803da09f437c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:42:42.481394 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2db9f1e-5e28-43ba-a040-98cef3c08c66 service nova] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:42.481675 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2db9f1e-5e28-43ba-a040-98cef3c08c66 service nova] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:42.481949 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2db9f1e-5e28-43ba-a040-98cef3c08c66 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:42.483843 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-d2db9f1e-5e28-43ba-a040-98cef3c08c66 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:42:42.497488 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2db9f1e-5e28-43ba-a040-98cef3c08c66 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:42:42.499093 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2db9f1e-5e28-43ba-a040-98cef3c08c66 service nova] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:42:42.512490 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1199/2441] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:42:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:42:42.626620 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21112131-a1c2-4dc0-88b7-da2006862656 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:42.627081 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21112131-a1c2-4dc0-88b7-da2006862656 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:42.627174 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21112131-a1c2-4dc0-88b7-da2006862656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:42.644170 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-21112131-a1c2-4dc0-88b7-da2006862656 None None] MFA Rules not processed for user `f7ad5ae70939416e8157693e02997a58`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:42:42.645360 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-21112131-a1c2-4dc0-88b7-da2006862656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:42:42.658735 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:42:42.704295 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1243/2442] 10.222.0.118 () {58 vars in 1014 bytes} [Thu Jul 14 15:42:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:42:42.717559 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2db9f1e-5e28-43ba-a040-98cef3c08c66 service nova] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:42:42.723371 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-d2db9f1e-5e28-43ba-a040-98cef3c08c66 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:42:42.796994 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2db9f1e-5e28-43ba-a040-98cef3c08c66 service nova] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:42:42.802071 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672e1701-a60d-40d7-96f1-bcc647f73aea service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b672a6a601584d2d826147069e90a10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:42:42.802723 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672e1701-a60d-40d7-96f1-bcc647f73aea service swift] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:42.803005 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672e1701-a60d-40d7-96f1-bcc647f73aea service swift] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:42.803278 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672e1701-a60d-40d7-96f1-bcc647f73aea service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:42.813204 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672e1701-a60d-40d7-96f1-bcc647f73aea service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:42:42.814823 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672e1701-a60d-40d7-96f1-bcc647f73aea service swift] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:42:42.823084 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1200/2443] 10.222.0.118 () {60 vars in 1389 bytes} [Thu Jul 14 15:42:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 15:42:42.887590 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21112131-a1c2-4dc0-88b7-da2006862656 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:42:42.889097 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-21112131-a1c2-4dc0-88b7-da2006862656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:42:42.901562 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21112131-a1c2-4dc0-88b7-da2006862656 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:42:42.908143 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0969bdea-ea20-4563-a287-2c265588e609 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea647438ea1c438987f28cbe39c3ff2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:42:42.908824 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0969bdea-ea20-4563-a287-2c265588e609 service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:42.909109 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0969bdea-ea20-4563-a287-2c265588e609 service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:42.909385 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0969bdea-ea20-4563-a287-2c265588e609 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:42.979138 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0969bdea-ea20-4563-a287-2c265588e609 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:42:42.980637 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0969bdea-ea20-4563-a287-2c265588e609 service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:42:42.992045 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1244/2444] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:42:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:42:43.628731 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672e1701-a60d-40d7-96f1-bcc647f73aea service swift] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:42:43.639591 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672e1701-a60d-40d7-96f1-bcc647f73aea service swift] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:42:43.645113 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ff303f-08eb-42ef-adac-f4447e70383c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea647438ea1c438987f28cbe39c3ff2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:42:43.646248 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ff303f-08eb-42ef-adac-f4447e70383c service cinder] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:43.646696 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ff303f-08eb-42ef-adac-f4447e70383c service cinder] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:43.647062 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ff303f-08eb-42ef-adac-f4447e70383c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:43.658571 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ff303f-08eb-42ef-adac-f4447e70383c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:42:43.660018 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ff303f-08eb-42ef-adac-f4447e70383c service cinder] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:42:43.665541 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:42:43.675262 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1201/2445] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:42:43 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:42:47.636369 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0969bdea-ea20-4563-a287-2c265588e609 service cinder] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:42:47.720246 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0969bdea-ea20-4563-a287-2c265588e609 service cinder] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:42:47.726161 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773784a5-5686-4901-98b6-c2f9c3716300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:42:47.727402 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773784a5-5686-4901-98b6-c2f9c3716300 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:47.727837 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773784a5-5686-4901-98b6-c2f9c3716300 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:47.728264 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773784a5-5686-4901-98b6-c2f9c3716300 admin admin] PATH_INFO: `/v3/users/3e35a682b4654d2b871c8c1a0848b424` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:47.729656 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773784a5-5686-4901-98b6-c2f9c3716300 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e35a682b4654d2b871c8c1a0848b424)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:42:47.731635 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773784a5-5686-4901-98b6-c2f9c3716300 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:42:47.792317 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-773784a5-5686-4901-98b6-c2f9c3716300 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e35a682b4654d2b871c8c1a0848b424'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:47.800306 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-773784a5-5686-4901-98b6-c2f9c3716300 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e35a682b4654d2b871c8c1a0848b424'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:47.801242 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-773784a5-5686-4901-98b6-c2f9c3716300 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e35a682b4654d2b871c8c1a0848b424'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:47.802048 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-773784a5-5686-4901-98b6-c2f9c3716300 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e35a682b4654d2b871c8c1a0848b424'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:47.812081 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:42:47.820841 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-773784a5-5686-4901-98b6-c2f9c3716300 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e35a682b4654d2b871c8c1a0848b424'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:47.837579 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1245/2446] 10.222.0.118 () {58 vars in 1228 bytes} [Thu Jul 14 15:42:47 2022] DELETE /identity/v3/users/3e35a682b4654d2b871c8c1a0848b424 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:42:47.844221 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88db9b2-c378-410e-8886-cdb55bc53987 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:47.845536 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88db9b2-c378-410e-8886-cdb55bc53987 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:47.846547 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88db9b2-c378-410e-8886-cdb55bc53987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:47.868915 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-f88db9b2-c378-410e-8886-cdb55bc53987 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:42:47.870403 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-f88db9b2-c378-410e-8886-cdb55bc53987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:42:47.968429 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1202/2447] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:42:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:42:47.975557 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773784a5-5686-4901-98b6-c2f9c3716300 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:42:47.977180 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-773784a5-5686-4901-98b6-c2f9c3716300 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:42:48.070635 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773784a5-5686-4901-98b6-c2f9c3716300 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:42:48.074970 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c8f33b-64d4-409d-a812-d9816c22103a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b650be8114b64df0ac88441f1c50b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:42:48.075603 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c8f33b-64d4-409d-a812-d9816c22103a service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:48.075882 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c8f33b-64d4-409d-a812-d9816c22103a service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:48.076143 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c8f33b-64d4-409d-a812-d9816c22103a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:48.086422 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c8f33b-64d4-409d-a812-d9816c22103a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:42:48.087868 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c8f33b-64d4-409d-a812-d9816c22103a service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:42:48.101122 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1246/2448] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:42:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:42:48.553760 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88db9b2-c378-410e-8886-cdb55bc53987 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:42:48.557354 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-f88db9b2-c378-410e-8886-cdb55bc53987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:42:48.570084 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88db9b2-c378-410e-8886-cdb55bc53987 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:42:48.579453 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd20ea21-68d7-4f86-83e2-1c5382d63cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:42:48.580371 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd20ea21-68d7-4f86-83e2-1c5382d63cc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:48.580620 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd20ea21-68d7-4f86-83e2-1c5382d63cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:48.580899 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd20ea21-68d7-4f86-83e2-1c5382d63cc4 admin admin] PATH_INFO: `/v3/projects/346c9b487dee4dcc9ad7f939247ae74c` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:48.582228 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd20ea21-68d7-4f86-83e2-1c5382d63cc4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=346c9b487dee4dcc9ad7f939247ae74c)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:42:48.584191 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd20ea21-68d7-4f86-83e2-1c5382d63cc4 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:42:48.646590 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-fd20ea21-68d7-4f86-83e2-1c5382d63cc4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '346c9b487dee4dcc9ad7f939247ae74c', 'request_id': 'req-fd20ea21-68d7-4f86-83e2-1c5382d63cc4'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:48.657606 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-fd20ea21-68d7-4f86-83e2-1c5382d63cc4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '346c9b487dee4dcc9ad7f939247ae74c', 'request_id': 'req-fd20ea21-68d7-4f86-83e2-1c5382d63cc4'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:48.684923 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-fd20ea21-68d7-4f86-83e2-1c5382d63cc4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '346c9b487dee4dcc9ad7f939247ae74c', 'request_id': 'req-fd20ea21-68d7-4f86-83e2-1c5382d63cc4'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:48.701444 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-fd20ea21-68d7-4f86-83e2-1c5382d63cc4 admin admin] The token cache is being invalidate because project 346c9b487dee4dcc9ad7f939247ae74c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:42:48.701947 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-fd20ea21-68d7-4f86-83e2-1c5382d63cc4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:48.702654 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-fd20ea21-68d7-4f86-83e2-1c5382d63cc4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:48.708238 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1203/2449] 10.222.0.118 () {58 vars in 1237 bytes} [Thu Jul 14 15:42:48 2022] DELETE /identity/v3/projects/346c9b487dee4dcc9ad7f939247ae74c => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:42:48.708448 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c8f33b-64d4-409d-a812-d9816c22103a service neutron] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:42:48.725196 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c8f33b-64d4-409d-a812-d9816c22103a service neutron] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:42:48.807313 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9720f52b-1e3d-4710-b4b7-f7325d01be0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:42:48.809081 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9720f52b-1e3d-4710-b4b7-f7325d01be0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:48.809548 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9720f52b-1e3d-4710-b4b7-f7325d01be0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:48.809830 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9720f52b-1e3d-4710-b4b7-f7325d01be0d admin admin] PATH_INFO: `/v3/users/f8874ea492894dba87b045cb41b0be14` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:48.811107 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9720f52b-1e3d-4710-b4b7-f7325d01be0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8874ea492894dba87b045cb41b0be14)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:42:48.813435 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9720f52b-1e3d-4710-b4b7-f7325d01be0d admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:42:48.877518 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-9720f52b-1e3d-4710-b4b7-f7325d01be0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8874ea492894dba87b045cb41b0be14'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:48.886534 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-9720f52b-1e3d-4710-b4b7-f7325d01be0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8874ea492894dba87b045cb41b0be14'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:48.887169 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-9720f52b-1e3d-4710-b4b7-f7325d01be0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8874ea492894dba87b045cb41b0be14'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:48.888473 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-9720f52b-1e3d-4710-b4b7-f7325d01be0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8874ea492894dba87b045cb41b0be14'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:48.909636 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-9720f52b-1e3d-4710-b4b7-f7325d01be0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8874ea492894dba87b045cb41b0be14'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:48.930760 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1247/2450] 10.222.0.118 () {58 vars in 1228 bytes} [Thu Jul 14 15:42:48 2022] DELETE /identity/v3/users/f8874ea492894dba87b045cb41b0be14 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:42:49.277817 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd20ea21-68d7-4f86-83e2-1c5382d63cc4 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:42:49.280294 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-fd20ea21-68d7-4f86-83e2-1c5382d63cc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:42:49.318560 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd20ea21-68d7-4f86-83e2-1c5382d63cc4 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:42:49.410111 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf65ef09-c1dc-4256-967d-c495cba5fe9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:42:49.411113 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf65ef09-c1dc-4256-967d-c495cba5fe9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:49.411471 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf65ef09-c1dc-4256-967d-c495cba5fe9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:49.411977 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf65ef09-c1dc-4256-967d-c495cba5fe9f admin admin] PATH_INFO: `/v3/projects/b8f0253b5c524256841c18794d616c8e` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:49.413284 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf65ef09-c1dc-4256-967d-c495cba5fe9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8f0253b5c524256841c18794d616c8e)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:42:49.415298 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf65ef09-c1dc-4256-967d-c495cba5fe9f admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:42:49.454678 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:42:49.501494 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-bf65ef09-c1dc-4256-967d-c495cba5fe9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8f0253b5c524256841c18794d616c8e', 'request_id': 'req-bf65ef09-c1dc-4256-967d-c495cba5fe9f'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:49.518569 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-bf65ef09-c1dc-4256-967d-c495cba5fe9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8f0253b5c524256841c18794d616c8e', 'request_id': 'req-bf65ef09-c1dc-4256-967d-c495cba5fe9f'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:49.525746 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-bf65ef09-c1dc-4256-967d-c495cba5fe9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8f0253b5c524256841c18794d616c8e', 'request_id': 'req-bf65ef09-c1dc-4256-967d-c495cba5fe9f'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:49.541737 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-bf65ef09-c1dc-4256-967d-c495cba5fe9f admin admin] The token cache is being invalidate because project b8f0253b5c524256841c18794d616c8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:42:49.542289 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-bf65ef09-c1dc-4256-967d-c495cba5fe9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:49.543026 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-bf65ef09-c1dc-4256-967d-c495cba5fe9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:49.544688 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1204/2451] 10.222.0.118 () {58 vars in 1237 bytes} [Thu Jul 14 15:42:49 2022] DELETE /identity/v3/projects/b8f0253b5c524256841c18794d616c8e => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:42:49.549794 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9720f52b-1e3d-4710-b4b7-f7325d01be0d admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:42:49.551732 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-9720f52b-1e3d-4710-b4b7-f7325d01be0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:42:49.562705 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:42:49.570252 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9720f52b-1e3d-4710-b4b7-f7325d01be0d admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:42:49.649103 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2712aaf8-57a6-44e5-9608-bb6ce741abbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:42:49.650049 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2712aaf8-57a6-44e5-9608-bb6ce741abbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:49.650331 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2712aaf8-57a6-44e5-9608-bb6ce741abbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:49.650608 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2712aaf8-57a6-44e5-9608-bb6ce741abbc admin admin] PATH_INFO: `/v3/users/c155ce1aa8b8411f876ab3b69c7ece5a` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:49.651839 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2712aaf8-57a6-44e5-9608-bb6ce741abbc admin admin] RBAC: Authorizing `identity:delete_user(user_id=c155ce1aa8b8411f876ab3b69c7ece5a)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:42:49.653855 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2712aaf8-57a6-44e5-9608-bb6ce741abbc admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:42:49.732889 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-2712aaf8-57a6-44e5-9608-bb6ce741abbc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c155ce1aa8b8411f876ab3b69c7ece5a'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:49.740668 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-2712aaf8-57a6-44e5-9608-bb6ce741abbc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c155ce1aa8b8411f876ab3b69c7ece5a'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:49.741631 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-2712aaf8-57a6-44e5-9608-bb6ce741abbc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c155ce1aa8b8411f876ab3b69c7ece5a'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:49.742278 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-2712aaf8-57a6-44e5-9608-bb6ce741abbc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c155ce1aa8b8411f876ab3b69c7ece5a'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:49.758234 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-2712aaf8-57a6-44e5-9608-bb6ce741abbc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c155ce1aa8b8411f876ab3b69c7ece5a'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:49.773889 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1248/2452] 10.222.0.118 () {58 vars in 1228 bytes} [Thu Jul 14 15:42:49 2022] DELETE /identity/v3/users/c155ce1aa8b8411f876ab3b69c7ece5a => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:42:50.088160 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf65ef09-c1dc-4256-967d-c495cba5fe9f admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:42:50.089796 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-bf65ef09-c1dc-4256-967d-c495cba5fe9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:42:50.113804 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf65ef09-c1dc-4256-967d-c495cba5fe9f admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:42:50.209430 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ebe220-332a-4839-ad7d-16102e7a49af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:42:50.211834 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ebe220-332a-4839-ad7d-16102e7a49af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:50.212157 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ebe220-332a-4839-ad7d-16102e7a49af admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:50.212498 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ebe220-332a-4839-ad7d-16102e7a49af admin admin] PATH_INFO: `/v3/projects/af22e5721d81442b8c3c074c984fc879` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:50.214389 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ebe220-332a-4839-ad7d-16102e7a49af admin admin] RBAC: Authorizing `identity:delete_project(project_id=af22e5721d81442b8c3c074c984fc879)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:42:50.216616 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ebe220-332a-4839-ad7d-16102e7a49af admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:42:50.278868 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-32ebe220-332a-4839-ad7d-16102e7a49af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af22e5721d81442b8c3c074c984fc879', 'request_id': 'req-32ebe220-332a-4839-ad7d-16102e7a49af'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:50.286565 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-32ebe220-332a-4839-ad7d-16102e7a49af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af22e5721d81442b8c3c074c984fc879', 'request_id': 'req-32ebe220-332a-4839-ad7d-16102e7a49af'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:50.293254 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-32ebe220-332a-4839-ad7d-16102e7a49af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af22e5721d81442b8c3c074c984fc879', 'request_id': 'req-32ebe220-332a-4839-ad7d-16102e7a49af'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:50.309880 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-32ebe220-332a-4839-ad7d-16102e7a49af admin admin] The token cache is being invalidate because project af22e5721d81442b8c3c074c984fc879 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:42:50.310201 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-32ebe220-332a-4839-ad7d-16102e7a49af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:50.311946 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-32ebe220-332a-4839-ad7d-16102e7a49af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:42:50.315169 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1205/2453] 10.222.0.118 () {58 vars in 1237 bytes} [Thu Jul 14 15:42:50 2022] DELETE /identity/v3/projects/af22e5721d81442b8c3c074c984fc879 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:42:50.320296 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afe112f-fafc-4b2f-be08-7cc10fce1927 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:50.320908 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afe112f-fafc-4b2f-be08-7cc10fce1927 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:50.321214 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afe112f-fafc-4b2f-be08-7cc10fce1927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:50.344408 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-1afe112f-fafc-4b2f-be08-7cc10fce1927 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:42:50.345990 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-1afe112f-fafc-4b2f-be08-7cc10fce1927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:42:50.424542 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1249/2454] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:42:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:42:50.496436 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca434e62-5a0b-49f6-af5e-1a2f5715aeb9 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:50.496814 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca434e62-5a0b-49f6-af5e-1a2f5715aeb9 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:50.497132 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca434e62-5a0b-49f6-af5e-1a2f5715aeb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:50.524954 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-ca434e62-5a0b-49f6-af5e-1a2f5715aeb9 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:42:50.526264 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-ca434e62-5a0b-49f6-af5e-1a2f5715aeb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:42:50.535372 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1206/2455] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:42:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:42:50.543642 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afe112f-fafc-4b2f-be08-7cc10fce1927 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:42:50.562818 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afe112f-fafc-4b2f-be08-7cc10fce1927 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:42:50.572643 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a650523-b0ae-4358-905a-fc94d2c4ef10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:42:50.573350 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a650523-b0ae-4358-905a-fc94d2c4ef10 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:50.573661 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a650523-b0ae-4358-905a-fc94d2c4ef10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:50.573911 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a650523-b0ae-4358-905a-fc94d2c4ef10 admin admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:50.574745 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a650523-b0ae-4358-905a-fc94d2c4ef10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:42:50.575031 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a650523-b0ae-4358-905a-fc94d2c4ef10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:42:50.579284 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a650523-b0ae-4358-905a-fc94d2c4ef10 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:42:50.628699 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1250/2456] 10.222.0.118 () {58 vars in 1157 bytes} [Thu Jul 14 15:42:50 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:42:50.634621 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca434e62-5a0b-49f6-af5e-1a2f5715aeb9 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:42:50.645560 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca434e62-5a0b-49f6-af5e-1a2f5715aeb9 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:42:50.650364 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0437397f-b3a1-4027-bd23-25a1aa44a236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:42:50.651033 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0437397f-b3a1-4027-bd23-25a1aa44a236 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:50.651311 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0437397f-b3a1-4027-bd23-25a1aa44a236 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:50.651588 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0437397f-b3a1-4027-bd23-25a1aa44a236 admin admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:50.652268 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0437397f-b3a1-4027-bd23-25a1aa44a236 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:42:50.654371 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0437397f-b3a1-4027-bd23-25a1aa44a236 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:42:50.697339 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1207/2457] 10.222.0.118 () {60 vars in 1157 bytes} [Thu Jul 14 15:42:50 2022] POST /identity/v3/projects => generated 370 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:42:50.701748 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a650523-b0ae-4358-905a-fc94d2c4ef10 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:42:50.720883 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a650523-b0ae-4358-905a-fc94d2c4ef10 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:42:50.738595 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:42:50.820423 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2407b6-b460-441c-888b-72c8d0c3b34f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:42:50.821425 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2407b6-b460-441c-888b-72c8d0c3b34f admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:50.821677 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2407b6-b460-441c-888b-72c8d0c3b34f admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:50.822099 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2407b6-b460-441c-888b-72c8d0c3b34f admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:50.822807 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2407b6-b460-441c-888b-72c8d0c3b34f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:42:50.824777 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2407b6-b460-441c-888b-72c8d0c3b34f admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:42:50.855464 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1251/2458] 10.222.0.118 () {60 vars in 1148 bytes} [Thu Jul 14 15:42:50 2022] POST /identity/v3/users => generated 286 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:42:50.858948 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0437397f-b3a1-4027-bd23-25a1aa44a236 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:42:50.870978 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0437397f-b3a1-4027-bd23-25a1aa44a236 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:42:50.875822 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c304cc0-9bd1-4941-8802-7786794b1bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:42:50.876485 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c304cc0-9bd1-4941-8802-7786794b1bfc admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:50.876768 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c304cc0-9bd1-4941-8802-7786794b1bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:50.877035 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c304cc0-9bd1-4941-8802-7786794b1bfc admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:50.877925 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c304cc0-9bd1-4941-8802-7786794b1bfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:42:50.879625 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c304cc0-9bd1-4941-8802-7786794b1bfc admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:42:50.895090 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1208/2459] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:42:50 2022] GET /identity/v3/roles => generated 1427 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:42:50.896279 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2407b6-b460-441c-888b-72c8d0c3b34f admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:42:50.912167 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2407b6-b460-441c-888b-72c8d0c3b34f admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:42:50.918059 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6381ac21-5dde-4a90-8f1d-b6084a3d7e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:42:50.918879 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6381ac21-5dde-4a90-8f1d-b6084a3d7e71 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:50.919165 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6381ac21-5dde-4a90-8f1d-b6084a3d7e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:50.919445 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6381ac21-5dde-4a90-8f1d-b6084a3d7e71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:50.920244 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6381ac21-5dde-4a90-8f1d-b6084a3d7e71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:42:50.921984 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6381ac21-5dde-4a90-8f1d-b6084a3d7e71 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:42:50.935391 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1252/2460] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:42:50 2022] GET /identity/v3/roles => generated 1427 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:42:50.939078 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c304cc0-9bd1-4941-8802-7786794b1bfc admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:42:50.945047 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:42:50.953244 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c304cc0-9bd1-4941-8802-7786794b1bfc admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:42:50.959510 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f86c195-f653-4f25-b673-c934e99c20b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:42:50.960731 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f86c195-f653-4f25-b673-c934e99c20b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:50.961577 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f86c195-f653-4f25-b673-c934e99c20b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:50.961890 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f86c195-f653-4f25-b673-c934e99c20b9 admin admin] PATH_INFO: `/v3/projects/2889626d82f44e109e2a73c63f0c51c8/users/bc670609063440118548be51aee8c0bc/roles/4abcf5e5e7cd4b53ae1828fec6550d53` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:50.980781 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f86c195-f653-4f25-b673-c934e99c20b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2889626d82f44e109e2a73c63f0c51c8, user_id=bc670609063440118548be51aee8c0bc, role_id=4abcf5e5e7cd4b53ae1828fec6550d53)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:42:50.985946 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f86c195-f653-4f25-b673-c934e99c20b9 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:42:51.004557 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1209/2461] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:42:50 2022] PUT /identity/v3/projects/2889626d82f44e109e2a73c63f0c51c8/users/bc670609063440118548be51aee8c0bc/roles/4abcf5e5e7cd4b53ae1828fec6550d53 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:42:51.019527 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6740d370-b7fa-41a7-9b7b-2bb3acdee8a9 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:51.019880 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6740d370-b7fa-41a7-9b7b-2bb3acdee8a9 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:51.020079 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6740d370-b7fa-41a7-9b7b-2bb3acdee8a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:51.052884 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-6740d370-b7fa-41a7-9b7b-2bb3acdee8a9 None None] MFA Rules not processed for user `bc670609063440118548be51aee8c0bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:42:51.054144 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-6740d370-b7fa-41a7-9b7b-2bb3acdee8a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:42:51.135976 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1253/2462] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:42:51 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:42:51.149091 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f86c195-f653-4f25-b673-c934e99c20b9 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:42:51.151231 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-0f86c195-f653-4f25-b673-c934e99c20b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:42:51.214366 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f86c195-f653-4f25-b673-c934e99c20b9 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:42:51.220591 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d3dcb2-79cb-483e-aef7-a4c27e6ae082 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4336c3d678a4d33b00885def42dfb1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:42:51.221499 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d3dcb2-79cb-483e-aef7-a4c27e6ae082 service glance] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:51.221943 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d3dcb2-79cb-483e-aef7-a4c27e6ae082 service glance] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:51.222240 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d3dcb2-79cb-483e-aef7-a4c27e6ae082 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:51.232228 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d3dcb2-79cb-483e-aef7-a4c27e6ae082 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:42:51.235553 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d3dcb2-79cb-483e-aef7-a4c27e6ae082 service glance] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:42:51.245909 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1210/2463] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:42:51 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:42:57.662110 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6740d370-b7fa-41a7-9b7b-2bb3acdee8a9 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:42:57.663617 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-6740d370-b7fa-41a7-9b7b-2bb3acdee8a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:42:57.732982 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6740d370-b7fa-41a7-9b7b-2bb3acdee8a9 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:42:57.736636 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937ba79c-05f9-4ef6-b1eb-b36ce6b0854a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b650be8114b64df0ac88441f1c50b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:42:57.737265 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937ba79c-05f9-4ef6-b1eb-b36ce6b0854a service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:57.737539 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937ba79c-05f9-4ef6-b1eb-b36ce6b0854a service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:57.737810 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937ba79c-05f9-4ef6-b1eb-b36ce6b0854a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:57.739943 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-937ba79c-05f9-4ef6-b1eb-b36ce6b0854a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:42:57.752293 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937ba79c-05f9-4ef6-b1eb-b36ce6b0854a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:42:57.754033 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937ba79c-05f9-4ef6-b1eb-b36ce6b0854a service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:42:57.761759 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1254/2464] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:42:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:42:58.016939 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd297b7e-0f73-44fd-85bb-6d4787ec84d2 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:58.017419 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd297b7e-0f73-44fd-85bb-6d4787ec84d2 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:58.017534 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd297b7e-0f73-44fd-85bb-6d4787ec84d2 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:58.019297 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1211/2465] 10.222.0.118 () {54 vars in 926 bytes} [Thu Jul 14 15:42:58 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:42:58.025156 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9afe2aa-2939-4540-a3fc-1e3fe7ed159a None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:58.025464 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9afe2aa-2939-4540-a3fc-1e3fe7ed159a None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:58.025739 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9afe2aa-2939-4540-a3fc-1e3fe7ed159a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:58.043615 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-f9afe2aa-2939-4540-a3fc-1e3fe7ed159a None None] MFA Rules not processed for user `f0177fc696ea40069902803da09f437c`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:42:58.044850 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-f9afe2aa-2939-4540-a3fc-1e3fe7ed159a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:42:58.063075 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:42:58.114062 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1255/2466] 10.222.0.118 () {58 vars in 1023 bytes} [Thu Jul 14 15:42:58 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:42:58.129902 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd297b7e-0f73-44fd-85bb-6d4787ec84d2 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:42:58.131941 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-cd297b7e-0f73-44fd-85bb-6d4787ec84d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:42:58.159872 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd297b7e-0f73-44fd-85bb-6d4787ec84d2 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:42:58.169406 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19889ee5-a588-4f9f-a7e2-3a50b7273e18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b650be8114b64df0ac88441f1c50b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:42:58.171587 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19889ee5-a588-4f9f-a7e2-3a50b7273e18 service neutron] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:58.172110 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19889ee5-a588-4f9f-a7e2-3a50b7273e18 service neutron] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:58.172658 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19889ee5-a588-4f9f-a7e2-3a50b7273e18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:58.188325 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19889ee5-a588-4f9f-a7e2-3a50b7273e18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:42:58.189934 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19889ee5-a588-4f9f-a7e2-3a50b7273e18 service neutron] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:42:58.203061 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1212/2467] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:42:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:42:58.272499 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9afe2aa-2939-4540-a3fc-1e3fe7ed159a None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:42:58.273899 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-f9afe2aa-2939-4540-a3fc-1e3fe7ed159a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:42:58.343738 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9afe2aa-2939-4540-a3fc-1e3fe7ed159a None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:42:58.349088 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72312ab-1598-41ba-bfe6-2e675ce7ea53 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b0f8be7e04adca6e3f218fbe3a295', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:42:58.349734 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72312ab-1598-41ba-bfe6-2e675ce7ea53 service placement] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:58.350044 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72312ab-1598-41ba-bfe6-2e675ce7ea53 service placement] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:58.350324 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72312ab-1598-41ba-bfe6-2e675ce7ea53 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:58.352184 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-b72312ab-1598-41ba-bfe6-2e675ce7ea53 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:42:58.364228 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72312ab-1598-41ba-bfe6-2e675ce7ea53 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:42:58.365819 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72312ab-1598-41ba-bfe6-2e675ce7ea53 service placement] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:42:58.377029 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1256/2468] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:42:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:43:00.474354 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35508f4e-9054-45db-b5a1-f18034f61ec0 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:00.474354 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35508f4e-9054-45db-b5a1-f18034f61ec0 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:00.474354 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35508f4e-9054-45db-b5a1-f18034f61ec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:00.491636 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-35508f4e-9054-45db-b5a1-f18034f61ec0 None None] MFA Rules not processed for user `f7ad5ae70939416e8157693e02997a58`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:43:00.492916 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-35508f4e-9054-45db-b5a1-f18034f61ec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:00.573470 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1213/2469] 10.222.0.118 () {58 vars in 1014 bytes} [Thu Jul 14 15:43:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:43:00.590293 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72312ab-1598-41ba-bfe6-2e675ce7ea53 service placement] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:00.592393 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-b72312ab-1598-41ba-bfe6-2e675ce7ea53 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:00.672387 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72312ab-1598-41ba-bfe6-2e675ce7ea53 service placement] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:00.677606 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed71f18-638d-4a96-92e8-c572037c8007 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b672a6a601584d2d826147069e90a10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:00.678293 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed71f18-638d-4a96-92e8-c572037c8007 service swift] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:00.678580 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed71f18-638d-4a96-92e8-c572037c8007 service swift] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:00.678857 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed71f18-638d-4a96-92e8-c572037c8007 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:00.688003 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed71f18-638d-4a96-92e8-c572037c8007 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:00.689682 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed71f18-638d-4a96-92e8-c572037c8007 service swift] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:00.698431 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1257/2470] 10.222.0.118 () {60 vars in 1389 bytes} [Thu Jul 14 15:43:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 15:43:10.559978 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=66,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:43:10.695098 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=85 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:43:12.528157 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35508f4e-9054-45db-b5a1-f18034f61ec0 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:12.530315 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-35508f4e-9054-45db-b5a1-f18034f61ec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:12.551858 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35508f4e-9054-45db-b5a1-f18034f61ec0 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:12.558124 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee15921b-be00-43e9-8726-6fafe2a4b965 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0177fc696ea40069902803da09f437c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:12.559057 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee15921b-be00-43e9-8726-6fafe2a4b965 service nova] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:12.559578 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee15921b-be00-43e9-8726-6fafe2a4b965 service nova] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:12.560052 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee15921b-be00-43e9-8726-6fafe2a4b965 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:12.562260 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-ee15921b-be00-43e9-8726-6fafe2a4b965 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:12.580622 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee15921b-be00-43e9-8726-6fafe2a4b965 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:12.582655 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee15921b-be00-43e9-8726-6fafe2a4b965 service nova] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:12.599616 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1214/2471] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:43:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:43:15.426232 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed71f18-638d-4a96-92e8-c572037c8007 service swift] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:15.497020 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed71f18-638d-4a96-92e8-c572037c8007 service swift] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:15.502357 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67daf2af-df9d-4216-a3c0-fd86abcc9cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:15.503266 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67daf2af-df9d-4216-a3c0-fd86abcc9cb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:15.503543 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67daf2af-df9d-4216-a3c0-fd86abcc9cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:15.503817 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67daf2af-df9d-4216-a3c0-fd86abcc9cb3 admin admin] PATH_INFO: `/v3/users/bc670609063440118548be51aee8c0bc` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:15.505086 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67daf2af-df9d-4216-a3c0-fd86abcc9cb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc670609063440118548be51aee8c0bc)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:15.507053 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67daf2af-df9d-4216-a3c0-fd86abcc9cb3 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:15.571004 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-67daf2af-df9d-4216-a3c0-fd86abcc9cb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc670609063440118548be51aee8c0bc'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:15.580961 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-67daf2af-df9d-4216-a3c0-fd86abcc9cb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc670609063440118548be51aee8c0bc'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:15.581667 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-67daf2af-df9d-4216-a3c0-fd86abcc9cb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc670609063440118548be51aee8c0bc'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:15.582299 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-67daf2af-df9d-4216-a3c0-fd86abcc9cb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc670609063440118548be51aee8c0bc'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:15.595053 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-67daf2af-df9d-4216-a3c0-fd86abcc9cb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc670609063440118548be51aee8c0bc'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:15.609256 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1258/2472] 10.222.0.118 () {58 vars in 1228 bytes} [Thu Jul 14 15:43:15 2022] DELETE /identity/v3/users/bc670609063440118548be51aee8c0bc => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:43:15.614397 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ece489f-e387-42d1-8dc8-b06818d02c58 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:15.614928 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ece489f-e387-42d1-8dc8-b06818d02c58 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:15.615317 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ece489f-e387-42d1-8dc8-b06818d02c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:15.634203 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-5ece489f-e387-42d1-8dc8-b06818d02c58 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:43:15.635565 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-5ece489f-e387-42d1-8dc8-b06818d02c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:15.695962 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1215/2473] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:43:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:43:15.707001 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67daf2af-df9d-4216-a3c0-fd86abcc9cb3 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:15.708479 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-67daf2af-df9d-4216-a3c0-fd86abcc9cb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:15.766535 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67daf2af-df9d-4216-a3c0-fd86abcc9cb3 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:15.770597 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987f8601-e913-4c1e-9445-7a3805e1b938 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b650be8114b64df0ac88441f1c50b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:15.771249 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f8601-e913-4c1e-9445-7a3805e1b938 service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:15.771528 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f8601-e913-4c1e-9445-7a3805e1b938 service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:15.771799 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f8601-e913-4c1e-9445-7a3805e1b938 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:15.781193 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987f8601-e913-4c1e-9445-7a3805e1b938 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:15.782795 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987f8601-e913-4c1e-9445-7a3805e1b938 service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:15.793201 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1259/2474] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:43:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:43:16.083408 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ece489f-e387-42d1-8dc8-b06818d02c58 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:16.084870 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-5ece489f-e387-42d1-8dc8-b06818d02c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:16.100106 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ece489f-e387-42d1-8dc8-b06818d02c58 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:16.120666 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b9979a-4878-48dd-9601-d2f3bc0b7f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:16.121881 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b9979a-4878-48dd-9601-d2f3bc0b7f62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:16.122329 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b9979a-4878-48dd-9601-d2f3bc0b7f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:16.123252 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b9979a-4878-48dd-9601-d2f3bc0b7f62 admin admin] PATH_INFO: `/v3/projects/2889626d82f44e109e2a73c63f0c51c8` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:16.124567 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b9979a-4878-48dd-9601-d2f3bc0b7f62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2889626d82f44e109e2a73c63f0c51c8)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:16.126835 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b9979a-4878-48dd-9601-d2f3bc0b7f62 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:16.175385 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-95b9979a-4878-48dd-9601-d2f3bc0b7f62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2889626d82f44e109e2a73c63f0c51c8', 'request_id': 'req-95b9979a-4878-48dd-9601-d2f3bc0b7f62'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:16.181653 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-95b9979a-4878-48dd-9601-d2f3bc0b7f62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2889626d82f44e109e2a73c63f0c51c8', 'request_id': 'req-95b9979a-4878-48dd-9601-d2f3bc0b7f62'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:16.188462 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-95b9979a-4878-48dd-9601-d2f3bc0b7f62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2889626d82f44e109e2a73c63f0c51c8', 'request_id': 'req-95b9979a-4878-48dd-9601-d2f3bc0b7f62'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:16.201310 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-95b9979a-4878-48dd-9601-d2f3bc0b7f62 admin admin] The token cache is being invalidate because project 2889626d82f44e109e2a73c63f0c51c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:43:16.201594 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-95b9979a-4878-48dd-9601-d2f3bc0b7f62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:16.202244 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-95b9979a-4878-48dd-9601-d2f3bc0b7f62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:16.203985 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1216/2475] 10.222.0.118 () {58 vars in 1237 bytes} [Thu Jul 14 15:43:16 2022] DELETE /identity/v3/projects/2889626d82f44e109e2a73c63f0c51c8 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:43:17.039682 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d172d578-4ce1-4d17-a12e-180f2713bc48 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:17.040223 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d172d578-4ce1-4d17-a12e-180f2713bc48 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:17.041541 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d172d578-4ce1-4d17-a12e-180f2713bc48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:17.059642 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-d172d578-4ce1-4d17-a12e-180f2713bc48 None None] MFA Rules not processed for user `f7ad5ae70939416e8157693e02997a58`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:43:17.061403 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-d172d578-4ce1-4d17-a12e-180f2713bc48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:17.080385 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:43:17.127063 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1260/2476] 10.222.0.118 () {58 vars in 972 bytes} [Thu Jul 14 15:43:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:43:17.140155 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b9979a-4878-48dd-9601-d2f3bc0b7f62 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:17.142726 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-95b9979a-4878-48dd-9601-d2f3bc0b7f62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:17.230331 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b9979a-4878-48dd-9601-d2f3bc0b7f62 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:17.236733 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b33314-c7c1-4b28-bab9-946310817360 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b672a6a601584d2d826147069e90a10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:17.237399 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b33314-c7c1-4b28-bab9-946310817360 service swift] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:17.237677 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b33314-c7c1-4b28-bab9-946310817360 service swift] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:17.237947 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b33314-c7c1-4b28-bab9-946310817360 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:17.248354 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b33314-c7c1-4b28-bab9-946310817360 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:17.250021 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b33314-c7c1-4b28-bab9-946310817360 service swift] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:17.255254 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:43:17.259644 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1217/2477] 10.222.0.118 () {60 vars in 1389 bytes} [Thu Jul 14 15:43:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 15:43:17.785688 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d172d578-4ce1-4d17-a12e-180f2713bc48 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:17.788518 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-d172d578-4ce1-4d17-a12e-180f2713bc48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:17.895749 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d172d578-4ce1-4d17-a12e-180f2713bc48 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:17.900744 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24920a7b-2331-4660-a8f4-332cd4b1a92a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b650be8114b64df0ac88441f1c50b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:17.901498 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24920a7b-2331-4660-a8f4-332cd4b1a92a service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:17.901705 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24920a7b-2331-4660-a8f4-332cd4b1a92a service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:17.902058 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24920a7b-2331-4660-a8f4-332cd4b1a92a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:17.904288 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-24920a7b-2331-4660-a8f4-332cd4b1a92a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:17.992365 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24920a7b-2331-4660-a8f4-332cd4b1a92a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:17.994268 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24920a7b-2331-4660-a8f4-332cd4b1a92a service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:18.022495 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1261/2478] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:43:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:43:21.616666 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b33314-c7c1-4b28-bab9-946310817360 service swift] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:21.618640 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-d4b33314-c7c1-4b28-bab9-946310817360 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:21.680348 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24920a7b-2331-4660-a8f4-332cd4b1a92a service neutron] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:21.682011 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-24920a7b-2331-4660-a8f4-332cd4b1a92a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:21.706641 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24920a7b-2331-4660-a8f4-332cd4b1a92a service neutron] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:21.713435 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b33314-c7c1-4b28-bab9-946310817360 service swift] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:21.719939 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bf3392-1955-428d-bc87-714bd1d77020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:21.720898 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bf3392-1955-428d-bc87-714bd1d77020 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:21.721786 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bf3392-1955-428d-bc87-714bd1d77020 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:21.722290 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bf3392-1955-428d-bc87-714bd1d77020 admin admin] PATH_INFO: `/v3/users/d1f95427c9ff4d8287c6ecd33a1a0d2c` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:21.725625 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c368e1b8-30f5-4f60-b124-870a2ea656d0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b0f8be7e04adca6e3f218fbe3a295', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:21.725899 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c368e1b8-30f5-4f60-b124-870a2ea656d0 service placement] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:21.726039 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bf3392-1955-428d-bc87-714bd1d77020 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1f95427c9ff4d8287c6ecd33a1a0d2c)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:21.726313 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c368e1b8-30f5-4f60-b124-870a2ea656d0 service placement] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:21.726642 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c368e1b8-30f5-4f60-b124-870a2ea656d0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:21.728017 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bf3392-1955-428d-bc87-714bd1d77020 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:21.730701 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-c368e1b8-30f5-4f60-b124-870a2ea656d0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:21.748003 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c368e1b8-30f5-4f60-b124-870a2ea656d0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:21.749636 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c368e1b8-30f5-4f60-b124-870a2ea656d0 service placement] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:21.765266 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1218/2479] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:43:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:43:21.815069 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-56bf3392-1955-428d-bc87-714bd1d77020 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1f95427c9ff4d8287c6ecd33a1a0d2c'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:21.825583 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-56bf3392-1955-428d-bc87-714bd1d77020 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1f95427c9ff4d8287c6ecd33a1a0d2c'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:21.826960 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-56bf3392-1955-428d-bc87-714bd1d77020 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1f95427c9ff4d8287c6ecd33a1a0d2c'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:21.827869 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-56bf3392-1955-428d-bc87-714bd1d77020 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1f95427c9ff4d8287c6ecd33a1a0d2c'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:21.847682 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:43:21.849798 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-56bf3392-1955-428d-bc87-714bd1d77020 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1f95427c9ff4d8287c6ecd33a1a0d2c'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:21.871921 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1262/2480] 10.222.0.118 () {58 vars in 1228 bytes} [Thu Jul 14 15:43:21 2022] DELETE /identity/v3/users/d1f95427c9ff4d8287c6ecd33a1a0d2c => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:43:22.144494 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c368e1b8-30f5-4f60-b124-870a2ea656d0 service placement] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:22.177263 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c368e1b8-30f5-4f60-b124-870a2ea656d0 service placement] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:22.280368 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9824de7-2ba6-4416-8617-e56d45bba2d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:22.281315 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9824de7-2ba6-4416-8617-e56d45bba2d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:22.281602 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9824de7-2ba6-4416-8617-e56d45bba2d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:22.281886 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9824de7-2ba6-4416-8617-e56d45bba2d8 admin admin] PATH_INFO: `/v3/projects/c51c65ccf8d148c0ad5343570e22724f` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:22.283302 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9824de7-2ba6-4416-8617-e56d45bba2d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c51c65ccf8d148c0ad5343570e22724f)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:22.285298 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9824de7-2ba6-4416-8617-e56d45bba2d8 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:22.343586 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-e9824de7-2ba6-4416-8617-e56d45bba2d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c51c65ccf8d148c0ad5343570e22724f', 'request_id': 'req-e9824de7-2ba6-4416-8617-e56d45bba2d8'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:22.350533 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-e9824de7-2ba6-4416-8617-e56d45bba2d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c51c65ccf8d148c0ad5343570e22724f', 'request_id': 'req-e9824de7-2ba6-4416-8617-e56d45bba2d8'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:22.356320 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-e9824de7-2ba6-4416-8617-e56d45bba2d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c51c65ccf8d148c0ad5343570e22724f', 'request_id': 'req-e9824de7-2ba6-4416-8617-e56d45bba2d8'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:22.371952 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-e9824de7-2ba6-4416-8617-e56d45bba2d8 admin admin] The token cache is being invalidate because project c51c65ccf8d148c0ad5343570e22724f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:43:22.372800 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-e9824de7-2ba6-4416-8617-e56d45bba2d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:22.373435 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-e9824de7-2ba6-4416-8617-e56d45bba2d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:22.375280 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1219/2481] 10.222.0.118 () {58 vars in 1237 bytes} [Thu Jul 14 15:43:22 2022] DELETE /identity/v3/projects/c51c65ccf8d148c0ad5343570e22724f => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:43:22.380670 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29fed78-227c-4a03-8557-90ec741b7284 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:22.381049 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29fed78-227c-4a03-8557-90ec741b7284 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:22.381453 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29fed78-227c-4a03-8557-90ec741b7284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:22.404655 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-b29fed78-227c-4a03-8557-90ec741b7284 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:43:22.405898 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-b29fed78-227c-4a03-8557-90ec741b7284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:22.473609 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1263/2482] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:43:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:43:22.482567 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1559fe-6e28-41f1-958a-9960aad6191c None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:22.482996 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1559fe-6e28-41f1-958a-9960aad6191c None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:22.483369 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1559fe-6e28-41f1-958a-9960aad6191c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:22.505915 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-ee1559fe-6e28-41f1-958a-9960aad6191c None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:43:22.507675 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-ee1559fe-6e28-41f1-958a-9960aad6191c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:22.516620 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1220/2483] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:43:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:43:22.520989 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29fed78-227c-4a03-8557-90ec741b7284 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:22.531334 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29fed78-227c-4a03-8557-90ec741b7284 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:22.535886 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6746a4a-8638-4db3-9dc1-ee2f9a7d8544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:22.536603 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6746a4a-8638-4db3-9dc1-ee2f9a7d8544 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:22.536826 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6746a4a-8638-4db3-9dc1-ee2f9a7d8544 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:22.537079 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6746a4a-8638-4db3-9dc1-ee2f9a7d8544 admin admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:22.537840 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6746a4a-8638-4db3-9dc1-ee2f9a7d8544 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:43:22.538175 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6746a4a-8638-4db3-9dc1-ee2f9a7d8544 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:22.539798 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6746a4a-8638-4db3-9dc1-ee2f9a7d8544 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:22.552127 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1264/2484] 10.222.0.118 () {58 vars in 1157 bytes} [Thu Jul 14 15:43:22 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:43:22.556410 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1559fe-6e28-41f1-958a-9960aad6191c None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:22.565986 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1559fe-6e28-41f1-958a-9960aad6191c None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:22.570924 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec00f18-c631-4af8-80ce-bcd18bb18fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:22.571756 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec00f18-c631-4af8-80ce-bcd18bb18fde admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:22.572068 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec00f18-c631-4af8-80ce-bcd18bb18fde admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:22.572348 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec00f18-c631-4af8-80ce-bcd18bb18fde admin admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:22.573222 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec00f18-c631-4af8-80ce-bcd18bb18fde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:22.576190 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec00f18-c631-4af8-80ce-bcd18bb18fde admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:22.586638 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:43:22.605849 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1221/2485] 10.222.0.118 () {60 vars in 1157 bytes} [Thu Jul 14 15:43:22 2022] POST /identity/v3/projects => generated 368 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:43:22.610801 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6746a4a-8638-4db3-9dc1-ee2f9a7d8544 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:22.621444 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6746a4a-8638-4db3-9dc1-ee2f9a7d8544 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:22.679467 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2ce4eb-c06d-494a-b0d9-c49bb5552e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:22.680138 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ce4eb-c06d-494a-b0d9-c49bb5552e43 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:22.680415 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ce4eb-c06d-494a-b0d9-c49bb5552e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:22.680956 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ce4eb-c06d-494a-b0d9-c49bb5552e43 admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:22.681406 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2ce4eb-c06d-494a-b0d9-c49bb5552e43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:22.683389 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2ce4eb-c06d-494a-b0d9-c49bb5552e43 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:22.703526 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1265/2486] 10.222.0.118 () {60 vars in 1148 bytes} [Thu Jul 14 15:43:22 2022] POST /identity/v3/users => generated 285 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:43:22.707670 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec00f18-c631-4af8-80ce-bcd18bb18fde admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:22.718761 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec00f18-c631-4af8-80ce-bcd18bb18fde admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:22.723392 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbdef48-b6ae-4124-bb56-e05545821b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:22.724055 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbdef48-b6ae-4124-bb56-e05545821b2f admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:22.724332 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbdef48-b6ae-4124-bb56-e05545821b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:22.724603 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbdef48-b6ae-4124-bb56-e05545821b2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:22.725322 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbdef48-b6ae-4124-bb56-e05545821b2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:22.726952 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbdef48-b6ae-4124-bb56-e05545821b2f admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:22.737991 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1222/2487] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:43:22 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:43:22.742323 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2ce4eb-c06d-494a-b0d9-c49bb5552e43 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:22.753309 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2ce4eb-c06d-494a-b0d9-c49bb5552e43 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:22.758421 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5e4d40-282f-4939-85a0-f366c903b7ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:22.759125 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e4d40-282f-4939-85a0-f366c903b7ec admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:22.759397 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e4d40-282f-4939-85a0-f366c903b7ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:22.760318 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e4d40-282f-4939-85a0-f366c903b7ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:22.760825 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5e4d40-282f-4939-85a0-f366c903b7ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:22.762076 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5e4d40-282f-4939-85a0-f366c903b7ec admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:22.772690 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1266/2488] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:43:22 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:43:22.778234 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbdef48-b6ae-4124-bb56-e05545821b2f admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:22.789245 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbdef48-b6ae-4124-bb56-e05545821b2f admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:22.794710 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf9b71c-1e6e-4cf1-9026-fad455bb4b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:22.795651 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf9b71c-1e6e-4cf1-9026-fad455bb4b0e admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:22.796018 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf9b71c-1e6e-4cf1-9026-fad455bb4b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:22.796295 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf9b71c-1e6e-4cf1-9026-fad455bb4b0e admin admin] PATH_INFO: `/v3/projects/fb652403987e4312b962cb066cf6686a/users/49e715a21133412398f9e1a8a622d85d/roles/4abcf5e5e7cd4b53ae1828fec6550d53` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:22.812096 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf9b71c-1e6e-4cf1-9026-fad455bb4b0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb652403987e4312b962cb066cf6686a, user_id=49e715a21133412398f9e1a8a622d85d, role_id=4abcf5e5e7cd4b53ae1828fec6550d53)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:22.814737 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf9b71c-1e6e-4cf1-9026-fad455bb4b0e admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:22.830287 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1223/2489] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:43:22 2022] PUT /identity/v3/projects/fb652403987e4312b962cb066cf6686a/users/49e715a21133412398f9e1a8a622d85d/roles/4abcf5e5e7cd4b53ae1828fec6550d53 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:43:22.840729 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ca7550-226c-444d-b796-b54b42b5110e None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:22.841011 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ca7550-226c-444d-b796-b54b42b5110e None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:22.841154 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ca7550-226c-444d-b796-b54b42b5110e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:22.868823 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-63ca7550-226c-444d-b796-b54b42b5110e None None] MFA Rules not processed for user `49e715a21133412398f9e1a8a622d85d`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:43:22.870070 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-63ca7550-226c-444d-b796-b54b42b5110e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:22.914373 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:43:22.943142 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1267/2490] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:43:22 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:43:22.947622 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf9b71c-1e6e-4cf1-9026-fad455bb4b0e admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:23.007705 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf9b71c-1e6e-4cf1-9026-fad455bb4b0e admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:23.012344 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52792ae6-d3e2-418c-8955-305f0786a648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:23.013058 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52792ae6-d3e2-418c-8955-305f0786a648 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:23.013334 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52792ae6-d3e2-418c-8955-305f0786a648 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:23.013639 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52792ae6-d3e2-418c-8955-305f0786a648 admin admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:23.014305 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52792ae6-d3e2-418c-8955-305f0786a648 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:23.016199 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52792ae6-d3e2-418c-8955-305f0786a648 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:23.041436 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1224/2491] 10.222.0.118 () {60 vars in 1157 bytes} [Thu Jul 14 15:43:22 2022] POST /identity/v3/projects => generated 368 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:43:23.046446 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ca7550-226c-444d-b796-b54b42b5110e None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:23.057159 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ca7550-226c-444d-b796-b54b42b5110e None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:23.116074 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b19117-5306-4dc2-9a1b-9139e342fb97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:23.116659 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b19117-5306-4dc2-9a1b-9139e342fb97 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:23.116938 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b19117-5306-4dc2-9a1b-9139e342fb97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:23.117324 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b19117-5306-4dc2-9a1b-9139e342fb97 admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:23.118057 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b19117-5306-4dc2-9a1b-9139e342fb97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:23.119968 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b19117-5306-4dc2-9a1b-9139e342fb97 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:23.139446 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1268/2492] 10.222.0.118 () {60 vars in 1148 bytes} [Thu Jul 14 15:43:23 2022] POST /identity/v3/users => generated 291 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:43:23.143552 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52792ae6-d3e2-418c-8955-305f0786a648 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:23.154284 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52792ae6-d3e2-418c-8955-305f0786a648 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:23.158918 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f011eb9b-7928-422b-a2b2-682417a1c5c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:23.159568 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f011eb9b-7928-422b-a2b2-682417a1c5c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:23.159844 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f011eb9b-7928-422b-a2b2-682417a1c5c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:23.160116 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f011eb9b-7928-422b-a2b2-682417a1c5c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:23.160834 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f011eb9b-7928-422b-a2b2-682417a1c5c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:23.162501 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f011eb9b-7928-422b-a2b2-682417a1c5c5 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:23.173910 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1225/2493] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:43:23 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:43:23.178111 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b19117-5306-4dc2-9a1b-9139e342fb97 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:23.188319 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b19117-5306-4dc2-9a1b-9139e342fb97 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:23.193210 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ef63c1-4035-48a3-8436-dff281e59035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:23.194141 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ef63c1-4035-48a3-8436-dff281e59035 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:23.194433 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ef63c1-4035-48a3-8436-dff281e59035 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:23.194709 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ef63c1-4035-48a3-8436-dff281e59035 admin admin] PATH_INFO: `/v3/projects/1d42a878fa964f66bdde5ae55f7af408/users/a6950d874b1841d4b6ea6da3f4dd83ca/roles/3b880cef7dcf4baf87b50f8610c0c56e` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:23.209507 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ef63c1-4035-48a3-8436-dff281e59035 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d42a878fa964f66bdde5ae55f7af408, user_id=a6950d874b1841d4b6ea6da3f4dd83ca, role_id=3b880cef7dcf4baf87b50f8610c0c56e)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:23.212201 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ef63c1-4035-48a3-8436-dff281e59035 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:23.233032 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1269/2494] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:43:23 2022] PUT /identity/v3/projects/1d42a878fa964f66bdde5ae55f7af408/users/a6950d874b1841d4b6ea6da3f4dd83ca/roles/3b880cef7dcf4baf87b50f8610c0c56e => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:43:23.237197 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f011eb9b-7928-422b-a2b2-682417a1c5c5 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:23.247911 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f011eb9b-7928-422b-a2b2-682417a1c5c5 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:23.304432 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5e99a8-006b-4f53-ad97-bf484b2754dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:23.305105 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e99a8-006b-4f53-ad97-bf484b2754dc admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:23.305389 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e99a8-006b-4f53-ad97-bf484b2754dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:23.305664 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e99a8-006b-4f53-ad97-bf484b2754dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:23.306429 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5e99a8-006b-4f53-ad97-bf484b2754dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:23.308071 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5e99a8-006b-4f53-ad97-bf484b2754dc admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:23.323925 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1226/2495] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:43:23 2022] GET /identity/v3/roles => generated 1427 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:43:23.328105 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ef63c1-4035-48a3-8436-dff281e59035 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:23.339014 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ef63c1-4035-48a3-8436-dff281e59035 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:23.344374 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fc8e18-2bb6-406f-b1ff-e32efa46d9aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:23.345420 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc8e18-2bb6-406f-b1ff-e32efa46d9aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:23.345698 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc8e18-2bb6-406f-b1ff-e32efa46d9aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:23.345990 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc8e18-2bb6-406f-b1ff-e32efa46d9aa admin admin] PATH_INFO: `/v3/projects/1d42a878fa964f66bdde5ae55f7af408/users/a6950d874b1841d4b6ea6da3f4dd83ca/roles/3b880cef7dcf4baf87b50f8610c0c56e` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:23.347967 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fc8e18-2bb6-406f-b1ff-e32efa46d9aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d42a878fa964f66bdde5ae55f7af408, user_id=a6950d874b1841d4b6ea6da3f4dd83ca, role_id=3b880cef7dcf4baf87b50f8610c0c56e)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:23.350655 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fc8e18-2bb6-406f-b1ff-e32efa46d9aa admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:23.363999 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1270/2496] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:43:23 2022] PUT /identity/v3/projects/1d42a878fa964f66bdde5ae55f7af408/users/a6950d874b1841d4b6ea6da3f4dd83ca/roles/3b880cef7dcf4baf87b50f8610c0c56e => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:43:23.374628 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a27eaef-b592-4162-b4a5-8b8e44dd7bbd None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:23.374914 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a27eaef-b592-4162-b4a5-8b8e44dd7bbd None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:23.375207 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a27eaef-b592-4162-b4a5-8b8e44dd7bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:23.406478 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fc8e18-2bb6-406f-b1ff-e32efa46d9aa admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:23.408203 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-80fc8e18-2bb6-406f-b1ff-e32efa46d9aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:23.409422 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-6a27eaef-b592-4162-b4a5-8b8e44dd7bbd None None] MFA Rules not processed for user `a6950d874b1841d4b6ea6da3f4dd83ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:43:23.410646 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-6a27eaef-b592-4162-b4a5-8b8e44dd7bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:23.423512 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:43:23.471674 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fc8e18-2bb6-406f-b1ff-e32efa46d9aa admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:23.479146 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85a718a-2386-4546-beb4-b50137ea130b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b650be8114b64df0ac88441f1c50b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:23.479146 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85a718a-2386-4546-beb4-b50137ea130b service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:23.479415 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85a718a-2386-4546-beb4-b50137ea130b service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:23.479415 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85a718a-2386-4546-beb4-b50137ea130b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:23.481577 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-f85a718a-2386-4546-beb4-b50137ea130b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:23.491185 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1227/2497] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:43:23 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:43:23.505112 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a27eaef-b592-4162-b4a5-8b8e44dd7bbd None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:23.506585 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-6a27eaef-b592-4162-b4a5-8b8e44dd7bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:23.538742 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:43:23.560403 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85a718a-2386-4546-beb4-b50137ea130b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:23.562708 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85a718a-2386-4546-beb4-b50137ea130b service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:23.570349 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a27eaef-b592-4162-b4a5-8b8e44dd7bbd None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:23.573312 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1271/2498] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:43:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:43:23.574126 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24e6622-ce34-4014-a56b-f19ed244957d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea647438ea1c438987f28cbe39c3ff2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:23.574863 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24e6622-ce34-4014-a56b-f19ed244957d service cinder] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:23.575651 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24e6622-ce34-4014-a56b-f19ed244957d service cinder] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:23.576087 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24e6622-ce34-4014-a56b-f19ed244957d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:23.587661 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24e6622-ce34-4014-a56b-f19ed244957d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:23.589111 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24e6622-ce34-4014-a56b-f19ed244957d service cinder] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:23.605147 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1228/2499] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:43:23 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:43:25.030503 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85a718a-2386-4546-beb4-b50137ea130b service neutron] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:25.040964 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85a718a-2386-4546-beb4-b50137ea130b service neutron] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:25.048437 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476a1509-6bac-4089-9e07-36e1540c5a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:25.049315 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a1509-6bac-4089-9e07-36e1540c5a47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:25.049792 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a1509-6bac-4089-9e07-36e1540c5a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:25.050283 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a1509-6bac-4089-9e07-36e1540c5a47 admin admin] PATH_INFO: `/v3/users/49e715a21133412398f9e1a8a622d85d` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:25.054714 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476a1509-6bac-4089-9e07-36e1540c5a47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49e715a21133412398f9e1a8a622d85d)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:25.056659 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476a1509-6bac-4089-9e07-36e1540c5a47 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:25.111648 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-476a1509-6bac-4089-9e07-36e1540c5a47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49e715a21133412398f9e1a8a622d85d'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:25.120344 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-476a1509-6bac-4089-9e07-36e1540c5a47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49e715a21133412398f9e1a8a622d85d'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:25.121113 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-476a1509-6bac-4089-9e07-36e1540c5a47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49e715a21133412398f9e1a8a622d85d'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:25.121774 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-476a1509-6bac-4089-9e07-36e1540c5a47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49e715a21133412398f9e1a8a622d85d'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:25.134379 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-476a1509-6bac-4089-9e07-36e1540c5a47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49e715a21133412398f9e1a8a622d85d'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:25.152538 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1272/2500] 10.222.0.118 () {58 vars in 1228 bytes} [Thu Jul 14 15:43:25 2022] DELETE /identity/v3/users/49e715a21133412398f9e1a8a622d85d => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:43:25.157722 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab415e6-a181-4f06-aa9b-387d7b8ff7b6 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:25.158281 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab415e6-a181-4f06-aa9b-387d7b8ff7b6 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:25.159015 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab415e6-a181-4f06-aa9b-387d7b8ff7b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:25.179515 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-5ab415e6-a181-4f06-aa9b-387d7b8ff7b6 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:43:25.181143 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-5ab415e6-a181-4f06-aa9b-387d7b8ff7b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:25.256975 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1229/2501] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:43:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:43:25.268965 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476a1509-6bac-4089-9e07-36e1540c5a47 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:25.270587 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-476a1509-6bac-4089-9e07-36e1540c5a47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:25.335713 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476a1509-6bac-4089-9e07-36e1540c5a47 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:25.340791 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8b6255-e45b-4a7f-9450-5635c7049058 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b650be8114b64df0ac88441f1c50b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:25.341864 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8b6255-e45b-4a7f-9450-5635c7049058 service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:25.342187 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8b6255-e45b-4a7f-9450-5635c7049058 service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:25.342480 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8b6255-e45b-4a7f-9450-5635c7049058 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:25.353031 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8b6255-e45b-4a7f-9450-5635c7049058 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:25.354936 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8b6255-e45b-4a7f-9450-5635c7049058 service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:25.367230 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1273/2502] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:43:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:43:25.870123 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab415e6-a181-4f06-aa9b-387d7b8ff7b6 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:25.871970 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-5ab415e6-a181-4f06-aa9b-387d7b8ff7b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:25.884614 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab415e6-a181-4f06-aa9b-387d7b8ff7b6 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:25.890127 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6610344-33e6-45d3-9cf4-63577af0c719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:25.891008 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6610344-33e6-45d3-9cf4-63577af0c719 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:25.891313 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6610344-33e6-45d3-9cf4-63577af0c719 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:25.891762 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6610344-33e6-45d3-9cf4-63577af0c719 admin admin] PATH_INFO: `/v3/projects/fb652403987e4312b962cb066cf6686a` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:25.893787 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6610344-33e6-45d3-9cf4-63577af0c719 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb652403987e4312b962cb066cf6686a)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:25.895921 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6610344-33e6-45d3-9cf4-63577af0c719 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:25.951723 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-f6610344-33e6-45d3-9cf4-63577af0c719 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb652403987e4312b962cb066cf6686a', 'request_id': 'req-f6610344-33e6-45d3-9cf4-63577af0c719'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:25.952848 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:43:25.960886 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-f6610344-33e6-45d3-9cf4-63577af0c719 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb652403987e4312b962cb066cf6686a', 'request_id': 'req-f6610344-33e6-45d3-9cf4-63577af0c719'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:25.967779 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-f6610344-33e6-45d3-9cf4-63577af0c719 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb652403987e4312b962cb066cf6686a', 'request_id': 'req-f6610344-33e6-45d3-9cf4-63577af0c719'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:25.984657 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-f6610344-33e6-45d3-9cf4-63577af0c719 admin admin] The token cache is being invalidate because project fb652403987e4312b962cb066cf6686a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:43:25.985689 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-f6610344-33e6-45d3-9cf4-63577af0c719 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:25.986378 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-f6610344-33e6-45d3-9cf4-63577af0c719 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:25.988182 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1230/2503] 10.222.0.118 () {58 vars in 1237 bytes} [Thu Jul 14 15:43:25 2022] DELETE /identity/v3/projects/fb652403987e4312b962cb066cf6686a => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:43:25.992300 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8b6255-e45b-4a7f-9450-5635c7049058 service neutron] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:26.003623 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8b6255-e45b-4a7f-9450-5635c7049058 service neutron] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:26.079454 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5923268d-7620-40b6-afcd-e09fc9e6944a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:26.080383 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5923268d-7620-40b6-afcd-e09fc9e6944a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:26.080669 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5923268d-7620-40b6-afcd-e09fc9e6944a admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:26.080941 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5923268d-7620-40b6-afcd-e09fc9e6944a admin admin] PATH_INFO: `/v3/users/a6950d874b1841d4b6ea6da3f4dd83ca` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:26.082491 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5923268d-7620-40b6-afcd-e09fc9e6944a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6950d874b1841d4b6ea6da3f4dd83ca)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:26.085039 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5923268d-7620-40b6-afcd-e09fc9e6944a admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:26.088338 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:43:26.148624 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-5923268d-7620-40b6-afcd-e09fc9e6944a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6950d874b1841d4b6ea6da3f4dd83ca'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:26.155618 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-5923268d-7620-40b6-afcd-e09fc9e6944a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6950d874b1841d4b6ea6da3f4dd83ca'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:26.156332 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-5923268d-7620-40b6-afcd-e09fc9e6944a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6950d874b1841d4b6ea6da3f4dd83ca'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:26.157056 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-5923268d-7620-40b6-afcd-e09fc9e6944a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6950d874b1841d4b6ea6da3f4dd83ca'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:26.169645 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-5923268d-7620-40b6-afcd-e09fc9e6944a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6950d874b1841d4b6ea6da3f4dd83ca'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:26.190653 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1274/2504] 10.222.0.118 () {58 vars in 1228 bytes} [Thu Jul 14 15:43:25 2022] DELETE /identity/v3/users/a6950d874b1841d4b6ea6da3f4dd83ca => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:43:26.811969 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6610344-33e6-45d3-9cf4-63577af0c719 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:26.813468 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-f6610344-33e6-45d3-9cf4-63577af0c719 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:26.826487 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6610344-33e6-45d3-9cf4-63577af0c719 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:26.906771 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e726630a-b5d4-4096-96bc-170f609317ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:26.907652 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e726630a-b5d4-4096-96bc-170f609317ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:26.907927 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e726630a-b5d4-4096-96bc-170f609317ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:26.908199 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e726630a-b5d4-4096-96bc-170f609317ea admin admin] PATH_INFO: `/v3/projects/1d42a878fa964f66bdde5ae55f7af408` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:26.909390 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e726630a-b5d4-4096-96bc-170f609317ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d42a878fa964f66bdde5ae55f7af408)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:26.911363 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e726630a-b5d4-4096-96bc-170f609317ea admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:26.949486 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5923268d-7620-40b6-afcd-e09fc9e6944a admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:26.951080 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-5923268d-7620-40b6-afcd-e09fc9e6944a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:26.964667 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5923268d-7620-40b6-afcd-e09fc9e6944a admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:26.968441 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-e726630a-b5d4-4096-96bc-170f609317ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d42a878fa964f66bdde5ae55f7af408', 'request_id': 'req-e726630a-b5d4-4096-96bc-170f609317ea'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:26.976462 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-e726630a-b5d4-4096-96bc-170f609317ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d42a878fa964f66bdde5ae55f7af408', 'request_id': 'req-e726630a-b5d4-4096-96bc-170f609317ea'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:26.983296 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-e726630a-b5d4-4096-96bc-170f609317ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d42a878fa964f66bdde5ae55f7af408', 'request_id': 'req-e726630a-b5d4-4096-96bc-170f609317ea'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:26.996033 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-e726630a-b5d4-4096-96bc-170f609317ea admin admin] The token cache is being invalidate because project 1d42a878fa964f66bdde5ae55f7af408 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:43:26.996395 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-e726630a-b5d4-4096-96bc-170f609317ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:26.997112 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-e726630a-b5d4-4096-96bc-170f609317ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:26.998990 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1231/2505] 10.222.0.118 () {58 vars in 1237 bytes} [Thu Jul 14 15:43:26 2022] DELETE /identity/v3/projects/1d42a878fa964f66bdde5ae55f7af408 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:43:27.003347 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d1541a-04e7-4386-a816-d1d10602777f None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:27.003702 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d1541a-04e7-4386-a816-d1d10602777f None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:27.003980 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d1541a-04e7-4386-a816-d1d10602777f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:27.022014 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-49d1541a-04e7-4386-a816-d1d10602777f None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:43:27.023158 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-49d1541a-04e7-4386-a816-d1d10602777f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:27.024260 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8b201d-b712-4196-9776-cf8990005f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:27.025128 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8b201d-b712-4196-9776-cf8990005f27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:27.025403 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8b201d-b712-4196-9776-cf8990005f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:27.025676 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8b201d-b712-4196-9776-cf8990005f27 admin admin] PATH_INFO: `/v3/users/34f09b2afbe54a6ab1ba27292bc5a964` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:27.026883 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8b201d-b712-4196-9776-cf8990005f27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34f09b2afbe54a6ab1ba27292bc5a964)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:27.029331 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8b201d-b712-4196-9776-cf8990005f27 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:27.031818 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1232/2506] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:43:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:43:27.039350 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03e7130-295a-4750-a439-872897affe02 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:27.039637 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03e7130-295a-4750-a439-872897affe02 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:27.039985 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03e7130-295a-4750-a439-872897affe02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:27.059373 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-d03e7130-295a-4750-a439-872897affe02 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:43:27.060589 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-d03e7130-295a-4750-a439-872897affe02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:27.069598 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1233/2507] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:43:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:43:27.073453 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03e7130-295a-4750-a439-872897affe02 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:27.078056 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-db8b201d-b712-4196-9776-cf8990005f27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34f09b2afbe54a6ab1ba27292bc5a964'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:27.082476 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03e7130-295a-4750-a439-872897affe02 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:27.085569 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-db8b201d-b712-4196-9776-cf8990005f27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34f09b2afbe54a6ab1ba27292bc5a964'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:27.086275 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-db8b201d-b712-4196-9776-cf8990005f27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34f09b2afbe54a6ab1ba27292bc5a964'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:27.086882 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-db8b201d-b712-4196-9776-cf8990005f27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34f09b2afbe54a6ab1ba27292bc5a964'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:27.087085 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1eda06-8671-421f-a7ee-848714ce19f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:27.087729 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1eda06-8671-421f-a7ee-848714ce19f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:27.088008 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1eda06-8671-421f-a7ee-848714ce19f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:27.088279 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1eda06-8671-421f-a7ee-848714ce19f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:27.089001 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1eda06-8671-421f-a7ee-848714ce19f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:43:27.089303 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1eda06-8671-421f-a7ee-848714ce19f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:27.091476 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1eda06-8671-421f-a7ee-848714ce19f7 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:27.101271 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-db8b201d-b712-4196-9776-cf8990005f27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34f09b2afbe54a6ab1ba27292bc5a964'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:27.110711 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1234/2508] 10.222.0.118 () {58 vars in 1157 bytes} [Thu Jul 14 15:43:27 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:43:27.112136 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1eda06-8671-421f-a7ee-848714ce19f7 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:27.114167 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-ba1eda06-8671-421f-a7ee-848714ce19f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:27.116955 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:43:27.123026 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1275/2509] 10.222.0.118 () {58 vars in 1228 bytes} [Thu Jul 14 15:43:26 2022] DELETE /identity/v3/users/34f09b2afbe54a6ab1ba27292bc5a964 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:43:27.133057 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1eda06-8671-421f-a7ee-848714ce19f7 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:27.183201 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:43:27.208238 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83e572d-3c70-4be8-9c21-2a233fee3d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:27.208956 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83e572d-3c70-4be8-9c21-2a233fee3d11 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:27.209320 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83e572d-3c70-4be8-9c21-2a233fee3d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:27.210183 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83e572d-3c70-4be8-9c21-2a233fee3d11 admin admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:27.210330 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83e572d-3c70-4be8-9c21-2a233fee3d11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:27.212515 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83e572d-3c70-4be8-9c21-2a233fee3d11 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:27.246829 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1235/2510] 10.222.0.118 () {60 vars in 1157 bytes} [Thu Jul 14 15:43:27 2022] POST /identity/v3/projects => generated 386 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:43:27.248555 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8b201d-b712-4196-9776-cf8990005f27 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:27.258392 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8b201d-b712-4196-9776-cf8990005f27 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:27.321500 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83e572d-3c70-4be8-9c21-2a233fee3d11 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:27.321651 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e476f36d-ca40-40ce-8892-fa5cfeb45267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:27.322240 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e476f36d-ca40-40ce-8892-fa5cfeb45267 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:27.322510 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e476f36d-ca40-40ce-8892-fa5cfeb45267 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:27.322780 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e476f36d-ca40-40ce-8892-fa5cfeb45267 admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:27.323494 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-a83e572d-3c70-4be8-9c21-2a233fee3d11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:27.323596 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e476f36d-ca40-40ce-8892-fa5cfeb45267 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:27.326278 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e476f36d-ca40-40ce-8892-fa5cfeb45267 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:27.346327 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83e572d-3c70-4be8-9c21-2a233fee3d11 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:27.351810 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859ee790-8955-4336-80f4-e1f1d66f2a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:27.352509 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1276/2511] 10.222.0.118 () {60 vars in 1148 bytes} [Thu Jul 14 15:43:27 2022] POST /identity/v3/users => generated 294 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:43:27.352688 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859ee790-8955-4336-80f4-e1f1d66f2a8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:27.352934 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859ee790-8955-4336-80f4-e1f1d66f2a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:27.353204 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859ee790-8955-4336-80f4-e1f1d66f2a8f admin admin] PATH_INFO: `/v3/projects/1e2032eee43241ee812367ad9bf8027a` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:27.354428 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859ee790-8955-4336-80f4-e1f1d66f2a8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e2032eee43241ee812367ad9bf8027a)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:27.356307 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e476f36d-ca40-40ce-8892-fa5cfeb45267 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:27.356433 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859ee790-8955-4336-80f4-e1f1d66f2a8f admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:27.366904 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e476f36d-ca40-40ce-8892-fa5cfeb45267 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:27.372591 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c2f1ba-81e8-43db-8c6f-62e55f412ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:27.373347 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c2f1ba-81e8-43db-8c6f-62e55f412ad2 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:27.373531 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c2f1ba-81e8-43db-8c6f-62e55f412ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:27.373816 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c2f1ba-81e8-43db-8c6f-62e55f412ad2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:27.374577 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c2f1ba-81e8-43db-8c6f-62e55f412ad2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:27.376170 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c2f1ba-81e8-43db-8c6f-62e55f412ad2 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:27.386847 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1277/2512] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:43:27 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:43:27.391529 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c2f1ba-81e8-43db-8c6f-62e55f412ad2 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:27.401360 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c2f1ba-81e8-43db-8c6f-62e55f412ad2 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:27.406747 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-859ee790-8955-4336-80f4-e1f1d66f2a8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e2032eee43241ee812367ad9bf8027a', 'request_id': 'req-859ee790-8955-4336-80f4-e1f1d66f2a8f'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:27.413003 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-859ee790-8955-4336-80f4-e1f1d66f2a8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e2032eee43241ee812367ad9bf8027a', 'request_id': 'req-859ee790-8955-4336-80f4-e1f1d66f2a8f'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:27.419737 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-859ee790-8955-4336-80f4-e1f1d66f2a8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e2032eee43241ee812367ad9bf8027a', 'request_id': 'req-859ee790-8955-4336-80f4-e1f1d66f2a8f'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:27.432298 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-859ee790-8955-4336-80f4-e1f1d66f2a8f admin admin] The token cache is being invalidate because project 1e2032eee43241ee812367ad9bf8027a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:43:27.432582 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-859ee790-8955-4336-80f4-e1f1d66f2a8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:27.433206 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-859ee790-8955-4336-80f4-e1f1d66f2a8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:27.436017 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1236/2513] 10.222.0.118 () {58 vars in 1237 bytes} [Thu Jul 14 15:43:27 2022] DELETE /identity/v3/projects/1e2032eee43241ee812367ad9bf8027a => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:43:27.440621 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d14c6c4-b649-4234-8e00-222f1175bc58 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:27.440970 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d14c6c4-b649-4234-8e00-222f1175bc58 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:27.441253 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d14c6c4-b649-4234-8e00-222f1175bc58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:27.459319 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-4d14c6c4-b649-4234-8e00-222f1175bc58 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:43:27.460533 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-4d14c6c4-b649-4234-8e00-222f1175bc58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:27.460782 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9270a636-a9c1-459f-a8cf-0be8398d6462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:27.461444 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9270a636-a9c1-459f-a8cf-0be8398d6462 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:27.461717 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9270a636-a9c1-459f-a8cf-0be8398d6462 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:27.462007 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9270a636-a9c1-459f-a8cf-0be8398d6462 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:27.462727 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9270a636-a9c1-459f-a8cf-0be8398d6462 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:27.464311 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9270a636-a9c1-459f-a8cf-0be8398d6462 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:27.469774 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1237/2514] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:43:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:43:27.476317 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1278/2515] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:43:27 2022] GET /identity/v3/roles => generated 1427 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:43:27.477881 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c1a521-66fe-48ee-9a75-0d843603a6d4 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:27.478211 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c1a521-66fe-48ee-9a75-0d843603a6d4 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:27.478482 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c1a521-66fe-48ee-9a75-0d843603a6d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:27.480057 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9270a636-a9c1-459f-a8cf-0be8398d6462 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:27.481839 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-9270a636-a9c1-459f-a8cf-0be8398d6462 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:27.494536 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9270a636-a9c1-459f-a8cf-0be8398d6462 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:27.497896 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-a4c1a521-66fe-48ee-9a75-0d843603a6d4 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:43:27.499146 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-a4c1a521-66fe-48ee-9a75-0d843603a6d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:27.500508 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bf8d42-2f14-4e8b-bdb1-60cce158ea1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:27.501396 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bf8d42-2f14-4e8b-bdb1-60cce158ea1c admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:27.501676 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bf8d42-2f14-4e8b-bdb1-60cce158ea1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:27.501948 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bf8d42-2f14-4e8b-bdb1-60cce158ea1c admin admin] PATH_INFO: `/v3/projects/e26e91803f10474cb661a614e0986834/users/483d3981ea5846a7919be8460860701b/roles/4abcf5e5e7cd4b53ae1828fec6550d53` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:27.509816 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1238/2516] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:43:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:43:27.515019 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c1a521-66fe-48ee-9a75-0d843603a6d4 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:27.521295 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bf8d42-2f14-4e8b-bdb1-60cce158ea1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e26e91803f10474cb661a614e0986834, user_id=483d3981ea5846a7919be8460860701b, role_id=4abcf5e5e7cd4b53ae1828fec6550d53)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:27.524015 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bf8d42-2f14-4e8b-bdb1-60cce158ea1c admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:27.524138 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c1a521-66fe-48ee-9a75-0d843603a6d4 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:27.528776 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395c0502-05df-4ccf-806c-5a0544229382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:27.529426 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395c0502-05df-4ccf-806c-5a0544229382 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:27.529724 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395c0502-05df-4ccf-806c-5a0544229382 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:27.529995 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395c0502-05df-4ccf-806c-5a0544229382 admin admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:27.530715 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395c0502-05df-4ccf-806c-5a0544229382 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:43:27.531039 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395c0502-05df-4ccf-806c-5a0544229382 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:27.532603 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395c0502-05df-4ccf-806c-5a0544229382 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:27.537530 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1279/2517] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:43:27 2022] PUT /identity/v3/projects/e26e91803f10474cb661a614e0986834/users/483d3981ea5846a7919be8460860701b/roles/4abcf5e5e7cd4b53ae1828fec6550d53 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:43:27.547912 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380d92d9-cb6c-40c6-9f12-9470beab8e49 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:27.548194 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380d92d9-cb6c-40c6-9f12-9470beab8e49 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:27.548466 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380d92d9-cb6c-40c6-9f12-9470beab8e49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:27.548561 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1239/2518] 10.222.0.118 () {58 vars in 1157 bytes} [Thu Jul 14 15:43:27 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:43:27.552692 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395c0502-05df-4ccf-806c-5a0544229382 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:27.563542 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395c0502-05df-4ccf-806c-5a0544229382 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:27.578513 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-380d92d9-cb6c-40c6-9f12-9470beab8e49 None None] MFA Rules not processed for user `483d3981ea5846a7919be8460860701b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:43:27.579794 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-380d92d9-cb6c-40c6-9f12-9470beab8e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:27.620386 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:43:27.626984 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a6016e-b784-4abd-9eea-9a8f02daf0d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:27.627652 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a6016e-b784-4abd-9eea-9a8f02daf0d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:27.627931 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a6016e-b784-4abd-9eea-9a8f02daf0d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:27.628201 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a6016e-b784-4abd-9eea-9a8f02daf0d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:27.628895 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a6016e-b784-4abd-9eea-9a8f02daf0d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:27.630866 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a6016e-b784-4abd-9eea-9a8f02daf0d9 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:27.647399 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1280/2519] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:43:27 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:43:27.652004 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380d92d9-cb6c-40c6-9f12-9470beab8e49 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:27.660179 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1240/2520] 10.222.0.118 () {60 vars in 1157 bytes} [Thu Jul 14 15:43:27 2022] POST /identity/v3/projects => generated 372 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:43:27.661189 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a6016e-b784-4abd-9eea-9a8f02daf0d9 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:27.663300 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380d92d9-cb6c-40c6-9f12-9470beab8e49 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:27.671850 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:43:27.720448 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e141e9f-4fb8-46f0-b026-4665a3185285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:27.721118 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e141e9f-4fb8-46f0-b026-4665a3185285 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:27.721401 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e141e9f-4fb8-46f0-b026-4665a3185285 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:27.721675 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e141e9f-4fb8-46f0-b026-4665a3185285 admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:27.722406 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e141e9f-4fb8-46f0-b026-4665a3185285 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:27.724326 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e141e9f-4fb8-46f0-b026-4665a3185285 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:27.734682 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a6016e-b784-4abd-9eea-9a8f02daf0d9 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:27.739411 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124c93f6-4084-4fdd-9e6a-3757477d3e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:27.740095 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124c93f6-4084-4fdd-9e6a-3757477d3e35 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:27.740626 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124c93f6-4084-4fdd-9e6a-3757477d3e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:27.740900 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124c93f6-4084-4fdd-9e6a-3757477d3e35 admin admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:27.741590 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124c93f6-4084-4fdd-9e6a-3757477d3e35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:27.743573 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124c93f6-4084-4fdd-9e6a-3757477d3e35 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:27.750270 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1281/2521] 10.222.0.118 () {60 vars in 1157 bytes} [Thu Jul 14 15:43:27 2022] POST /identity/v3/projects => generated 388 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:43:27.754079 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e141e9f-4fb8-46f0-b026-4665a3185285 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:27.766714 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1241/2522] 10.222.0.118 () {60 vars in 1148 bytes} [Thu Jul 14 15:43:27 2022] POST /identity/v3/users => generated 287 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:43:27.771030 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124c93f6-4084-4fdd-9e6a-3757477d3e35 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:27.781738 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124c93f6-4084-4fdd-9e6a-3757477d3e35 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:27.820974 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e141e9f-4fb8-46f0-b026-4665a3185285 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:27.826653 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2468b5b-95e2-4bbe-8212-abd47a1b732e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:27.827320 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2468b5b-95e2-4bbe-8212-abd47a1b732e admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:27.827645 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2468b5b-95e2-4bbe-8212-abd47a1b732e admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:27.827926 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2468b5b-95e2-4bbe-8212-abd47a1b732e admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:27.828666 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2468b5b-95e2-4bbe-8212-abd47a1b732e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:27.830574 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2468b5b-95e2-4bbe-8212-abd47a1b732e admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:27.838609 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e312c05e-bb74-4477-a1b7-7da8ab28147b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:27.839299 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e312c05e-bb74-4477-a1b7-7da8ab28147b admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:27.839575 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e312c05e-bb74-4477-a1b7-7da8ab28147b admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:27.839843 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e312c05e-bb74-4477-a1b7-7da8ab28147b admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:27.840584 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e312c05e-bb74-4477-a1b7-7da8ab28147b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:27.842208 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e312c05e-bb74-4477-a1b7-7da8ab28147b admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:27.851460 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1282/2523] 10.222.0.118 () {60 vars in 1148 bytes} [Thu Jul 14 15:43:27 2022] POST /identity/v3/users => generated 301 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:43:27.855651 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1242/2524] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:43:27 2022] GET /identity/v3/roles => generated 1427 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:43:27.855797 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2468b5b-95e2-4bbe-8212-abd47a1b732e admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:27.857283 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e312c05e-bb74-4477-a1b7-7da8ab28147b admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:27.866281 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2468b5b-95e2-4bbe-8212-abd47a1b732e admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:27.867051 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e312c05e-bb74-4477-a1b7-7da8ab28147b admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:27.871058 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f6a70e-d2a3-4876-a15a-6b7c2d90fe6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:27.871706 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f6a70e-d2a3-4876-a15a-6b7c2d90fe6f admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:27.872528 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f6a70e-d2a3-4876-a15a-6b7c2d90fe6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:27.872800 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f6a70e-d2a3-4876-a15a-6b7c2d90fe6f admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:27.873279 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e04e054-8a5c-4940-bdbb-395d3ee30763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:27.873516 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f6a70e-d2a3-4876-a15a-6b7c2d90fe6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:27.874228 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e04e054-8a5c-4940-bdbb-395d3ee30763 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:27.874627 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e04e054-8a5c-4940-bdbb-395d3ee30763 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:27.875002 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e04e054-8a5c-4940-bdbb-395d3ee30763 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:27.875126 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f6a70e-d2a3-4876-a15a-6b7c2d90fe6f admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:27.876048 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e04e054-8a5c-4940-bdbb-395d3ee30763 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:27.877946 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e04e054-8a5c-4940-bdbb-395d3ee30763 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:27.885503 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1283/2525] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:43:27 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:43:27.889590 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f6a70e-d2a3-4876-a15a-6b7c2d90fe6f admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:27.891911 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1243/2526] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:43:27 2022] GET /identity/v3/roles => generated 1427 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:43:27.895617 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e04e054-8a5c-4940-bdbb-395d3ee30763 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:27.899242 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f6a70e-d2a3-4876-a15a-6b7c2d90fe6f admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:27.903916 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b824d1a-ca72-473c-8a1e-fb099e0fe4fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:27.904786 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b824d1a-ca72-473c-8a1e-fb099e0fe4fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:27.905067 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b824d1a-ca72-473c-8a1e-fb099e0fe4fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:27.905343 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b824d1a-ca72-473c-8a1e-fb099e0fe4fe admin admin] PATH_INFO: `/v3/projects/84cc91cc3a214c7f8b9db5c1e2f803f2/users/dd14d94bb9094dd7b085e0c80fdaefa0/roles/3b880cef7dcf4baf87b50f8610c0c56e` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:27.905754 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e04e054-8a5c-4940-bdbb-395d3ee30763 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:27.910492 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47244240-7441-4414-87aa-475fbd66e0b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:27.911354 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47244240-7441-4414-87aa-475fbd66e0b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:27.911670 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47244240-7441-4414-87aa-475fbd66e0b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:27.911926 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47244240-7441-4414-87aa-475fbd66e0b1 admin admin] PATH_INFO: `/v3/projects/620c93fd7b1f479fafbe6fc5860da99d/users/c721200a5f374f0780b59f08a675e183/roles/4abcf5e5e7cd4b53ae1828fec6550d53` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:27.920861 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b824d1a-ca72-473c-8a1e-fb099e0fe4fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=84cc91cc3a214c7f8b9db5c1e2f803f2, user_id=dd14d94bb9094dd7b085e0c80fdaefa0, role_id=3b880cef7dcf4baf87b50f8610c0c56e)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:27.923567 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b824d1a-ca72-473c-8a1e-fb099e0fe4fe admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:27.928339 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47244240-7441-4414-87aa-475fbd66e0b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=620c93fd7b1f479fafbe6fc5860da99d, user_id=c721200a5f374f0780b59f08a675e183, role_id=4abcf5e5e7cd4b53ae1828fec6550d53)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:27.931020 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47244240-7441-4414-87aa-475fbd66e0b1 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:27.938106 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1284/2527] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:43:27 2022] PUT /identity/v3/projects/84cc91cc3a214c7f8b9db5c1e2f803f2/users/dd14d94bb9094dd7b085e0c80fdaefa0/roles/3b880cef7dcf4baf87b50f8610c0c56e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:43:27.941770 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b824d1a-ca72-473c-8a1e-fb099e0fe4fe admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:27.944788 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1244/2528] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:43:27 2022] PUT /identity/v3/projects/620c93fd7b1f479fafbe6fc5860da99d/users/c721200a5f374f0780b59f08a675e183/roles/4abcf5e5e7cd4b53ae1828fec6550d53 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:43:27.955897 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab62978c-85e9-4984-8608-3f7469c56965 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:27.956177 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab62978c-85e9-4984-8608-3f7469c56965 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:27.956460 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab62978c-85e9-4984-8608-3f7469c56965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:27.963307 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:43:27.983115 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-ab62978c-85e9-4984-8608-3f7469c56965 None None] MFA Rules not processed for user `c721200a5f374f0780b59f08a675e183`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:43:27.984334 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-ab62978c-85e9-4984-8608-3f7469c56965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:28.009225 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b824d1a-ca72-473c-8a1e-fb099e0fe4fe admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:28.031432 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:43:28.053590 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1245/2529] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:43:27 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:43:28.057793 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab62978c-85e9-4984-8608-3f7469c56965 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:28.072856 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c962fe-4561-44e2-a1c3-6fcb66a6da5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:28.073526 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c962fe-4561-44e2-a1c3-6fcb66a6da5f admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:28.073809 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c962fe-4561-44e2-a1c3-6fcb66a6da5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:28.074117 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c962fe-4561-44e2-a1c3-6fcb66a6da5f admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:28.074854 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c962fe-4561-44e2-a1c3-6fcb66a6da5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:28.076551 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c962fe-4561-44e2-a1c3-6fcb66a6da5f admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:28.089012 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1285/2530] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:43:27 2022] GET /identity/v3/roles => generated 1427 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:43:28.093627 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c962fe-4561-44e2-a1c3-6fcb66a6da5f admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:28.102771 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c962fe-4561-44e2-a1c3-6fcb66a6da5f admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:28.108680 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20582ad-cdb6-4ff5-be63-cb4bd2a88246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:28.109612 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20582ad-cdb6-4ff5-be63-cb4bd2a88246 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:28.109915 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20582ad-cdb6-4ff5-be63-cb4bd2a88246 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:28.110548 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20582ad-cdb6-4ff5-be63-cb4bd2a88246 admin admin] PATH_INFO: `/v3/projects/84cc91cc3a214c7f8b9db5c1e2f803f2/users/dd14d94bb9094dd7b085e0c80fdaefa0/roles/3b880cef7dcf4baf87b50f8610c0c56e` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:28.112285 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20582ad-cdb6-4ff5-be63-cb4bd2a88246 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84cc91cc3a214c7f8b9db5c1e2f803f2, user_id=dd14d94bb9094dd7b085e0c80fdaefa0, role_id=3b880cef7dcf4baf87b50f8610c0c56e)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:28.115053 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20582ad-cdb6-4ff5-be63-cb4bd2a88246 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:28.127925 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1286/2531] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:43:28 2022] PUT /identity/v3/projects/84cc91cc3a214c7f8b9db5c1e2f803f2/users/dd14d94bb9094dd7b085e0c80fdaefa0/roles/3b880cef7dcf4baf87b50f8610c0c56e => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:43:28.131838 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab62978c-85e9-4984-8608-3f7469c56965 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:28.140468 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9c36a1-6917-4e92-b6e1-2386ba95f3f9 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:28.140468 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9c36a1-6917-4e92-b6e1-2386ba95f3f9 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:28.140468 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9c36a1-6917-4e92-b6e1-2386ba95f3f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:28.165347 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-ea9c36a1-6917-4e92-b6e1-2386ba95f3f9 None None] MFA Rules not processed for user `dd14d94bb9094dd7b085e0c80fdaefa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:43:28.166581 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-ea9c36a1-6917-4e92-b6e1-2386ba95f3f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:28.192628 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e786a9-fb99-47c8-8983-dd0912aff81f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:28.193303 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e786a9-fb99-47c8-8983-dd0912aff81f admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:28.193589 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e786a9-fb99-47c8-8983-dd0912aff81f admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:28.193866 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e786a9-fb99-47c8-8983-dd0912aff81f admin admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:28.194589 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e786a9-fb99-47c8-8983-dd0912aff81f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:28.196516 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e786a9-fb99-47c8-8983-dd0912aff81f admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:28.223229 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1246/2532] 10.222.0.118 () {60 vars in 1157 bytes} [Thu Jul 14 15:43:28 2022] POST /identity/v3/projects => generated 374 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:43:28.227198 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e786a9-fb99-47c8-8983-dd0912aff81f admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:28.240854 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1287/2533] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:43:28 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:43:28.252158 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9c36a1-6917-4e92-b6e1-2386ba95f3f9 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:28.253553 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-ea9c36a1-6917-4e92-b6e1-2386ba95f3f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:28.290376 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e786a9-fb99-47c8-8983-dd0912aff81f admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:28.294833 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:43:28.295696 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609dbe46-4b00-424b-bb09-463e6e30a362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:28.296368 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609dbe46-4b00-424b-bb09-463e6e30a362 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:28.296661 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609dbe46-4b00-424b-bb09-463e6e30a362 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:28.296977 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609dbe46-4b00-424b-bb09-463e6e30a362 admin admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:28.297611 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609dbe46-4b00-424b-bb09-463e6e30a362 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:28.299655 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609dbe46-4b00-424b-bb09-463e6e30a362 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:28.314618 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9c36a1-6917-4e92-b6e1-2386ba95f3f9 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:28.319721 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1247/2534] 10.222.0.118 () {60 vars in 1148 bytes} [Thu Jul 14 15:43:28 2022] POST /identity/v3/users => generated 294 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:43:28.323659 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609dbe46-4b00-424b-bb09-463e6e30a362 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:28.333686 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609dbe46-4b00-424b-bb09-463e6e30a362 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:28.338349 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89e5824-4340-48f8-9499-9ab10dd7a82c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:28.339003 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89e5824-4340-48f8-9499-9ab10dd7a82c admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:28.339287 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89e5824-4340-48f8-9499-9ab10dd7a82c admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:28.339651 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89e5824-4340-48f8-9499-9ab10dd7a82c admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:28.340976 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89e5824-4340-48f8-9499-9ab10dd7a82c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:28.342620 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89e5824-4340-48f8-9499-9ab10dd7a82c admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:28.348413 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:43:28.354891 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1248/2535] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:43:28 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:43:28.360218 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89e5824-4340-48f8-9499-9ab10dd7a82c admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:28.367506 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff64816-c0bf-48bd-8157-3bdddfb02b84 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea647438ea1c438987f28cbe39c3ff2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:28.368154 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff64816-c0bf-48bd-8157-3bdddfb02b84 service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:28.368436 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff64816-c0bf-48bd-8157-3bdddfb02b84 service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:28.368710 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff64816-c0bf-48bd-8157-3bdddfb02b84 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:28.371431 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89e5824-4340-48f8-9499-9ab10dd7a82c admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:28.378983 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3c338d-829c-4083-adaa-40449d42bdca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:28.379875 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c338d-829c-4083-adaa-40449d42bdca admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:28.380150 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c338d-829c-4083-adaa-40449d42bdca admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:28.380424 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c338d-829c-4083-adaa-40449d42bdca admin admin] PATH_INFO: `/v3/projects/91049923312c4c18bff1c03212978a81/users/0fbb9a18c00c47e582fce1aee373cc90/roles/3b880cef7dcf4baf87b50f8610c0c56e` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:28.394714 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3c338d-829c-4083-adaa-40449d42bdca admin admin] RBAC: Authorizing `identity:create_grant(project_id=91049923312c4c18bff1c03212978a81, user_id=0fbb9a18c00c47e582fce1aee373cc90, role_id=3b880cef7dcf4baf87b50f8610c0c56e)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:28.397362 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3c338d-829c-4083-adaa-40449d42bdca admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:28.411482 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1249/2536] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:43:28 2022] PUT /identity/v3/projects/91049923312c4c18bff1c03212978a81/users/0fbb9a18c00c47e582fce1aee373cc90/roles/3b880cef7dcf4baf87b50f8610c0c56e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:43:28.415333 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3c338d-829c-4083-adaa-40449d42bdca admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:28.436771 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff64816-c0bf-48bd-8157-3bdddfb02b84 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:28.438357 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff64816-c0bf-48bd-8157-3bdddfb02b84 service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:28.449513 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1288/2537] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:43:28 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:43:28.484056 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3c338d-829c-4083-adaa-40449d42bdca admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:28.489765 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3128493-dab8-4b98-95fd-59f29f099fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:28.490729 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3128493-dab8-4b98-95fd-59f29f099fa0 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:28.491013 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3128493-dab8-4b98-95fd-59f29f099fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:28.491292 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3128493-dab8-4b98-95fd-59f29f099fa0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:28.492036 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3128493-dab8-4b98-95fd-59f29f099fa0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:28.493671 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3128493-dab8-4b98-95fd-59f29f099fa0 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:28.508701 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1250/2538] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:43:28 2022] GET /identity/v3/roles => generated 1427 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:43:28.510102 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff64816-c0bf-48bd-8157-3bdddfb02b84 service cinder] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:28.519123 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3128493-dab8-4b98-95fd-59f29f099fa0 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:28.521783 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff64816-c0bf-48bd-8157-3bdddfb02b84 service cinder] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:28.526426 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af7e860-fc1d-4a50-bc4a-8076146c0466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:28.527398 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af7e860-fc1d-4a50-bc4a-8076146c0466 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:28.528036 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af7e860-fc1d-4a50-bc4a-8076146c0466 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:28.528036 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af7e860-fc1d-4a50-bc4a-8076146c0466 admin admin] PATH_INFO: `/v3/projects/91049923312c4c18bff1c03212978a81/users/0fbb9a18c00c47e582fce1aee373cc90/roles/3b880cef7dcf4baf87b50f8610c0c56e` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:28.529382 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3128493-dab8-4b98-95fd-59f29f099fa0 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:28.530166 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af7e860-fc1d-4a50-bc4a-8076146c0466 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91049923312c4c18bff1c03212978a81, user_id=0fbb9a18c00c47e582fce1aee373cc90, role_id=3b880cef7dcf4baf87b50f8610c0c56e)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:28.532881 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af7e860-fc1d-4a50-bc4a-8076146c0466 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:28.534129 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62462336-4fe0-41f5-a184-19221f41c385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:28.535045 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62462336-4fe0-41f5-a184-19221f41c385 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:28.535338 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62462336-4fe0-41f5-a184-19221f41c385 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:28.535611 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62462336-4fe0-41f5-a184-19221f41c385 admin admin] PATH_INFO: `/v3/users/483d3981ea5846a7919be8460860701b` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:28.536843 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62462336-4fe0-41f5-a184-19221f41c385 admin admin] RBAC: Authorizing `identity:delete_user(user_id=483d3981ea5846a7919be8460860701b)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:28.538817 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62462336-4fe0-41f5-a184-19221f41c385 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:28.544268 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1289/2539] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:43:28 2022] PUT /identity/v3/projects/91049923312c4c18bff1c03212978a81/users/0fbb9a18c00c47e582fce1aee373cc90/roles/3b880cef7dcf4baf87b50f8610c0c56e => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:43:28.554557 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5462514-ddae-4267-8d23-26d6b3ef4af0 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:28.554838 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5462514-ddae-4267-8d23-26d6b3ef4af0 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:28.555110 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5462514-ddae-4267-8d23-26d6b3ef4af0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:28.586409 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-d5462514-ddae-4267-8d23-26d6b3ef4af0 None None] MFA Rules not processed for user `0fbb9a18c00c47e582fce1aee373cc90`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:43:28.587538 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-d5462514-ddae-4267-8d23-26d6b3ef4af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:28.592390 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-62462336-4fe0-41f5-a184-19221f41c385 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '483d3981ea5846a7919be8460860701b'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:28.599704 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-62462336-4fe0-41f5-a184-19221f41c385 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '483d3981ea5846a7919be8460860701b'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:28.600431 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-62462336-4fe0-41f5-a184-19221f41c385 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '483d3981ea5846a7919be8460860701b'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:28.601070 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-62462336-4fe0-41f5-a184-19221f41c385 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '483d3981ea5846a7919be8460860701b'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:28.613729 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-62462336-4fe0-41f5-a184-19221f41c385 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '483d3981ea5846a7919be8460860701b'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:28.627427 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1251/2540] 10.222.0.118 () {58 vars in 1228 bytes} [Thu Jul 14 15:43:28 2022] DELETE /identity/v3/users/483d3981ea5846a7919be8460860701b => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:43:28.631703 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b86acf-c3d6-4e4b-bde0-a2b0485b579d None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:28.631988 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b86acf-c3d6-4e4b-bde0-a2b0485b579d None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:28.632265 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b86acf-c3d6-4e4b-bde0-a2b0485b579d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:28.650457 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-c3b86acf-c3d6-4e4b-bde0-a2b0485b579d None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:43:28.651662 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-c3b86acf-c3d6-4e4b-bde0-a2b0485b579d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:28.664782 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1290/2541] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:43:28 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:43:28.677560 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5462514-ddae-4267-8d23-26d6b3ef4af0 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:28.679059 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-d5462514-ddae-4267-8d23-26d6b3ef4af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:28.692150 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:43:28.694133 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:43:28.712375 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1252/2542] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:43:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:43:28.722017 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b86acf-c3d6-4e4b-bde0-a2b0485b579d None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:28.723652 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-c3b86acf-c3d6-4e4b-bde0-a2b0485b579d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:28.747752 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5462514-ddae-4267-8d23-26d6b3ef4af0 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:28.781626 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b86acf-c3d6-4e4b-bde0-a2b0485b579d None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:28.785446 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947f73a2-a5ad-4588-b258-f21ff2c9ea1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b650be8114b64df0ac88441f1c50b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:28.786176 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947f73a2-a5ad-4588-b258-f21ff2c9ea1f service neutron] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:28.786455 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947f73a2-a5ad-4588-b258-f21ff2c9ea1f service neutron] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:28.786728 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947f73a2-a5ad-4588-b258-f21ff2c9ea1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:28.796450 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947f73a2-a5ad-4588-b258-f21ff2c9ea1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:28.797327 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd15d44-0fbc-42fb-853b-40a4f276d258 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea647438ea1c438987f28cbe39c3ff2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:28.797912 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947f73a2-a5ad-4588-b258-f21ff2c9ea1f service neutron] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:28.798036 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd15d44-0fbc-42fb-853b-40a4f276d258 service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:28.798279 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd15d44-0fbc-42fb-853b-40a4f276d258 service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:28.798548 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd15d44-0fbc-42fb-853b-40a4f276d258 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:28.807516 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1253/2543] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:43:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:43:28.859771 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd15d44-0fbc-42fb-853b-40a4f276d258 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:28.861129 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd15d44-0fbc-42fb-853b-40a4f276d258 service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:28.873688 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1291/2544] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:43:28 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:43:28.945806 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947f73a2-a5ad-4588-b258-f21ff2c9ea1f service neutron] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:28.955674 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947f73a2-a5ad-4588-b258-f21ff2c9ea1f service neutron] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:28.959543 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4184d8d6-cef7-49a7-a46b-f70b9b93d4cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea647438ea1c438987f28cbe39c3ff2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:28.960190 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4184d8d6-cef7-49a7-a46b-f70b9b93d4cd service cinder] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:28.960467 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4184d8d6-cef7-49a7-a46b-f70b9b93d4cd service cinder] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:28.960736 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4184d8d6-cef7-49a7-a46b-f70b9b93d4cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:28.962701 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-4184d8d6-cef7-49a7-a46b-f70b9b93d4cd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:29.026573 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4184d8d6-cef7-49a7-a46b-f70b9b93d4cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:29.028601 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4184d8d6-cef7-49a7-a46b-f70b9b93d4cd service cinder] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:29.037628 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1254/2545] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:43:28 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:43:29.099880 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd15d44-0fbc-42fb-853b-40a4f276d258 service cinder] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:29.101494 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-1dd15d44-0fbc-42fb-853b-40a4f276d258 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:29.117561 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd15d44-0fbc-42fb-853b-40a4f276d258 service cinder] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:29.122826 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90823870-2b8c-4c84-9064-0cf6c2988037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:29.123734 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90823870-2b8c-4c84-9064-0cf6c2988037 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:29.124010 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90823870-2b8c-4c84-9064-0cf6c2988037 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:29.124280 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90823870-2b8c-4c84-9064-0cf6c2988037 admin admin] PATH_INFO: `/v3/projects/e26e91803f10474cb661a614e0986834` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:29.125496 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90823870-2b8c-4c84-9064-0cf6c2988037 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e26e91803f10474cb661a614e0986834)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:29.127442 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90823870-2b8c-4c84-9064-0cf6c2988037 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:29.182838 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-90823870-2b8c-4c84-9064-0cf6c2988037 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e26e91803f10474cb661a614e0986834', 'request_id': 'req-90823870-2b8c-4c84-9064-0cf6c2988037'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:29.188259 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-90823870-2b8c-4c84-9064-0cf6c2988037 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e26e91803f10474cb661a614e0986834', 'request_id': 'req-90823870-2b8c-4c84-9064-0cf6c2988037'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:29.194661 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-90823870-2b8c-4c84-9064-0cf6c2988037 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e26e91803f10474cb661a614e0986834', 'request_id': 'req-90823870-2b8c-4c84-9064-0cf6c2988037'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:29.207328 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-90823870-2b8c-4c84-9064-0cf6c2988037 admin admin] The token cache is being invalidate because project e26e91803f10474cb661a614e0986834 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:43:29.207615 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-90823870-2b8c-4c84-9064-0cf6c2988037 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:29.208226 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-90823870-2b8c-4c84-9064-0cf6c2988037 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:29.209792 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1292/2546] 10.222.0.118 () {58 vars in 1237 bytes} [Thu Jul 14 15:43:29 2022] DELETE /identity/v3/projects/e26e91803f10474cb661a614e0986834 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:43:29.213899 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4184d8d6-cef7-49a7-a46b-f70b9b93d4cd service cinder] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:29.225260 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4184d8d6-cef7-49a7-a46b-f70b9b93d4cd service cinder] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:29.281690 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a26b62-96ed-4421-90f0-907b8f835caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:29.282879 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a26b62-96ed-4421-90f0-907b8f835caf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:29.283162 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a26b62-96ed-4421-90f0-907b8f835caf admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:29.283436 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a26b62-96ed-4421-90f0-907b8f835caf admin admin] PATH_INFO: `/v3/users/dd14d94bb9094dd7b085e0c80fdaefa0` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:29.284648 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a26b62-96ed-4421-90f0-907b8f835caf admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd14d94bb9094dd7b085e0c80fdaefa0)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:29.286612 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a26b62-96ed-4421-90f0-907b8f835caf admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:29.315586 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:43:29.333793 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-43a26b62-96ed-4421-90f0-907b8f835caf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd14d94bb9094dd7b085e0c80fdaefa0'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:29.342312 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-43a26b62-96ed-4421-90f0-907b8f835caf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd14d94bb9094dd7b085e0c80fdaefa0'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:29.342977 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-43a26b62-96ed-4421-90f0-907b8f835caf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd14d94bb9094dd7b085e0c80fdaefa0'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:29.343602 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-43a26b62-96ed-4421-90f0-907b8f835caf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd14d94bb9094dd7b085e0c80fdaefa0'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:29.355250 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-43a26b62-96ed-4421-90f0-907b8f835caf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd14d94bb9094dd7b085e0c80fdaefa0'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:29.368832 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1255/2547] 10.222.0.118 () {58 vars in 1228 bytes} [Thu Jul 14 15:43:29 2022] DELETE /identity/v3/users/dd14d94bb9094dd7b085e0c80fdaefa0 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:43:29.645355 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90823870-2b8c-4c84-9064-0cf6c2988037 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:29.646955 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-90823870-2b8c-4c84-9064-0cf6c2988037 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:29.655716 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:43:29.662487 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90823870-2b8c-4c84-9064-0cf6c2988037 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:29.725600 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66522df8-a88c-467b-9d9d-b4e2407d36f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:29.726507 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66522df8-a88c-467b-9d9d-b4e2407d36f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:29.726790 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66522df8-a88c-467b-9d9d-b4e2407d36f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:29.727065 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66522df8-a88c-467b-9d9d-b4e2407d36f6 admin admin] PATH_INFO: `/v3/projects/84cc91cc3a214c7f8b9db5c1e2f803f2` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:29.728280 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66522df8-a88c-467b-9d9d-b4e2407d36f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84cc91cc3a214c7f8b9db5c1e2f803f2)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:29.730241 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66522df8-a88c-467b-9d9d-b4e2407d36f6 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:29.778418 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-66522df8-a88c-467b-9d9d-b4e2407d36f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84cc91cc3a214c7f8b9db5c1e2f803f2', 'request_id': 'req-66522df8-a88c-467b-9d9d-b4e2407d36f6'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:29.784081 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-66522df8-a88c-467b-9d9d-b4e2407d36f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84cc91cc3a214c7f8b9db5c1e2f803f2', 'request_id': 'req-66522df8-a88c-467b-9d9d-b4e2407d36f6'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:29.790259 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-66522df8-a88c-467b-9d9d-b4e2407d36f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84cc91cc3a214c7f8b9db5c1e2f803f2', 'request_id': 'req-66522df8-a88c-467b-9d9d-b4e2407d36f6'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:29.802996 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-66522df8-a88c-467b-9d9d-b4e2407d36f6 admin admin] The token cache is being invalidate because project 84cc91cc3a214c7f8b9db5c1e2f803f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:43:29.803285 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-66522df8-a88c-467b-9d9d-b4e2407d36f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:29.803924 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-66522df8-a88c-467b-9d9d-b4e2407d36f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:29.805505 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1293/2548] 10.222.0.118 () {58 vars in 1237 bytes} [Thu Jul 14 15:43:29 2022] DELETE /identity/v3/projects/84cc91cc3a214c7f8b9db5c1e2f803f2 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:43:29.811599 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dbd5a7-d846-4388-bd07-1db3ab88c8b4 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:29.811890 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dbd5a7-d846-4388-bd07-1db3ab88c8b4 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:29.812199 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dbd5a7-d846-4388-bd07-1db3ab88c8b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:29.830447 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-66dbd5a7-d846-4388-bd07-1db3ab88c8b4 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:43:29.831662 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-66dbd5a7-d846-4388-bd07-1db3ab88c8b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:29.890969 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1256/2549] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:43:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:43:29.898738 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b28e0c-0bb7-416b-99ed-f22baaeb8f14 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:29.899031 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b28e0c-0bb7-416b-99ed-f22baaeb8f14 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:29.899311 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b28e0c-0bb7-416b-99ed-f22baaeb8f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:29.918865 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-19b28e0c-0bb7-416b-99ed-f22baaeb8f14 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:43:29.919911 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-19b28e0c-0bb7-416b-99ed-f22baaeb8f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:29.927894 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1294/2550] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:43:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:43:29.932142 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dbd5a7-d846-4388-bd07-1db3ab88c8b4 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:29.942738 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dbd5a7-d846-4388-bd07-1db3ab88c8b4 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:29.947845 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b44458-8948-4644-85ba-ed46a3673c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:29.948578 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b44458-8948-4644-85ba-ed46a3673c16 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:29.948856 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b44458-8948-4644-85ba-ed46a3673c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:29.949181 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b44458-8948-4644-85ba-ed46a3673c16 admin admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:29.950746 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b44458-8948-4644-85ba-ed46a3673c16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:43:29.951318 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b44458-8948-4644-85ba-ed46a3673c16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:29.953244 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b44458-8948-4644-85ba-ed46a3673c16 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:29.966100 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1257/2551] 10.222.0.118 () {58 vars in 1157 bytes} [Thu Jul 14 15:43:29 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:43:29.970517 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b28e0c-0bb7-416b-99ed-f22baaeb8f14 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:29.979711 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b28e0c-0bb7-416b-99ed-f22baaeb8f14 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:29.984890 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769dabf8-7587-43b4-ae75-0cc7582caba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:29.985531 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769dabf8-7587-43b4-ae75-0cc7582caba0 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:29.985812 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769dabf8-7587-43b4-ae75-0cc7582caba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:29.986123 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769dabf8-7587-43b4-ae75-0cc7582caba0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:29.986809 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769dabf8-7587-43b4-ae75-0cc7582caba0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:29.988702 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769dabf8-7587-43b4-ae75-0cc7582caba0 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:30.013864 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1295/2552] 10.222.0.118 () {60 vars in 1157 bytes} [Thu Jul 14 15:43:29 2022] POST /identity/v3/projects => generated 400 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:43:30.018097 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b44458-8948-4644-85ba-ed46a3673c16 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:30.029244 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b44458-8948-4644-85ba-ed46a3673c16 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:30.085062 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7b172c-8243-4889-98fa-4d12ab80d99b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:30.085717 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7b172c-8243-4889-98fa-4d12ab80d99b admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:30.086022 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7b172c-8243-4889-98fa-4d12ab80d99b admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:30.086303 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7b172c-8243-4889-98fa-4d12ab80d99b admin admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:30.086998 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7b172c-8243-4889-98fa-4d12ab80d99b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:30.088926 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7b172c-8243-4889-98fa-4d12ab80d99b admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:30.109222 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1258/2553] 10.222.0.118 () {60 vars in 1148 bytes} [Thu Jul 14 15:43:30 2022] POST /identity/v3/users => generated 301 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:43:30.113679 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769dabf8-7587-43b4-ae75-0cc7582caba0 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:30.124180 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769dabf8-7587-43b4-ae75-0cc7582caba0 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:30.128802 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e765abb-dd24-4cdb-b1bf-002a974fad52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:30.129473 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e765abb-dd24-4cdb-b1bf-002a974fad52 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:30.129740 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e765abb-dd24-4cdb-b1bf-002a974fad52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:30.130055 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e765abb-dd24-4cdb-b1bf-002a974fad52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:30.130787 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e765abb-dd24-4cdb-b1bf-002a974fad52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:30.132379 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e765abb-dd24-4cdb-b1bf-002a974fad52 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:30.143270 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1296/2554] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:43:30 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:43:30.147149 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7b172c-8243-4889-98fa-4d12ab80d99b admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:30.158186 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7b172c-8243-4889-98fa-4d12ab80d99b admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:30.162775 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235d870b-4eb6-43ef-9801-4046e09f344a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:30.163475 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d870b-4eb6-43ef-9801-4046e09f344a admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:30.163757 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d870b-4eb6-43ef-9801-4046e09f344a admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:30.164100 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d870b-4eb6-43ef-9801-4046e09f344a admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:30.164898 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235d870b-4eb6-43ef-9801-4046e09f344a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:30.166744 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235d870b-4eb6-43ef-9801-4046e09f344a admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:30.177530 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1259/2555] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:43:30 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:43:30.182047 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e765abb-dd24-4cdb-b1bf-002a974fad52 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:30.193239 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e765abb-dd24-4cdb-b1bf-002a974fad52 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:30.197955 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacd2819-b0e0-428a-a006-7635aaf74db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:30.198838 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacd2819-b0e0-428a-a006-7635aaf74db8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:30.199145 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacd2819-b0e0-428a-a006-7635aaf74db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:30.199529 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacd2819-b0e0-428a-a006-7635aaf74db8 admin admin] PATH_INFO: `/v3/projects/83c685821f14469983d3baa10f6c899f/users/3267f7abc5eb4757b2f7f3e4eabb3896/roles/4abcf5e5e7cd4b53ae1828fec6550d53` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:30.214553 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacd2819-b0e0-428a-a006-7635aaf74db8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83c685821f14469983d3baa10f6c899f, user_id=3267f7abc5eb4757b2f7f3e4eabb3896, role_id=4abcf5e5e7cd4b53ae1828fec6550d53)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:30.217277 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacd2819-b0e0-428a-a006-7635aaf74db8 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:30.234946 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1297/2556] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:43:30 2022] PUT /identity/v3/projects/83c685821f14469983d3baa10f6c899f/users/3267f7abc5eb4757b2f7f3e4eabb3896/roles/4abcf5e5e7cd4b53ae1828fec6550d53 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:43:30.246173 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960a27a7-6630-4c2f-8d4a-2d79319c8a0b None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:30.246625 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960a27a7-6630-4c2f-8d4a-2d79319c8a0b None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:30.247943 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960a27a7-6630-4c2f-8d4a-2d79319c8a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:30.267714 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:43:30.276318 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-960a27a7-6630-4c2f-8d4a-2d79319c8a0b None None] MFA Rules not processed for user `3267f7abc5eb4757b2f7f3e4eabb3896`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:43:30.278204 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-960a27a7-6630-4c2f-8d4a-2d79319c8a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:30.343693 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1260/2557] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:43:30 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:43:30.348298 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacd2819-b0e0-428a-a006-7635aaf74db8 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:30.386024 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:43:30.423220 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacd2819-b0e0-428a-a006-7635aaf74db8 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:30.427758 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c6c199-6d72-41ed-9725-1d953f594389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:30.428429 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c6c199-6d72-41ed-9725-1d953f594389 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:30.428706 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c6c199-6d72-41ed-9725-1d953f594389 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:30.428987 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c6c199-6d72-41ed-9725-1d953f594389 admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:30.429698 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c6c199-6d72-41ed-9725-1d953f594389 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:30.431658 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c6c199-6d72-41ed-9725-1d953f594389 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:30.460223 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1298/2558] 10.222.0.118 () {60 vars in 1157 bytes} [Thu Jul 14 15:43:30 2022] POST /identity/v3/projects => generated 400 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:43:30.464692 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960a27a7-6630-4c2f-8d4a-2d79319c8a0b None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:30.477371 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960a27a7-6630-4c2f-8d4a-2d79319c8a0b None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:30.557581 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996179cd-7137-46a0-845e-6e6825d56204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:30.558273 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996179cd-7137-46a0-845e-6e6825d56204 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:30.558569 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996179cd-7137-46a0-845e-6e6825d56204 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:30.558978 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996179cd-7137-46a0-845e-6e6825d56204 admin admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:30.560191 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996179cd-7137-46a0-845e-6e6825d56204 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:30.562369 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996179cd-7137-46a0-845e-6e6825d56204 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:30.589548 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1261/2559] 10.222.0.118 () {60 vars in 1148 bytes} [Thu Jul 14 15:43:30 2022] POST /identity/v3/users => generated 307 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:43:30.594477 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c6c199-6d72-41ed-9725-1d953f594389 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:30.605609 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c6c199-6d72-41ed-9725-1d953f594389 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:30.611184 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f0e9dc-3d26-4cb8-9cc2-499d932a0774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:30.611906 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f0e9dc-3d26-4cb8-9cc2-499d932a0774 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:30.612187 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f0e9dc-3d26-4cb8-9cc2-499d932a0774 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:30.612467 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f0e9dc-3d26-4cb8-9cc2-499d932a0774 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:30.613204 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f0e9dc-3d26-4cb8-9cc2-499d932a0774 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:30.614887 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f0e9dc-3d26-4cb8-9cc2-499d932a0774 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:30.628076 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1299/2560] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:43:30 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:43:30.632252 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996179cd-7137-46a0-845e-6e6825d56204 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:30.642729 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996179cd-7137-46a0-845e-6e6825d56204 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:30.647296 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f200a7b-5c6d-4598-9d08-ee7362f0eec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:30.648188 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f200a7b-5c6d-4598-9d08-ee7362f0eec4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:30.648462 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f200a7b-5c6d-4598-9d08-ee7362f0eec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:30.648730 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f200a7b-5c6d-4598-9d08-ee7362f0eec4 admin admin] PATH_INFO: `/v3/projects/20cae6fd99684a399d5e27fdba1c7437/users/03bb9806eaff4082a0916780d6c202a7/roles/3b880cef7dcf4baf87b50f8610c0c56e` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:30.663772 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f200a7b-5c6d-4598-9d08-ee7362f0eec4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20cae6fd99684a399d5e27fdba1c7437, user_id=03bb9806eaff4082a0916780d6c202a7, role_id=3b880cef7dcf4baf87b50f8610c0c56e)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:30.666710 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f200a7b-5c6d-4598-9d08-ee7362f0eec4 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:30.680599 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1262/2561] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:43:30 2022] PUT /identity/v3/projects/20cae6fd99684a399d5e27fdba1c7437/users/03bb9806eaff4082a0916780d6c202a7/roles/3b880cef7dcf4baf87b50f8610c0c56e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:43:30.684531 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f0e9dc-3d26-4cb8-9cc2-499d932a0774 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:30.694276 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f0e9dc-3d26-4cb8-9cc2-499d932a0774 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:30.751163 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d06775-5698-49b2-9f36-8b1513490031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:30.751839 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d06775-5698-49b2-9f36-8b1513490031 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:30.752124 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d06775-5698-49b2-9f36-8b1513490031 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:30.752396 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d06775-5698-49b2-9f36-8b1513490031 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:30.753124 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d06775-5698-49b2-9f36-8b1513490031 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:30.754762 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d06775-5698-49b2-9f36-8b1513490031 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:30.764472 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1300/2562] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:43:30 2022] GET /identity/v3/roles => generated 1427 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:43:30.768637 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f200a7b-5c6d-4598-9d08-ee7362f0eec4 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:30.779751 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f200a7b-5c6d-4598-9d08-ee7362f0eec4 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:30.784736 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b292adb9-1b47-4435-8f13-c48d2d40a29a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:30.785774 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b292adb9-1b47-4435-8f13-c48d2d40a29a admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:30.786155 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b292adb9-1b47-4435-8f13-c48d2d40a29a admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:30.786446 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b292adb9-1b47-4435-8f13-c48d2d40a29a admin admin] PATH_INFO: `/v3/projects/20cae6fd99684a399d5e27fdba1c7437/users/03bb9806eaff4082a0916780d6c202a7/roles/3b880cef7dcf4baf87b50f8610c0c56e` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:30.788677 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b292adb9-1b47-4435-8f13-c48d2d40a29a admin admin] RBAC: Authorizing `identity:create_grant(project_id=20cae6fd99684a399d5e27fdba1c7437, user_id=03bb9806eaff4082a0916780d6c202a7, role_id=3b880cef7dcf4baf87b50f8610c0c56e)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:30.791371 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b292adb9-1b47-4435-8f13-c48d2d40a29a admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:30.802980 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1263/2563] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:43:30 2022] PUT /identity/v3/projects/20cae6fd99684a399d5e27fdba1c7437/users/03bb9806eaff4082a0916780d6c202a7/roles/3b880cef7dcf4baf87b50f8610c0c56e => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:43:30.814462 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74874ba0-0700-47db-9f63-8f89c76c16f4 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:30.814751 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74874ba0-0700-47db-9f63-8f89c76c16f4 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:30.815030 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74874ba0-0700-47db-9f63-8f89c76c16f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:30.843077 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-74874ba0-0700-47db-9f63-8f89c76c16f4 None None] MFA Rules not processed for user `03bb9806eaff4082a0916780d6c202a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:43:30.844402 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-74874ba0-0700-47db-9f63-8f89c76c16f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:30.914456 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1301/2564] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:43:30 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:43:30.925647 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b292adb9-1b47-4435-8f13-c48d2d40a29a admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:30.927472 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-b292adb9-1b47-4435-8f13-c48d2d40a29a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:30.985620 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b292adb9-1b47-4435-8f13-c48d2d40a29a admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:30.989330 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af64de50-8b67-41cc-9d44-190d23bd5480 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea647438ea1c438987f28cbe39c3ff2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:30.990005 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af64de50-8b67-41cc-9d44-190d23bd5480 service cinder] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:30.990545 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af64de50-8b67-41cc-9d44-190d23bd5480 service cinder] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:30.990823 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af64de50-8b67-41cc-9d44-190d23bd5480 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:30.997775 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:43:31.000396 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af64de50-8b67-41cc-9d44-190d23bd5480 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:31.002217 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af64de50-8b67-41cc-9d44-190d23bd5480 service cinder] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:31.013360 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1264/2565] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:43:30 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:43:31.083110 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74874ba0-0700-47db-9f63-8f89c76c16f4 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:31.093241 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74874ba0-0700-47db-9f63-8f89c76c16f4 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:31.096840 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b744478a-0c12-477d-847a-389cf0fcd684 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea647438ea1c438987f28cbe39c3ff2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:31.097480 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b744478a-0c12-477d-847a-389cf0fcd684 service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:31.097760 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b744478a-0c12-477d-847a-389cf0fcd684 service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:31.098076 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b744478a-0c12-477d-847a-389cf0fcd684 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:31.118564 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:43:31.155398 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b744478a-0c12-477d-847a-389cf0fcd684 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:31.156829 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b744478a-0c12-477d-847a-389cf0fcd684 service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:31.165788 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1302/2566] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:43:31 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:43:35.201414 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af64de50-8b67-41cc-9d44-190d23bd5480 service cinder] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:35.263616 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af64de50-8b67-41cc-9d44-190d23bd5480 service cinder] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:35.268250 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2488cb-50e8-4362-81a1-3682845e8159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:35.269118 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2488cb-50e8-4362-81a1-3682845e8159 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:35.269395 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2488cb-50e8-4362-81a1-3682845e8159 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:35.269664 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2488cb-50e8-4362-81a1-3682845e8159 admin admin] PATH_INFO: `/v3/users/3267f7abc5eb4757b2f7f3e4eabb3896` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:35.270875 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2488cb-50e8-4362-81a1-3682845e8159 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3267f7abc5eb4757b2f7f3e4eabb3896)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:35.272810 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2488cb-50e8-4362-81a1-3682845e8159 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:35.322177 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-7e2488cb-50e8-4362-81a1-3682845e8159 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3267f7abc5eb4757b2f7f3e4eabb3896'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:35.329486 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-7e2488cb-50e8-4362-81a1-3682845e8159 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3267f7abc5eb4757b2f7f3e4eabb3896'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:35.330194 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-7e2488cb-50e8-4362-81a1-3682845e8159 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3267f7abc5eb4757b2f7f3e4eabb3896'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:35.330805 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-7e2488cb-50e8-4362-81a1-3682845e8159 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3267f7abc5eb4757b2f7f3e4eabb3896'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:35.343257 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-7e2488cb-50e8-4362-81a1-3682845e8159 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3267f7abc5eb4757b2f7f3e4eabb3896'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:35.356657 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1265/2567] 10.222.0.118 () {58 vars in 1228 bytes} [Thu Jul 14 15:43:35 2022] DELETE /identity/v3/users/3267f7abc5eb4757b2f7f3e4eabb3896 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:43:35.361235 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9c354c-8501-4f06-8f46-6461749409e4 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:35.361696 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9c354c-8501-4f06-8f46-6461749409e4 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:35.361792 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9c354c-8501-4f06-8f46-6461749409e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:35.378930 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-5c9c354c-8501-4f06-8f46-6461749409e4 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:43:35.380286 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-5c9c354c-8501-4f06-8f46-6461749409e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:35.437721 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1303/2568] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:43:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:43:35.447594 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2488cb-50e8-4362-81a1-3682845e8159 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:35.450229 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-7e2488cb-50e8-4362-81a1-3682845e8159 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:35.508438 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2488cb-50e8-4362-81a1-3682845e8159 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:35.513221 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41db8db9-b79f-4d00-9d52-e8d89c48d4ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b650be8114b64df0ac88441f1c50b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:35.513872 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41db8db9-b79f-4d00-9d52-e8d89c48d4ca service neutron] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:35.514553 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41db8db9-b79f-4d00-9d52-e8d89c48d4ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:35.514553 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41db8db9-b79f-4d00-9d52-e8d89c48d4ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:35.523827 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41db8db9-b79f-4d00-9d52-e8d89c48d4ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:35.525263 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41db8db9-b79f-4d00-9d52-e8d89c48d4ca service neutron] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:35.535339 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1266/2569] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:43:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:43:35.814232 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9c354c-8501-4f06-8f46-6461749409e4 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:35.815639 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-5c9c354c-8501-4f06-8f46-6461749409e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:35.829554 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9c354c-8501-4f06-8f46-6461749409e4 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:35.834243 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069f9324-8c6c-499b-a8f2-5004bf648b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:35.835104 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069f9324-8c6c-499b-a8f2-5004bf648b3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:35.835384 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069f9324-8c6c-499b-a8f2-5004bf648b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:35.836276 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069f9324-8c6c-499b-a8f2-5004bf648b3b admin admin] PATH_INFO: `/v3/projects/83c685821f14469983d3baa10f6c899f` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:35.837654 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069f9324-8c6c-499b-a8f2-5004bf648b3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=83c685821f14469983d3baa10f6c899f)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:35.839606 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069f9324-8c6c-499b-a8f2-5004bf648b3b admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:35.885890 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-069f9324-8c6c-499b-a8f2-5004bf648b3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83c685821f14469983d3baa10f6c899f', 'request_id': 'req-069f9324-8c6c-499b-a8f2-5004bf648b3b'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:35.892725 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-069f9324-8c6c-499b-a8f2-5004bf648b3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83c685821f14469983d3baa10f6c899f', 'request_id': 'req-069f9324-8c6c-499b-a8f2-5004bf648b3b'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:35.899507 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-069f9324-8c6c-499b-a8f2-5004bf648b3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83c685821f14469983d3baa10f6c899f', 'request_id': 'req-069f9324-8c6c-499b-a8f2-5004bf648b3b'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:35.913268 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-069f9324-8c6c-499b-a8f2-5004bf648b3b admin admin] The token cache is being invalidate because project 83c685821f14469983d3baa10f6c899f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:43:35.913557 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-069f9324-8c6c-499b-a8f2-5004bf648b3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:35.914355 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-069f9324-8c6c-499b-a8f2-5004bf648b3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:35.916023 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1304/2570] 10.222.0.118 () {58 vars in 1237 bytes} [Thu Jul 14 15:43:35 2022] DELETE /identity/v3/projects/83c685821f14469983d3baa10f6c899f => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:43:35.919969 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41db8db9-b79f-4d00-9d52-e8d89c48d4ca service neutron] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:35.929942 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41db8db9-b79f-4d00-9d52-e8d89c48d4ca service neutron] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:35.943401 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:43:35.994908 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5810848-48ef-4df4-9f7a-c69b2bee5e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:35.996100 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5810848-48ef-4df4-9f7a-c69b2bee5e6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:35.997198 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5810848-48ef-4df4-9f7a-c69b2bee5e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:35.997198 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5810848-48ef-4df4-9f7a-c69b2bee5e6f admin admin] PATH_INFO: `/v3/users/03bb9806eaff4082a0916780d6c202a7` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:35.998428 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5810848-48ef-4df4-9f7a-c69b2bee5e6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=03bb9806eaff4082a0916780d6c202a7)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:36.000339 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5810848-48ef-4df4-9f7a-c69b2bee5e6f admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:36.051494 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-a5810848-48ef-4df4-9f7a-c69b2bee5e6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03bb9806eaff4082a0916780d6c202a7'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:36.059434 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-a5810848-48ef-4df4-9f7a-c69b2bee5e6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03bb9806eaff4082a0916780d6c202a7'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:36.060020 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-a5810848-48ef-4df4-9f7a-c69b2bee5e6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03bb9806eaff4082a0916780d6c202a7'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:36.060619 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-a5810848-48ef-4df4-9f7a-c69b2bee5e6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03bb9806eaff4082a0916780d6c202a7'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:36.073320 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-a5810848-48ef-4df4-9f7a-c69b2bee5e6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03bb9806eaff4082a0916780d6c202a7'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:36.087270 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1267/2571] 10.222.0.118 () {58 vars in 1228 bytes} [Thu Jul 14 15:43:35 2022] DELETE /identity/v3/users/03bb9806eaff4082a0916780d6c202a7 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:43:36.378193 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069f9324-8c6c-499b-a8f2-5004bf648b3b admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:36.379748 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-069f9324-8c6c-499b-a8f2-5004bf648b3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:36.393008 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069f9324-8c6c-499b-a8f2-5004bf648b3b admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:36.438134 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:43:36.452447 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5141ace0-4827-44c6-8985-933b21ab5f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:36.453316 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5141ace0-4827-44c6-8985-933b21ab5f13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:36.453595 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5141ace0-4827-44c6-8985-933b21ab5f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:36.453895 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5141ace0-4827-44c6-8985-933b21ab5f13 admin admin] PATH_INFO: `/v3/projects/20cae6fd99684a399d5e27fdba1c7437` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:36.455123 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5141ace0-4827-44c6-8985-933b21ab5f13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20cae6fd99684a399d5e27fdba1c7437)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:36.457129 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5141ace0-4827-44c6-8985-933b21ab5f13 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:36.505476 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-5141ace0-4827-44c6-8985-933b21ab5f13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20cae6fd99684a399d5e27fdba1c7437', 'request_id': 'req-5141ace0-4827-44c6-8985-933b21ab5f13'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:36.511095 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-5141ace0-4827-44c6-8985-933b21ab5f13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20cae6fd99684a399d5e27fdba1c7437', 'request_id': 'req-5141ace0-4827-44c6-8985-933b21ab5f13'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:36.517226 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-5141ace0-4827-44c6-8985-933b21ab5f13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20cae6fd99684a399d5e27fdba1c7437', 'request_id': 'req-5141ace0-4827-44c6-8985-933b21ab5f13'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:36.529611 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-5141ace0-4827-44c6-8985-933b21ab5f13 admin admin] The token cache is being invalidate because project 20cae6fd99684a399d5e27fdba1c7437 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:43:36.529954 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-5141ace0-4827-44c6-8985-933b21ab5f13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:36.530657 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-5141ace0-4827-44c6-8985-933b21ab5f13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:36.532198 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1305/2572] 10.222.0.118 () {58 vars in 1237 bytes} [Thu Jul 14 15:43:36 2022] DELETE /identity/v3/projects/20cae6fd99684a399d5e27fdba1c7437 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:43:36.537332 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7c6e12-cf28-4c12-9f93-e8d856699d51 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:36.537787 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7c6e12-cf28-4c12-9f93-e8d856699d51 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:36.537882 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7c6e12-cf28-4c12-9f93-e8d856699d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:36.555737 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-ce7c6e12-cf28-4c12-9f93-e8d856699d51 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:43:36.557006 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-ce7c6e12-cf28-4c12-9f93-e8d856699d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:36.617053 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1268/2573] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:43:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:43:36.625186 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2488ee-8b2b-42d2-83ee-650405a4cbb7 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:36.625459 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2488ee-8b2b-42d2-83ee-650405a4cbb7 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:36.625785 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2488ee-8b2b-42d2-83ee-650405a4cbb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:36.644115 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-1a2488ee-8b2b-42d2-83ee-650405a4cbb7 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:43:36.645471 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-1a2488ee-8b2b-42d2-83ee-650405a4cbb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:36.654434 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1306/2574] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:43:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:43:36.658833 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7c6e12-cf28-4c12-9f93-e8d856699d51 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:36.669462 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7c6e12-cf28-4c12-9f93-e8d856699d51 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:36.674183 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73eba09-fcd8-4bd4-bcbd-4287d666c293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:36.674837 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73eba09-fcd8-4bd4-bcbd-4287d666c293 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:36.675119 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73eba09-fcd8-4bd4-bcbd-4287d666c293 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:36.675398 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73eba09-fcd8-4bd4-bcbd-4287d666c293 admin admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:36.676216 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73eba09-fcd8-4bd4-bcbd-4287d666c293 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:43:36.676527 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73eba09-fcd8-4bd4-bcbd-4287d666c293 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:36.678198 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73eba09-fcd8-4bd4-bcbd-4287d666c293 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:36.690244 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1269/2575] 10.222.0.118 () {58 vars in 1157 bytes} [Thu Jul 14 15:43:36 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:43:36.694543 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2488ee-8b2b-42d2-83ee-650405a4cbb7 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:36.704013 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2488ee-8b2b-42d2-83ee-650405a4cbb7 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:36.708770 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8e45c5-2784-4127-9694-32096a940d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:36.709445 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e45c5-2784-4127-9694-32096a940d21 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:36.709770 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e45c5-2784-4127-9694-32096a940d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:36.710123 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e45c5-2784-4127-9694-32096a940d21 admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:36.710891 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8e45c5-2784-4127-9694-32096a940d21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:36.712884 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8e45c5-2784-4127-9694-32096a940d21 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:36.740422 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1307/2576] 10.222.0.118 () {60 vars in 1157 bytes} [Thu Jul 14 15:43:36 2022] POST /identity/v3/projects => generated 374 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:43:36.744518 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73eba09-fcd8-4bd4-bcbd-4287d666c293 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:36.754631 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73eba09-fcd8-4bd4-bcbd-4287d666c293 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:36.774580 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:43:36.813827 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e6ec73-5ab7-4f53-990f-d90cc4f30ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:36.814526 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e6ec73-5ab7-4f53-990f-d90cc4f30ee8 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:36.814839 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e6ec73-5ab7-4f53-990f-d90cc4f30ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:36.815116 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e6ec73-5ab7-4f53-990f-d90cc4f30ee8 admin admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:36.815816 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e6ec73-5ab7-4f53-990f-d90cc4f30ee8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:36.817844 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e6ec73-5ab7-4f53-990f-d90cc4f30ee8 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:36.838230 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1270/2577] 10.222.0.118 () {60 vars in 1148 bytes} [Thu Jul 14 15:43:36 2022] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:43:36.842882 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8e45c5-2784-4127-9694-32096a940d21 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:36.853194 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8e45c5-2784-4127-9694-32096a940d21 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:36.858494 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b64d75a-b555-49a9-b329-dde1df3fcf8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:36.859165 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b64d75a-b555-49a9-b329-dde1df3fcf8a admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:36.859488 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b64d75a-b555-49a9-b329-dde1df3fcf8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:36.859804 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b64d75a-b555-49a9-b329-dde1df3fcf8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:36.860682 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b64d75a-b555-49a9-b329-dde1df3fcf8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:36.862363 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b64d75a-b555-49a9-b329-dde1df3fcf8a admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:36.873423 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1308/2578] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:43:36 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:43:36.877602 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e6ec73-5ab7-4f53-990f-d90cc4f30ee8 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:36.889336 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e6ec73-5ab7-4f53-990f-d90cc4f30ee8 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:36.894052 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c81eeb-a4d3-4ea7-95ac-8dc97c67255c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:36.894714 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c81eeb-a4d3-4ea7-95ac-8dc97c67255c admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:36.894993 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c81eeb-a4d3-4ea7-95ac-8dc97c67255c admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:36.895267 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c81eeb-a4d3-4ea7-95ac-8dc97c67255c admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:36.895992 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c81eeb-a4d3-4ea7-95ac-8dc97c67255c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:36.897579 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c81eeb-a4d3-4ea7-95ac-8dc97c67255c admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:36.908282 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1271/2579] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:43:36 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:43:36.912415 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b64d75a-b555-49a9-b329-dde1df3fcf8a admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:36.922350 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b64d75a-b555-49a9-b329-dde1df3fcf8a admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:36.926928 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf303b4-06a2-4a72-addf-3d1cd7362702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:36.927812 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf303b4-06a2-4a72-addf-3d1cd7362702 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:36.928135 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf303b4-06a2-4a72-addf-3d1cd7362702 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:36.928471 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf303b4-06a2-4a72-addf-3d1cd7362702 admin admin] PATH_INFO: `/v3/projects/ac08fb32a3b74141b32e0d91df60f491/users/d47fa9c35e0c49c78c22ffea75b1f4b3/roles/4abcf5e5e7cd4b53ae1828fec6550d53` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:36.943539 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf303b4-06a2-4a72-addf-3d1cd7362702 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac08fb32a3b74141b32e0d91df60f491, user_id=d47fa9c35e0c49c78c22ffea75b1f4b3, role_id=4abcf5e5e7cd4b53ae1828fec6550d53)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:36.946252 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf303b4-06a2-4a72-addf-3d1cd7362702 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:36.958932 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1309/2580] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:43:36 2022] PUT /identity/v3/projects/ac08fb32a3b74141b32e0d91df60f491/users/d47fa9c35e0c49c78c22ffea75b1f4b3/roles/4abcf5e5e7cd4b53ae1828fec6550d53 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:43:36.969762 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88529ba7-5832-4d15-90ef-9fafc45e6ffd None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:36.970089 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88529ba7-5832-4d15-90ef-9fafc45e6ffd None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:36.970371 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88529ba7-5832-4d15-90ef-9fafc45e6ffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:36.996633 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-88529ba7-5832-4d15-90ef-9fafc45e6ffd None None] MFA Rules not processed for user `d47fa9c35e0c49c78c22ffea75b1f4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:43:36.997793 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-88529ba7-5832-4d15-90ef-9fafc45e6ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:37.062518 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1272/2581] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:43:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:43:37.073853 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf303b4-06a2-4a72-addf-3d1cd7362702 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:37.076219 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-cdf303b4-06a2-4a72-addf-3d1cd7362702 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:37.133649 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf303b4-06a2-4a72-addf-3d1cd7362702 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:37.137882 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a98aea1-5f57-400b-afcf-183afb776c60 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea647438ea1c438987f28cbe39c3ff2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:37.138568 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a98aea1-5f57-400b-afcf-183afb776c60 service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:37.138890 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a98aea1-5f57-400b-afcf-183afb776c60 service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:37.139204 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a98aea1-5f57-400b-afcf-183afb776c60 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:37.147602 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a98aea1-5f57-400b-afcf-183afb776c60 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:37.149059 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a98aea1-5f57-400b-afcf-183afb776c60 service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:37.158663 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1310/2582] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:43:37 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:43:37.177607 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88529ba7-5832-4d15-90ef-9fafc45e6ffd None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:37.245258 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88529ba7-5832-4d15-90ef-9fafc45e6ffd None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:37.250913 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02429e66-2f72-4ecc-862e-22c5da7276c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:37.251792 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02429e66-2f72-4ecc-862e-22c5da7276c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:37.252080 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02429e66-2f72-4ecc-862e-22c5da7276c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:37.252360 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02429e66-2f72-4ecc-862e-22c5da7276c0 admin admin] PATH_INFO: `/v3/users/d47fa9c35e0c49c78c22ffea75b1f4b3` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:37.253584 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02429e66-2f72-4ecc-862e-22c5da7276c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d47fa9c35e0c49c78c22ffea75b1f4b3)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:37.255570 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02429e66-2f72-4ecc-862e-22c5da7276c0 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:37.305063 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:43:37.317610 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-02429e66-2f72-4ecc-862e-22c5da7276c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd47fa9c35e0c49c78c22ffea75b1f4b3'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:37.326409 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-02429e66-2f72-4ecc-862e-22c5da7276c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd47fa9c35e0c49c78c22ffea75b1f4b3'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:37.327131 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-02429e66-2f72-4ecc-862e-22c5da7276c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd47fa9c35e0c49c78c22ffea75b1f4b3'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:37.327764 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-02429e66-2f72-4ecc-862e-22c5da7276c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd47fa9c35e0c49c78c22ffea75b1f4b3'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:37.340598 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-02429e66-2f72-4ecc-862e-22c5da7276c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd47fa9c35e0c49c78c22ffea75b1f4b3'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:37.355800 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1273/2583] 10.222.0.118 () {58 vars in 1228 bytes} [Thu Jul 14 15:43:37 2022] DELETE /identity/v3/users/d47fa9c35e0c49c78c22ffea75b1f4b3 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:43:37.361447 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6be9fc-57dd-4d21-9a6e-2ee0bcbb2cee None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:37.361828 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6be9fc-57dd-4d21-9a6e-2ee0bcbb2cee None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:37.362215 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6be9fc-57dd-4d21-9a6e-2ee0bcbb2cee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:37.383304 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-2f6be9fc-57dd-4d21-9a6e-2ee0bcbb2cee None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:43:37.384628 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-2f6be9fc-57dd-4d21-9a6e-2ee0bcbb2cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:37.396095 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:43:37.454525 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1311/2584] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:43:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:43:37.463982 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02429e66-2f72-4ecc-862e-22c5da7276c0 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:37.465653 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-02429e66-2f72-4ecc-862e-22c5da7276c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:37.529684 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02429e66-2f72-4ecc-862e-22c5da7276c0 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:37.533384 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f490f5-9a5a-4603-bfbc-161cfaa2a7c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b650be8114b64df0ac88441f1c50b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:37.534435 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f490f5-9a5a-4603-bfbc-161cfaa2a7c8 service neutron] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:37.534720 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f490f5-9a5a-4603-bfbc-161cfaa2a7c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:37.534996 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f490f5-9a5a-4603-bfbc-161cfaa2a7c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:37.544084 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f490f5-9a5a-4603-bfbc-161cfaa2a7c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:37.545533 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f490f5-9a5a-4603-bfbc-161cfaa2a7c8 service neutron] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:37.555535 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1274/2585] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:43:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:43:37.829590 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6be9fc-57dd-4d21-9a6e-2ee0bcbb2cee None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:37.831230 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-2f6be9fc-57dd-4d21-9a6e-2ee0bcbb2cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:37.844212 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6be9fc-57dd-4d21-9a6e-2ee0bcbb2cee None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:37.848908 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad9c90b-7b03-4ebd-8b79-c285fbf8a8c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:37.849785 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad9c90b-7b03-4ebd-8b79-c285fbf8a8c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:37.850131 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad9c90b-7b03-4ebd-8b79-c285fbf8a8c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:37.851022 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad9c90b-7b03-4ebd-8b79-c285fbf8a8c3 admin admin] PATH_INFO: `/v3/projects/ac08fb32a3b74141b32e0d91df60f491` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:37.852464 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad9c90b-7b03-4ebd-8b79-c285fbf8a8c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac08fb32a3b74141b32e0d91df60f491)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:37.854486 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad9c90b-7b03-4ebd-8b79-c285fbf8a8c3 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:37.902904 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-fad9c90b-7b03-4ebd-8b79-c285fbf8a8c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac08fb32a3b74141b32e0d91df60f491', 'request_id': 'req-fad9c90b-7b03-4ebd-8b79-c285fbf8a8c3'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:37.908721 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-fad9c90b-7b03-4ebd-8b79-c285fbf8a8c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac08fb32a3b74141b32e0d91df60f491', 'request_id': 'req-fad9c90b-7b03-4ebd-8b79-c285fbf8a8c3'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:37.915092 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-fad9c90b-7b03-4ebd-8b79-c285fbf8a8c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac08fb32a3b74141b32e0d91df60f491', 'request_id': 'req-fad9c90b-7b03-4ebd-8b79-c285fbf8a8c3'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:37.927779 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-fad9c90b-7b03-4ebd-8b79-c285fbf8a8c3 admin admin] The token cache is being invalidate because project ac08fb32a3b74141b32e0d91df60f491 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:43:37.928119 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-fad9c90b-7b03-4ebd-8b79-c285fbf8a8c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:37.928789 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-fad9c90b-7b03-4ebd-8b79-c285fbf8a8c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:37.930383 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1312/2586] 10.222.0.118 () {58 vars in 1237 bytes} [Thu Jul 14 15:43:37 2022] DELETE /identity/v3/projects/ac08fb32a3b74141b32e0d91df60f491 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:43:37.936201 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53d76c1-11c6-4e11-9ba3-6d5ef79cd348 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:37.936486 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53d76c1-11c6-4e11-9ba3-6d5ef79cd348 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:37.936763 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53d76c1-11c6-4e11-9ba3-6d5ef79cd348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:37.954009 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-d53d76c1-11c6-4e11-9ba3-6d5ef79cd348 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:43:37.955233 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-d53d76c1-11c6-4e11-9ba3-6d5ef79cd348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:38.013783 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1275/2587] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:43:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:43:38.022554 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac7ea80-6c9e-4251-b9c6-8bf2ec3da700 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:38.022892 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac7ea80-6c9e-4251-b9c6-8bf2ec3da700 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:38.023217 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac7ea80-6c9e-4251-b9c6-8bf2ec3da700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:38.042138 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-bac7ea80-6c9e-4251-b9c6-8bf2ec3da700 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:43:38.043918 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-bac7ea80-6c9e-4251-b9c6-8bf2ec3da700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:38.052202 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1313/2588] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:43:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:43:38.056368 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53d76c1-11c6-4e11-9ba3-6d5ef79cd348 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:38.066397 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53d76c1-11c6-4e11-9ba3-6d5ef79cd348 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:38.070934 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d259c4d-b518-413e-8681-f590bdec4082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:38.071588 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d259c4d-b518-413e-8681-f590bdec4082 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:38.071869 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d259c4d-b518-413e-8681-f590bdec4082 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:38.072144 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d259c4d-b518-413e-8681-f590bdec4082 admin admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:38.072878 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d259c4d-b518-413e-8681-f590bdec4082 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:43:38.073172 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d259c4d-b518-413e-8681-f590bdec4082 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:38.074962 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d259c4d-b518-413e-8681-f590bdec4082 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:38.086362 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1276/2589] 10.222.0.118 () {58 vars in 1157 bytes} [Thu Jul 14 15:43:38 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:43:38.091175 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac7ea80-6c9e-4251-b9c6-8bf2ec3da700 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:38.100424 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac7ea80-6c9e-4251-b9c6-8bf2ec3da700 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:38.105071 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c1f424-4758-4236-943a-81cfda0c5f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:38.106344 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c1f424-4758-4236-943a-81cfda0c5f18 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:38.106677 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c1f424-4758-4236-943a-81cfda0c5f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:38.106993 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c1f424-4758-4236-943a-81cfda0c5f18 admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:38.107720 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c1f424-4758-4236-943a-81cfda0c5f18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:38.109689 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c1f424-4758-4236-943a-81cfda0c5f18 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:38.135356 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1314/2590] 10.222.0.118 () {60 vars in 1157 bytes} [Thu Jul 14 15:43:38 2022] POST /identity/v3/projects => generated 386 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:43:38.139653 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d259c4d-b518-413e-8681-f590bdec4082 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:38.149566 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d259c4d-b518-413e-8681-f590bdec4082 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:38.189945 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:43:38.207795 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25236182-a0b0-4923-83af-a17fa22f5f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:38.208460 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25236182-a0b0-4923-83af-a17fa22f5f9f admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:38.208739 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25236182-a0b0-4923-83af-a17fa22f5f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:38.209011 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25236182-a0b0-4923-83af-a17fa22f5f9f admin admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:38.209737 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25236182-a0b0-4923-83af-a17fa22f5f9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:38.211694 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25236182-a0b0-4923-83af-a17fa22f5f9f admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:38.231513 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1277/2591] 10.222.0.118 () {60 vars in 1148 bytes} [Thu Jul 14 15:43:38 2022] POST /identity/v3/users => generated 294 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:43:38.235946 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c1f424-4758-4236-943a-81cfda0c5f18 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:38.246323 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c1f424-4758-4236-943a-81cfda0c5f18 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:38.250902 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57392e05-65fa-4c2e-9871-c803da3e8cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:38.251575 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57392e05-65fa-4c2e-9871-c803da3e8cd5 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:38.251898 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57392e05-65fa-4c2e-9871-c803da3e8cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:38.252216 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57392e05-65fa-4c2e-9871-c803da3e8cd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:38.252980 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57392e05-65fa-4c2e-9871-c803da3e8cd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:38.254660 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57392e05-65fa-4c2e-9871-c803da3e8cd5 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:38.265256 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1315/2592] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:43:38 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:43:38.269182 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25236182-a0b0-4923-83af-a17fa22f5f9f admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:38.279527 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25236182-a0b0-4923-83af-a17fa22f5f9f admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:38.284078 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabfc1fa-917b-4966-9125-57de2079f110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:38.284764 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabfc1fa-917b-4966-9125-57de2079f110 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:38.285059 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabfc1fa-917b-4966-9125-57de2079f110 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:38.285373 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabfc1fa-917b-4966-9125-57de2079f110 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:38.286236 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabfc1fa-917b-4966-9125-57de2079f110 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:38.287856 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabfc1fa-917b-4966-9125-57de2079f110 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:38.298427 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1278/2593] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:43:38 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:43:38.302606 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57392e05-65fa-4c2e-9871-c803da3e8cd5 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:38.312752 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57392e05-65fa-4c2e-9871-c803da3e8cd5 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:38.317283 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d0ee34-d224-44c6-a8b0-1146c2a123f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:38.318201 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d0ee34-d224-44c6-a8b0-1146c2a123f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:38.318519 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d0ee34-d224-44c6-a8b0-1146c2a123f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:38.318852 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d0ee34-d224-44c6-a8b0-1146c2a123f0 admin admin] PATH_INFO: `/v3/projects/dcd80a89664e450fa01173d4893745b7/users/ff31c61f6fef4bd9b508cb476bdc65e3/roles/4abcf5e5e7cd4b53ae1828fec6550d53` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:38.332982 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d0ee34-d224-44c6-a8b0-1146c2a123f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcd80a89664e450fa01173d4893745b7, user_id=ff31c61f6fef4bd9b508cb476bdc65e3, role_id=4abcf5e5e7cd4b53ae1828fec6550d53)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:38.335663 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d0ee34-d224-44c6-a8b0-1146c2a123f0 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:38.349798 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1316/2594] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:43:38 2022] PUT /identity/v3/projects/dcd80a89664e450fa01173d4893745b7/users/ff31c61f6fef4bd9b508cb476bdc65e3/roles/4abcf5e5e7cd4b53ae1828fec6550d53 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:43:38.360538 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb60a23-2ef2-4491-adda-9a66e9a6fe0e None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:38.360826 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb60a23-2ef2-4491-adda-9a66e9a6fe0e None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:38.361106 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb60a23-2ef2-4491-adda-9a66e9a6fe0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:38.387924 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-cfb60a23-2ef2-4491-adda-9a66e9a6fe0e None None] MFA Rules not processed for user `ff31c61f6fef4bd9b508cb476bdc65e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:43:38.389174 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-cfb60a23-2ef2-4491-adda-9a66e9a6fe0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:38.450967 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1279/2595] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:43:38 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:43:38.461537 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d0ee34-d224-44c6-a8b0-1146c2a123f0 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:38.463370 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-e9d0ee34-d224-44c6-a8b0-1146c2a123f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:38.506498 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:43:38.527310 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d0ee34-d224-44c6-a8b0-1146c2a123f0 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:38.533388 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf79fc4-3b97-4767-a657-6659384bda5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea647438ea1c438987f28cbe39c3ff2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:38.534080 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf79fc4-3b97-4767-a657-6659384bda5b service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:38.534409 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf79fc4-3b97-4767-a657-6659384bda5b service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:38.535073 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf79fc4-3b97-4767-a657-6659384bda5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:38.544367 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf79fc4-3b97-4767-a657-6659384bda5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:38.545834 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf79fc4-3b97-4767-a657-6659384bda5b service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:38.556311 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1317/2596] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:43:38 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:43:43.961413 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb60a23-2ef2-4491-adda-9a66e9a6fe0e None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:44.023672 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb60a23-2ef2-4491-adda-9a66e9a6fe0e None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:44.028319 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d763bb7-93a9-459b-a3f3-c7981acf37f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:44.029186 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d763bb7-93a9-459b-a3f3-c7981acf37f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:44.029467 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d763bb7-93a9-459b-a3f3-c7981acf37f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:44.029739 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d763bb7-93a9-459b-a3f3-c7981acf37f6 admin admin] PATH_INFO: `/v3/users/ff31c61f6fef4bd9b508cb476bdc65e3` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:44.031467 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d763bb7-93a9-459b-a3f3-c7981acf37f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff31c61f6fef4bd9b508cb476bdc65e3)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:44.033398 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d763bb7-93a9-459b-a3f3-c7981acf37f6 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:44.079036 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-5d763bb7-93a9-459b-a3f3-c7981acf37f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff31c61f6fef4bd9b508cb476bdc65e3'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:44.083644 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:43:44.086554 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-5d763bb7-93a9-459b-a3f3-c7981acf37f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff31c61f6fef4bd9b508cb476bdc65e3'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:44.087302 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-5d763bb7-93a9-459b-a3f3-c7981acf37f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff31c61f6fef4bd9b508cb476bdc65e3'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:44.088402 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-5d763bb7-93a9-459b-a3f3-c7981acf37f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff31c61f6fef4bd9b508cb476bdc65e3'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:44.101396 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-5d763bb7-93a9-459b-a3f3-c7981acf37f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff31c61f6fef4bd9b508cb476bdc65e3'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:44.114492 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1280/2597] 10.222.0.118 () {58 vars in 1228 bytes} [Thu Jul 14 15:43:43 2022] DELETE /identity/v3/users/ff31c61f6fef4bd9b508cb476bdc65e3 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:43:44.119308 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba03b5a8-683c-491d-a403-8627ff0fa68a None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:44.119786 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba03b5a8-683c-491d-a403-8627ff0fa68a None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:44.119967 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba03b5a8-683c-491d-a403-8627ff0fa68a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:44.138037 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-ba03b5a8-683c-491d-a403-8627ff0fa68a None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:43:44.139281 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-ba03b5a8-683c-491d-a403-8627ff0fa68a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:44.198016 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1318/2598] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:43:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:43:44.207734 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d763bb7-93a9-459b-a3f3-c7981acf37f6 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:44.209198 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-5d763bb7-93a9-459b-a3f3-c7981acf37f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:44.267226 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d763bb7-93a9-459b-a3f3-c7981acf37f6 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:44.270830 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba12f70-5b70-42c7-9df7-9ee9a3bd7159 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b650be8114b64df0ac88441f1c50b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:44.272122 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba12f70-5b70-42c7-9df7-9ee9a3bd7159 service neutron] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:44.272402 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba12f70-5b70-42c7-9df7-9ee9a3bd7159 service neutron] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:44.272672 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba12f70-5b70-42c7-9df7-9ee9a3bd7159 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:44.282241 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba12f70-5b70-42c7-9df7-9ee9a3bd7159 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:44.283658 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba12f70-5b70-42c7-9df7-9ee9a3bd7159 service neutron] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:44.292953 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1281/2599] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:43:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:43:44.561727 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba03b5a8-683c-491d-a403-8627ff0fa68a None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:44.563166 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-ba03b5a8-683c-491d-a403-8627ff0fa68a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:44.576001 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba03b5a8-683c-491d-a403-8627ff0fa68a None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:44.581134 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0765f8c2-9367-4a54-93e2-4ccf9de12465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:44.582567 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0765f8c2-9367-4a54-93e2-4ccf9de12465 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:44.582856 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0765f8c2-9367-4a54-93e2-4ccf9de12465 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:44.583300 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0765f8c2-9367-4a54-93e2-4ccf9de12465 admin admin] PATH_INFO: `/v3/projects/dcd80a89664e450fa01173d4893745b7` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:44.584568 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0765f8c2-9367-4a54-93e2-4ccf9de12465 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcd80a89664e450fa01173d4893745b7)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:44.586671 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0765f8c2-9367-4a54-93e2-4ccf9de12465 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:44.634201 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-0765f8c2-9367-4a54-93e2-4ccf9de12465 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcd80a89664e450fa01173d4893745b7', 'request_id': 'req-0765f8c2-9367-4a54-93e2-4ccf9de12465'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:44.640252 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-0765f8c2-9367-4a54-93e2-4ccf9de12465 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcd80a89664e450fa01173d4893745b7', 'request_id': 'req-0765f8c2-9367-4a54-93e2-4ccf9de12465'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:44.646490 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-0765f8c2-9367-4a54-93e2-4ccf9de12465 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcd80a89664e450fa01173d4893745b7', 'request_id': 'req-0765f8c2-9367-4a54-93e2-4ccf9de12465'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:44.660284 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-0765f8c2-9367-4a54-93e2-4ccf9de12465 admin admin] The token cache is being invalidate because project dcd80a89664e450fa01173d4893745b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:43:44.660566 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-0765f8c2-9367-4a54-93e2-4ccf9de12465 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:44.661205 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-0765f8c2-9367-4a54-93e2-4ccf9de12465 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:44.662766 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1319/2600] 10.222.0.118 () {58 vars in 1237 bytes} [Thu Jul 14 15:43:44 2022] DELETE /identity/v3/projects/dcd80a89664e450fa01173d4893745b7 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:43:44.667796 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5226cbe1-a9e2-42bd-8baf-823048e805ab None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:44.668086 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5226cbe1-a9e2-42bd-8baf-823048e805ab None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:44.668367 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5226cbe1-a9e2-42bd-8baf-823048e805ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:44.685696 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-5226cbe1-a9e2-42bd-8baf-823048e805ab None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:43:44.687450 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-5226cbe1-a9e2-42bd-8baf-823048e805ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:44.747283 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1282/2601] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:43:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:43:44.755734 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102adaa0-ec6d-4426-8cb2-6b6ba4f39423 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:44.756037 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102adaa0-ec6d-4426-8cb2-6b6ba4f39423 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:44.756315 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102adaa0-ec6d-4426-8cb2-6b6ba4f39423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:44.775198 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-102adaa0-ec6d-4426-8cb2-6b6ba4f39423 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:43:44.776395 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-102adaa0-ec6d-4426-8cb2-6b6ba4f39423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:44.785174 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1320/2602] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:43:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:43:44.789393 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5226cbe1-a9e2-42bd-8baf-823048e805ab None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:44.799756 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5226cbe1-a9e2-42bd-8baf-823048e805ab None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:44.804274 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1387ba12-abea-4780-b191-7d3c5d84ac22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:44.804923 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1387ba12-abea-4780-b191-7d3c5d84ac22 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:44.805204 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1387ba12-abea-4780-b191-7d3c5d84ac22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:44.805479 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1387ba12-abea-4780-b191-7d3c5d84ac22 admin admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:44.806247 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1387ba12-abea-4780-b191-7d3c5d84ac22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:43:44.806556 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1387ba12-abea-4780-b191-7d3c5d84ac22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:44.808156 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1387ba12-abea-4780-b191-7d3c5d84ac22 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:44.819688 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1283/2603] 10.222.0.118 () {58 vars in 1157 bytes} [Thu Jul 14 15:43:44 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:43:44.823796 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102adaa0-ec6d-4426-8cb2-6b6ba4f39423 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:44.833062 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102adaa0-ec6d-4426-8cb2-6b6ba4f39423 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:44.838427 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f321e12-8659-4de5-aa45-6b188c7819c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:44.839077 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f321e12-8659-4de5-aa45-6b188c7819c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:44.839353 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f321e12-8659-4de5-aa45-6b188c7819c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:44.839625 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f321e12-8659-4de5-aa45-6b188c7819c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:44.840319 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f321e12-8659-4de5-aa45-6b188c7819c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:44.842272 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f321e12-8659-4de5-aa45-6b188c7819c4 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:44.872558 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1321/2604] 10.222.0.118 () {60 vars in 1157 bytes} [Thu Jul 14 15:43:44 2022] POST /identity/v3/projects => generated 374 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:43:44.873650 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1387ba12-abea-4780-b191-7d3c5d84ac22 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:44.883620 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1387ba12-abea-4780-b191-7d3c5d84ac22 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:44.952068 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e9b7ee-c4d9-4af3-afb2-c09ded917a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:44.952746 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e9b7ee-c4d9-4af3-afb2-c09ded917a8f admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:44.953024 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e9b7ee-c4d9-4af3-afb2-c09ded917a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:44.953298 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e9b7ee-c4d9-4af3-afb2-c09ded917a8f admin admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:44.954052 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e9b7ee-c4d9-4af3-afb2-c09ded917a8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:44.955983 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e9b7ee-c4d9-4af3-afb2-c09ded917a8f admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:44.962753 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:43:44.978779 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1284/2605] 10.222.0.118 () {60 vars in 1148 bytes} [Thu Jul 14 15:43:44 2022] POST /identity/v3/users => generated 288 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:43:44.983096 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f321e12-8659-4de5-aa45-6b188c7819c4 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:44.994331 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f321e12-8659-4de5-aa45-6b188c7819c4 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:44.998945 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3832a869-7644-43f9-a3f1-cce43e7e801d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:44.999546 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3832a869-7644-43f9-a3f1-cce43e7e801d admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:44.999822 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3832a869-7644-43f9-a3f1-cce43e7e801d admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:45.000093 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3832a869-7644-43f9-a3f1-cce43e7e801d admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:45.000816 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3832a869-7644-43f9-a3f1-cce43e7e801d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:45.002520 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3832a869-7644-43f9-a3f1-cce43e7e801d admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:45.012770 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1322/2606] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:43:44 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:43:45.017336 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e9b7ee-c4d9-4af3-afb2-c09ded917a8f admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:45.027168 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e9b7ee-c4d9-4af3-afb2-c09ded917a8f admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:45.032314 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead91f4f-3383-4f23-b99b-b951b1d6cbd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:45.032964 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead91f4f-3383-4f23-b99b-b951b1d6cbd6 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:45.033239 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead91f4f-3383-4f23-b99b-b951b1d6cbd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:45.033510 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead91f4f-3383-4f23-b99b-b951b1d6cbd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:45.034380 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead91f4f-3383-4f23-b99b-b951b1d6cbd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:45.035968 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead91f4f-3383-4f23-b99b-b951b1d6cbd6 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:45.045752 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1285/2607] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:43:45 2022] GET /identity/v3/roles => generated 1427 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:43:45.049719 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3832a869-7644-43f9-a3f1-cce43e7e801d admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:45.059442 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3832a869-7644-43f9-a3f1-cce43e7e801d admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:45.063961 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34129b6b-ea21-42a3-ac8b-0f9b0d37aecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:45.064839 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34129b6b-ea21-42a3-ac8b-0f9b0d37aecd admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:45.065097 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34129b6b-ea21-42a3-ac8b-0f9b0d37aecd admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:45.065366 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34129b6b-ea21-42a3-ac8b-0f9b0d37aecd admin admin] PATH_INFO: `/v3/projects/aa27434944de4075a635db2e90ac2a2b/users/22da00db00a44e80841c7f4ce878cb9f/roles/4abcf5e5e7cd4b53ae1828fec6550d53` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:45.081050 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34129b6b-ea21-42a3-ac8b-0f9b0d37aecd admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa27434944de4075a635db2e90ac2a2b, user_id=22da00db00a44e80841c7f4ce878cb9f, role_id=4abcf5e5e7cd4b53ae1828fec6550d53)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:45.083807 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34129b6b-ea21-42a3-ac8b-0f9b0d37aecd admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:45.094790 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:43:45.102846 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1323/2608] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:43:45 2022] PUT /identity/v3/projects/aa27434944de4075a635db2e90ac2a2b/users/22da00db00a44e80841c7f4ce878cb9f/roles/4abcf5e5e7cd4b53ae1828fec6550d53 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:43:45.113253 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94443b22-b165-4657-a5e5-990b2250980e None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:45.113545 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94443b22-b165-4657-a5e5-990b2250980e None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:45.113828 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94443b22-b165-4657-a5e5-990b2250980e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:45.141361 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-94443b22-b165-4657-a5e5-990b2250980e None None] MFA Rules not processed for user `22da00db00a44e80841c7f4ce878cb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:43:45.142618 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-94443b22-b165-4657-a5e5-990b2250980e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:45.209326 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1286/2609] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:43:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:43:45.213778 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34129b6b-ea21-42a3-ac8b-0f9b0d37aecd admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:45.274583 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34129b6b-ea21-42a3-ac8b-0f9b0d37aecd admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:45.279552 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3e4479-997f-450f-a5fa-4add63540587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:45.280872 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3e4479-997f-450f-a5fa-4add63540587 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:45.281151 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3e4479-997f-450f-a5fa-4add63540587 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:45.281422 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3e4479-997f-450f-a5fa-4add63540587 admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:45.282156 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3e4479-997f-450f-a5fa-4add63540587 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:45.284234 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3e4479-997f-450f-a5fa-4add63540587 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:45.315662 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1324/2610] 10.222.0.118 () {60 vars in 1157 bytes} [Thu Jul 14 15:43:45 2022] POST /identity/v3/projects => generated 376 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:43:45.316848 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94443b22-b165-4657-a5e5-990b2250980e None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:45.328360 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94443b22-b165-4657-a5e5-990b2250980e None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:45.388146 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3117a0b-74b2-4217-a119-fe348794fe8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:45.388826 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3117a0b-74b2-4217-a119-fe348794fe8c admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:45.389112 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3117a0b-74b2-4217-a119-fe348794fe8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:45.389387 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3117a0b-74b2-4217-a119-fe348794fe8c admin admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:45.390609 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3117a0b-74b2-4217-a119-fe348794fe8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:45.392561 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3117a0b-74b2-4217-a119-fe348794fe8c admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:45.413935 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1287/2611] 10.222.0.118 () {60 vars in 1148 bytes} [Thu Jul 14 15:43:45 2022] POST /identity/v3/users => generated 295 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:43:45.417871 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3e4479-997f-450f-a5fa-4add63540587 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:45.428299 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3e4479-997f-450f-a5fa-4add63540587 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:45.433125 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594d813a-05f4-4fd1-864c-d10ae61b3b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:45.433780 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d813a-05f4-4fd1-864c-d10ae61b3b07 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:45.434094 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d813a-05f4-4fd1-864c-d10ae61b3b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:45.434369 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d813a-05f4-4fd1-864c-d10ae61b3b07 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:45.435095 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594d813a-05f4-4fd1-864c-d10ae61b3b07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:45.437248 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594d813a-05f4-4fd1-864c-d10ae61b3b07 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:45.447896 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1325/2612] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:43:45 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:43:45.452762 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3117a0b-74b2-4217-a119-fe348794fe8c admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:45.462578 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3117a0b-74b2-4217-a119-fe348794fe8c admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:45.467083 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfdf128-f07f-44fc-ad47-deb875cad92c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:45.468009 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfdf128-f07f-44fc-ad47-deb875cad92c admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:45.468282 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfdf128-f07f-44fc-ad47-deb875cad92c admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:45.468555 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfdf128-f07f-44fc-ad47-deb875cad92c admin admin] PATH_INFO: `/v3/projects/ec91653011974c54a0915aa88f859cae/users/a800517a6e6a48e19208606a107b9723/roles/3b880cef7dcf4baf87b50f8610c0c56e` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:45.483455 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfdf128-f07f-44fc-ad47-deb875cad92c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec91653011974c54a0915aa88f859cae, user_id=a800517a6e6a48e19208606a107b9723, role_id=3b880cef7dcf4baf87b50f8610c0c56e)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:45.486216 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfdf128-f07f-44fc-ad47-deb875cad92c admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:45.499838 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1288/2613] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:43:45 2022] PUT /identity/v3/projects/ec91653011974c54a0915aa88f859cae/users/a800517a6e6a48e19208606a107b9723/roles/3b880cef7dcf4baf87b50f8610c0c56e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:43:45.504196 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594d813a-05f4-4fd1-864c-d10ae61b3b07 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:45.514345 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594d813a-05f4-4fd1-864c-d10ae61b3b07 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:45.571435 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de5f73c-c281-4ca5-98bf-b8176440fd14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:45.572020 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de5f73c-c281-4ca5-98bf-b8176440fd14 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:45.572299 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de5f73c-c281-4ca5-98bf-b8176440fd14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:45.572571 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de5f73c-c281-4ca5-98bf-b8176440fd14 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:45.573304 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de5f73c-c281-4ca5-98bf-b8176440fd14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:45.574965 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de5f73c-c281-4ca5-98bf-b8176440fd14 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:45.585703 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1326/2614] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:43:45 2022] GET /identity/v3/roles => generated 1427 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:43:45.590486 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfdf128-f07f-44fc-ad47-deb875cad92c admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:45.600846 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfdf128-f07f-44fc-ad47-deb875cad92c admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:45.605980 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05f2929-6405-4986-80fa-497fececc418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:45.606869 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f2929-6405-4986-80fa-497fececc418 admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:45.607150 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f2929-6405-4986-80fa-497fececc418 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:45.607427 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f2929-6405-4986-80fa-497fececc418 admin admin] PATH_INFO: `/v3/projects/ec91653011974c54a0915aa88f859cae/users/a800517a6e6a48e19208606a107b9723/roles/3b880cef7dcf4baf87b50f8610c0c56e` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:45.609457 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05f2929-6405-4986-80fa-497fececc418 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec91653011974c54a0915aa88f859cae, user_id=a800517a6e6a48e19208606a107b9723, role_id=3b880cef7dcf4baf87b50f8610c0c56e)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:45.612183 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05f2929-6405-4986-80fa-497fececc418 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:45.622952 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1289/2615] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:43:45 2022] PUT /identity/v3/projects/ec91653011974c54a0915aa88f859cae/users/a800517a6e6a48e19208606a107b9723/roles/3b880cef7dcf4baf87b50f8610c0c56e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:43:45.635768 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d2094-20e8-4693-8128-c93647c7b12c None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:45.636055 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d2094-20e8-4693-8128-c93647c7b12c None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:45.636335 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d2094-20e8-4693-8128-c93647c7b12c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:45.663215 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-4d1d2094-20e8-4693-8128-c93647c7b12c None None] MFA Rules not processed for user `a800517a6e6a48e19208606a107b9723`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:43:45.664416 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-4d1d2094-20e8-4693-8128-c93647c7b12c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:45.723702 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:43:45.735661 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1327/2616] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:43:45 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:43:45.747892 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05f2929-6405-4986-80fa-497fececc418 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:45.750081 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-b05f2929-6405-4986-80fa-497fececc418 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:45.773032 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:43:45.812667 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05f2929-6405-4986-80fa-497fececc418 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:45.816384 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9199fd-d436-47dd-8fe9-43fe348e391c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea647438ea1c438987f28cbe39c3ff2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:45.817029 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9199fd-d436-47dd-8fe9-43fe348e391c service cinder] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:45.817308 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9199fd-d436-47dd-8fe9-43fe348e391c service cinder] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:45.817580 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9199fd-d436-47dd-8fe9-43fe348e391c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:45.873305 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9199fd-d436-47dd-8fe9-43fe348e391c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:45.875262 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9199fd-d436-47dd-8fe9-43fe348e391c service cinder] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:45.884028 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1290/2617] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:43:45 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:43:48.420120 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1d2094-20e8-4693-8128-c93647c7b12c None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:48.489320 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1d2094-20e8-4693-8128-c93647c7b12c None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:48.492025 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877d24be-1595-4f5f-b21d-9ce66f9d7cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:48.492898 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877d24be-1595-4f5f-b21d-9ce66f9d7cd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:48.493177 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877d24be-1595-4f5f-b21d-9ce66f9d7cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:48.493451 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877d24be-1595-4f5f-b21d-9ce66f9d7cd0 admin admin] PATH_INFO: `/v3/users/22da00db00a44e80841c7f4ce878cb9f` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:48.494657 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877d24be-1595-4f5f-b21d-9ce66f9d7cd0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22da00db00a44e80841c7f4ce878cb9f)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:48.496693 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877d24be-1595-4f5f-b21d-9ce66f9d7cd0 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:48.546251 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-877d24be-1595-4f5f-b21d-9ce66f9d7cd0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22da00db00a44e80841c7f4ce878cb9f'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:48.553595 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-877d24be-1595-4f5f-b21d-9ce66f9d7cd0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22da00db00a44e80841c7f4ce878cb9f'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:48.554354 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-877d24be-1595-4f5f-b21d-9ce66f9d7cd0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22da00db00a44e80841c7f4ce878cb9f'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:48.555185 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-877d24be-1595-4f5f-b21d-9ce66f9d7cd0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22da00db00a44e80841c7f4ce878cb9f'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:48.570655 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-877d24be-1595-4f5f-b21d-9ce66f9d7cd0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22da00db00a44e80841c7f4ce878cb9f'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:48.586453 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1328/2618] 10.222.0.118 () {58 vars in 1228 bytes} [Thu Jul 14 15:43:48 2022] DELETE /identity/v3/users/22da00db00a44e80841c7f4ce878cb9f => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:43:48.591380 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be85c253-5455-49f6-86d8-9e1951ba010e None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:48.591870 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be85c253-5455-49f6-86d8-9e1951ba010e None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:48.591971 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be85c253-5455-49f6-86d8-9e1951ba010e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:48.611672 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-be85c253-5455-49f6-86d8-9e1951ba010e None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:43:48.615327 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-be85c253-5455-49f6-86d8-9e1951ba010e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:48.676034 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1291/2619] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:43:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:43:48.685739 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877d24be-1595-4f5f-b21d-9ce66f9d7cd0 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:48.687718 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-877d24be-1595-4f5f-b21d-9ce66f9d7cd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:48.755695 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877d24be-1595-4f5f-b21d-9ce66f9d7cd0 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:48.759328 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf4388a-715d-4b38-a0f5-d3222dfae39f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b650be8114b64df0ac88441f1c50b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:48.759975 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf4388a-715d-4b38-a0f5-d3222dfae39f service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:48.760254 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf4388a-715d-4b38-a0f5-d3222dfae39f service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:48.760526 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf4388a-715d-4b38-a0f5-d3222dfae39f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:48.770696 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf4388a-715d-4b38-a0f5-d3222dfae39f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:48.772123 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf4388a-715d-4b38-a0f5-d3222dfae39f service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:48.783103 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1329/2620] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:43:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:43:49.063575 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be85c253-5455-49f6-86d8-9e1951ba010e None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:49.065056 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-be85c253-5455-49f6-86d8-9e1951ba010e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:49.077464 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be85c253-5455-49f6-86d8-9e1951ba010e None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:49.082060 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153b1a8a-de04-4007-929d-c1816e9ed8d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:49.083068 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b1a8a-de04-4007-929d-c1816e9ed8d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:49.083391 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b1a8a-de04-4007-929d-c1816e9ed8d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:49.083676 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b1a8a-de04-4007-929d-c1816e9ed8d6 admin admin] PATH_INFO: `/v3/projects/aa27434944de4075a635db2e90ac2a2b` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:49.084945 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153b1a8a-de04-4007-929d-c1816e9ed8d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa27434944de4075a635db2e90ac2a2b)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:49.086921 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153b1a8a-de04-4007-929d-c1816e9ed8d6 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:49.136260 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-153b1a8a-de04-4007-929d-c1816e9ed8d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa27434944de4075a635db2e90ac2a2b', 'request_id': 'req-153b1a8a-de04-4007-929d-c1816e9ed8d6'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:49.142403 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-153b1a8a-de04-4007-929d-c1816e9ed8d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa27434944de4075a635db2e90ac2a2b', 'request_id': 'req-153b1a8a-de04-4007-929d-c1816e9ed8d6'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:49.149429 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-153b1a8a-de04-4007-929d-c1816e9ed8d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa27434944de4075a635db2e90ac2a2b', 'request_id': 'req-153b1a8a-de04-4007-929d-c1816e9ed8d6'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:49.161581 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:43:49.167175 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-153b1a8a-de04-4007-929d-c1816e9ed8d6 admin admin] The token cache is being invalidate because project aa27434944de4075a635db2e90ac2a2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:43:49.167617 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-153b1a8a-de04-4007-929d-c1816e9ed8d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:49.169991 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-153b1a8a-de04-4007-929d-c1816e9ed8d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:49.173369 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1292/2621] 10.222.0.118 () {58 vars in 1237 bytes} [Thu Jul 14 15:43:49 2022] DELETE /identity/v3/projects/aa27434944de4075a635db2e90ac2a2b => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:43:49.177697 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf4388a-715d-4b38-a0f5-d3222dfae39f service neutron] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:49.187049 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf4388a-715d-4b38-a0f5-d3222dfae39f service neutron] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:49.198573 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:43:49.250658 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3a3d83-a6a9-410f-9c87-8e11fc142e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:49.251521 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3a3d83-a6a9-410f-9c87-8e11fc142e20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:49.251804 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3a3d83-a6a9-410f-9c87-8e11fc142e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:49.252075 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3a3d83-a6a9-410f-9c87-8e11fc142e20 admin admin] PATH_INFO: `/v3/users/a800517a6e6a48e19208606a107b9723` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:49.253388 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3a3d83-a6a9-410f-9c87-8e11fc142e20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a800517a6e6a48e19208606a107b9723)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:49.255330 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3a3d83-a6a9-410f-9c87-8e11fc142e20 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:49.303557 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-ae3a3d83-a6a9-410f-9c87-8e11fc142e20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a800517a6e6a48e19208606a107b9723'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:49.311283 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-ae3a3d83-a6a9-410f-9c87-8e11fc142e20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a800517a6e6a48e19208606a107b9723'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:49.312019 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-ae3a3d83-a6a9-410f-9c87-8e11fc142e20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a800517a6e6a48e19208606a107b9723'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:49.312699 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-ae3a3d83-a6a9-410f-9c87-8e11fc142e20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a800517a6e6a48e19208606a107b9723'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:49.324725 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-ae3a3d83-a6a9-410f-9c87-8e11fc142e20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a800517a6e6a48e19208606a107b9723'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:49.337614 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1330/2622] 10.222.0.118 () {58 vars in 1228 bytes} [Thu Jul 14 15:43:49 2022] DELETE /identity/v3/users/a800517a6e6a48e19208606a107b9723 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:43:49.617409 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153b1a8a-de04-4007-929d-c1816e9ed8d6 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:49.619118 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-153b1a8a-de04-4007-929d-c1816e9ed8d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:49.635823 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153b1a8a-de04-4007-929d-c1816e9ed8d6 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:49.705386 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cde0e2-5b86-46df-9047-0a439b36cad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:49.706397 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cde0e2-5b86-46df-9047-0a439b36cad7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:49.706740 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cde0e2-5b86-46df-9047-0a439b36cad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:49.707080 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cde0e2-5b86-46df-9047-0a439b36cad7 admin admin] PATH_INFO: `/v3/projects/ec91653011974c54a0915aa88f859cae` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:49.708455 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cde0e2-5b86-46df-9047-0a439b36cad7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec91653011974c54a0915aa88f859cae)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:49.711198 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cde0e2-5b86-46df-9047-0a439b36cad7 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:49.766727 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-32cde0e2-5b86-46df-9047-0a439b36cad7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec91653011974c54a0915aa88f859cae', 'request_id': 'req-32cde0e2-5b86-46df-9047-0a439b36cad7'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:49.773367 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-32cde0e2-5b86-46df-9047-0a439b36cad7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec91653011974c54a0915aa88f859cae', 'request_id': 'req-32cde0e2-5b86-46df-9047-0a439b36cad7'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:49.779312 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-32cde0e2-5b86-46df-9047-0a439b36cad7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec91653011974c54a0915aa88f859cae', 'request_id': 'req-32cde0e2-5b86-46df-9047-0a439b36cad7'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:49.793571 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-32cde0e2-5b86-46df-9047-0a439b36cad7 admin admin] The token cache is being invalidate because project ec91653011974c54a0915aa88f859cae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:43:49.794154 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-32cde0e2-5b86-46df-9047-0a439b36cad7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:49.794826 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-32cde0e2-5b86-46df-9047-0a439b36cad7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:49.796473 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1293/2623] 10.222.0.118 () {58 vars in 1237 bytes} [Thu Jul 14 15:43:49 2022] DELETE /identity/v3/projects/ec91653011974c54a0915aa88f859cae => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:43:49.801557 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bb09f4-5527-4b92-b881-cf3d4dbc991b None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:49.801997 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bb09f4-5527-4b92-b881-cf3d4dbc991b None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:49.802309 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bb09f4-5527-4b92-b881-cf3d4dbc991b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:49.821372 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-e3bb09f4-5527-4b92-b881-cf3d4dbc991b None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:43:49.822805 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-e3bb09f4-5527-4b92-b881-cf3d4dbc991b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:49.894001 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1331/2624] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:43:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:43:49.959722 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5aaac0-486f-4b39-b861-309a6aca06e5 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:49.960011 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5aaac0-486f-4b39-b861-309a6aca06e5 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:49.960287 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5aaac0-486f-4b39-b861-309a6aca06e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:49.978962 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-2d5aaac0-486f-4b39-b861-309a6aca06e5 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:43:49.980487 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-2d5aaac0-486f-4b39-b861-309a6aca06e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:49.990402 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1294/2625] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:43:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:43:49.993329 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bb09f4-5527-4b92-b881-cf3d4dbc991b None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:50.003795 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bb09f4-5527-4b92-b881-cf3d4dbc991b None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:50.008673 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f07472-e2b3-4d85-895d-d23803c9599a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:50.009340 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f07472-e2b3-4d85-895d-d23803c9599a admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:50.009692 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f07472-e2b3-4d85-895d-d23803c9599a admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:50.009955 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f07472-e2b3-4d85-895d-d23803c9599a admin admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:50.010710 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f07472-e2b3-4d85-895d-d23803c9599a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:43:50.011068 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f07472-e2b3-4d85-895d-d23803c9599a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:50.012681 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f07472-e2b3-4d85-895d-d23803c9599a admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:50.034384 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1332/2626] 10.222.0.118 () {58 vars in 1157 bytes} [Thu Jul 14 15:43:49 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:43:50.035553 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5aaac0-486f-4b39-b861-309a6aca06e5 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:50.044965 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5aaac0-486f-4b39-b861-309a6aca06e5 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:50.049878 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2516e81c-1505-4533-ab8a-ba6a58f5e54c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:50.050627 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2516e81c-1505-4533-ab8a-ba6a58f5e54c admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:50.050909 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2516e81c-1505-4533-ab8a-ba6a58f5e54c admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:50.051182 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2516e81c-1505-4533-ab8a-ba6a58f5e54c admin admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:50.051873 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2516e81c-1505-4533-ab8a-ba6a58f5e54c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:50.053762 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2516e81c-1505-4533-ab8a-ba6a58f5e54c admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:50.084358 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1295/2627] 10.222.0.118 () {60 vars in 1157 bytes} [Thu Jul 14 15:43:50 2022] POST /identity/v3/projects => generated 386 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:43:50.085243 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f07472-e2b3-4d85-895d-d23803c9599a admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:50.096105 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f07472-e2b3-4d85-895d-d23803c9599a admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:50.120056 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:43:50.172417 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a67885-4be6-46d8-8945-6ec5dd8bd36b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:50.173099 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a67885-4be6-46d8-8945-6ec5dd8bd36b admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:50.173381 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a67885-4be6-46d8-8945-6ec5dd8bd36b admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:50.173650 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a67885-4be6-46d8-8945-6ec5dd8bd36b admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:50.174495 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a67885-4be6-46d8-8945-6ec5dd8bd36b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:50.178121 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a67885-4be6-46d8-8945-6ec5dd8bd36b admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:50.206349 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1333/2628] 10.222.0.118 () {60 vars in 1148 bytes} [Thu Jul 14 15:43:50 2022] POST /identity/v3/users => generated 294 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:43:50.215527 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2516e81c-1505-4533-ab8a-ba6a58f5e54c admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:50.226760 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2516e81c-1505-4533-ab8a-ba6a58f5e54c admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:50.244787 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9fa676-a947-469e-beac-ccbd96fa3af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:50.245938 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9fa676-a947-469e-beac-ccbd96fa3af4 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:50.245938 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9fa676-a947-469e-beac-ccbd96fa3af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:50.246229 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9fa676-a947-469e-beac-ccbd96fa3af4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:50.247069 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9fa676-a947-469e-beac-ccbd96fa3af4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:50.249233 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9fa676-a947-469e-beac-ccbd96fa3af4 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:50.261390 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1296/2629] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:43:50 2022] GET /identity/v3/roles => generated 1427 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:43:50.266180 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a67885-4be6-46d8-8945-6ec5dd8bd36b admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:50.276776 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a67885-4be6-46d8-8945-6ec5dd8bd36b admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:50.281471 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953b8212-df5f-43ee-afec-8d4d9b156e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:50.282265 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b8212-df5f-43ee-afec-8d4d9b156e30 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:50.283038 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b8212-df5f-43ee-afec-8d4d9b156e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:50.283038 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b8212-df5f-43ee-afec-8d4d9b156e30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:50.283555 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953b8212-df5f-43ee-afec-8d4d9b156e30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:50.285162 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953b8212-df5f-43ee-afec-8d4d9b156e30 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:50.297701 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1334/2630] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:43:50 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:43:50.301756 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9fa676-a947-469e-beac-ccbd96fa3af4 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:50.313401 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9fa676-a947-469e-beac-ccbd96fa3af4 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:50.320410 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8af968-095c-479b-a78e-acf1f69997b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:50.321307 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8af968-095c-479b-a78e-acf1f69997b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:50.321588 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8af968-095c-479b-a78e-acf1f69997b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:50.321874 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8af968-095c-479b-a78e-acf1f69997b8 admin admin] PATH_INFO: `/v3/projects/1926e7b160384847be252e3f911c20cc/users/3fbe9a87d709416da1010abb1a33d4e6/roles/4abcf5e5e7cd4b53ae1828fec6550d53` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:50.338841 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8af968-095c-479b-a78e-acf1f69997b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1926e7b160384847be252e3f911c20cc, user_id=3fbe9a87d709416da1010abb1a33d4e6, role_id=4abcf5e5e7cd4b53ae1828fec6550d53)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:50.342232 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8af968-095c-479b-a78e-acf1f69997b8 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:50.359860 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1297/2631] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:43:50 2022] PUT /identity/v3/projects/1926e7b160384847be252e3f911c20cc/users/3fbe9a87d709416da1010abb1a33d4e6/roles/4abcf5e5e7cd4b53ae1828fec6550d53 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:43:50.370895 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4599c8-df2e-45ac-84a4-d6bb50fff5c4 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:50.371183 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4599c8-df2e-45ac-84a4-d6bb50fff5c4 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:50.371454 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4599c8-df2e-45ac-84a4-d6bb50fff5c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:50.403768 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-ba4599c8-df2e-45ac-84a4-d6bb50fff5c4 None None] MFA Rules not processed for user `3fbe9a87d709416da1010abb1a33d4e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:43:50.405136 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-ba4599c8-df2e-45ac-84a4-d6bb50fff5c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:50.487201 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1335/2632] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:43:50 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:43:50.492132 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8af968-095c-479b-a78e-acf1f69997b8 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:50.531878 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:43:50.609760 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8af968-095c-479b-a78e-acf1f69997b8 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:50.615555 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32afcc4-7e67-427a-9d06-150d94132455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:50.617505 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32afcc4-7e67-427a-9d06-150d94132455 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:50.618090 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32afcc4-7e67-427a-9d06-150d94132455 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:50.618090 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32afcc4-7e67-427a-9d06-150d94132455 admin admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:50.618845 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32afcc4-7e67-427a-9d06-150d94132455 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:50.620813 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32afcc4-7e67-427a-9d06-150d94132455 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:50.653609 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1298/2633] 10.222.0.118 () {60 vars in 1157 bytes} [Thu Jul 14 15:43:50 2022] POST /identity/v3/projects => generated 384 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:43:50.658142 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4599c8-df2e-45ac-84a4-d6bb50fff5c4 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:50.669683 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4599c8-df2e-45ac-84a4-d6bb50fff5c4 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:50.749324 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34c6b21-eb86-407c-a507-6b8879c3943b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:50.750134 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c6b21-eb86-407c-a507-6b8879c3943b admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:50.750469 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c6b21-eb86-407c-a507-6b8879c3943b admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:50.750807 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c6b21-eb86-407c-a507-6b8879c3943b admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:50.751586 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34c6b21-eb86-407c-a507-6b8879c3943b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:50.753580 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34c6b21-eb86-407c-a507-6b8879c3943b admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:50.776508 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1336/2634] 10.222.0.118 () {60 vars in 1148 bytes} [Thu Jul 14 15:43:50 2022] POST /identity/v3/users => generated 293 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:43:50.781212 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32afcc4-7e67-427a-9d06-150d94132455 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:50.792633 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32afcc4-7e67-427a-9d06-150d94132455 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:50.798933 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6004d8bb-9059-4869-bf1f-e7a20d05e586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:50.799616 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6004d8bb-9059-4869-bf1f-e7a20d05e586 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:50.799896 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6004d8bb-9059-4869-bf1f-e7a20d05e586 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:50.800175 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6004d8bb-9059-4869-bf1f-e7a20d05e586 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:50.800905 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6004d8bb-9059-4869-bf1f-e7a20d05e586 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:50.802593 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6004d8bb-9059-4869-bf1f-e7a20d05e586 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:50.815800 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1299/2635] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:43:50 2022] GET /identity/v3/roles => generated 1427 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:43:50.821161 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34c6b21-eb86-407c-a507-6b8879c3943b admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:50.831659 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34c6b21-eb86-407c-a507-6b8879c3943b admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:50.837238 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336fddf9-31af-4bd4-883d-b9868fd89793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:50.837911 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336fddf9-31af-4bd4-883d-b9868fd89793 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:50.838358 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336fddf9-31af-4bd4-883d-b9868fd89793 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:50.838635 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336fddf9-31af-4bd4-883d-b9868fd89793 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:50.839408 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336fddf9-31af-4bd4-883d-b9868fd89793 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:50.841515 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336fddf9-31af-4bd4-883d-b9868fd89793 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:50.853603 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1337/2636] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:43:50 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:43:50.858613 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6004d8bb-9059-4869-bf1f-e7a20d05e586 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:50.869170 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6004d8bb-9059-4869-bf1f-e7a20d05e586 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:50.875455 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986fd9f4-e315-4339-9750-d04a60f461a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:50.876532 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986fd9f4-e315-4339-9750-d04a60f461a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:50.877034 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986fd9f4-e315-4339-9750-d04a60f461a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:50.877529 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986fd9f4-e315-4339-9750-d04a60f461a5 admin admin] PATH_INFO: `/v3/projects/8762c6779d2f43579b270d15f2dbeefc/users/a19cfa154d94418ebc4646179bd16aed/roles/4abcf5e5e7cd4b53ae1828fec6550d53` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:50.892974 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986fd9f4-e315-4339-9750-d04a60f461a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8762c6779d2f43579b270d15f2dbeefc, user_id=a19cfa154d94418ebc4646179bd16aed, role_id=4abcf5e5e7cd4b53ae1828fec6550d53)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:50.895756 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986fd9f4-e315-4339-9750-d04a60f461a5 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:50.910492 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1300/2637] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:43:50 2022] PUT /identity/v3/projects/8762c6779d2f43579b270d15f2dbeefc/users/a19cfa154d94418ebc4646179bd16aed/roles/4abcf5e5e7cd4b53ae1828fec6550d53 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:43:50.921951 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e83b9bf-7bed-403d-ba4e-baf68327c1b3 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:50.922532 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e83b9bf-7bed-403d-ba4e-baf68327c1b3 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:50.923138 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e83b9bf-7bed-403d-ba4e-baf68327c1b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:50.943667 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:43:50.955083 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-6e83b9bf-7bed-403d-ba4e-baf68327c1b3 None None] MFA Rules not processed for user `a19cfa154d94418ebc4646179bd16aed`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:43:50.957150 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-6e83b9bf-7bed-403d-ba4e-baf68327c1b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:51.039855 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1338/2638] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:43:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:43:51.043999 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986fd9f4-e315-4339-9750-d04a60f461a5 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:51.116813 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986fd9f4-e315-4339-9750-d04a60f461a5 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:51.121978 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283a3c66-6b39-4996-920c-6244a4e6aab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:51.122668 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283a3c66-6b39-4996-920c-6244a4e6aab0 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:51.122946 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283a3c66-6b39-4996-920c-6244a4e6aab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:51.123247 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283a3c66-6b39-4996-920c-6244a4e6aab0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:51.123987 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283a3c66-6b39-4996-920c-6244a4e6aab0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:51.125921 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283a3c66-6b39-4996-920c-6244a4e6aab0 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:51.160755 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1301/2639] 10.222.0.118 () {60 vars in 1157 bytes} [Thu Jul 14 15:43:51 2022] POST /identity/v3/projects => generated 386 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:43:51.162012 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e83b9bf-7bed-403d-ba4e-baf68327c1b3 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:51.174218 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e83b9bf-7bed-403d-ba4e-baf68327c1b3 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:51.249698 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2d8e27-d9e7-4136-82de-18fab5e7764f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:51.250255 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2d8e27-d9e7-4136-82de-18fab5e7764f admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:51.250540 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2d8e27-d9e7-4136-82de-18fab5e7764f admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:51.250819 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2d8e27-d9e7-4136-82de-18fab5e7764f admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:51.251527 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2d8e27-d9e7-4136-82de-18fab5e7764f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:51.253519 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2d8e27-d9e7-4136-82de-18fab5e7764f admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:51.283781 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1339/2640] 10.222.0.118 () {60 vars in 1148 bytes} [Thu Jul 14 15:43:51 2022] POST /identity/v3/users => generated 300 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:43:51.285250 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283a3c66-6b39-4996-920c-6244a4e6aab0 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:51.301901 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283a3c66-6b39-4996-920c-6244a4e6aab0 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:51.308791 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba308e22-dafd-43a7-9344-f39191e09edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:51.309490 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba308e22-dafd-43a7-9344-f39191e09edd admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:51.309773 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba308e22-dafd-43a7-9344-f39191e09edd admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:51.310075 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba308e22-dafd-43a7-9344-f39191e09edd admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:51.310815 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba308e22-dafd-43a7-9344-f39191e09edd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:51.312991 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba308e22-dafd-43a7-9344-f39191e09edd admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:51.332977 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1302/2641] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:43:51 2022] GET /identity/v3/roles => generated 1427 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:43:51.334155 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2d8e27-d9e7-4136-82de-18fab5e7764f admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:51.346773 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2d8e27-d9e7-4136-82de-18fab5e7764f admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:51.353028 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e9c9cb-2bac-46a0-80e1-704245c01a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:51.354154 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e9c9cb-2bac-46a0-80e1-704245c01a0d admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:51.354490 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e9c9cb-2bac-46a0-80e1-704245c01a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:51.354776 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e9c9cb-2bac-46a0-80e1-704245c01a0d admin admin] PATH_INFO: `/v3/projects/5f30bddd702f45398ccd5e752b02bd91/users/b800b602c5e44cc6997969ad479289d8/roles/3b880cef7dcf4baf87b50f8610c0c56e` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:51.373324 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e9c9cb-2bac-46a0-80e1-704245c01a0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f30bddd702f45398ccd5e752b02bd91, user_id=b800b602c5e44cc6997969ad479289d8, role_id=3b880cef7dcf4baf87b50f8610c0c56e)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:51.376854 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e9c9cb-2bac-46a0-80e1-704245c01a0d admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:51.395833 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1340/2642] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:43:51 2022] PUT /identity/v3/projects/5f30bddd702f45398ccd5e752b02bd91/users/b800b602c5e44cc6997969ad479289d8/roles/3b880cef7dcf4baf87b50f8610c0c56e => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:43:51.403383 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba308e22-dafd-43a7-9344-f39191e09edd admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:51.415516 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba308e22-dafd-43a7-9344-f39191e09edd admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:51.482657 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:43:51.503107 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4fe5f6-bf40-4945-8711-7c568c1d1818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:51.503798 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4fe5f6-bf40-4945-8711-7c568c1d1818 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:51.504078 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4fe5f6-bf40-4945-8711-7c568c1d1818 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:51.504379 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4fe5f6-bf40-4945-8711-7c568c1d1818 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:51.505732 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4fe5f6-bf40-4945-8711-7c568c1d1818 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:51.507857 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4fe5f6-bf40-4945-8711-7c568c1d1818 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:51.526194 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1303/2643] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:43:51 2022] GET /identity/v3/roles => generated 1427 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:43:51.526986 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e9c9cb-2bac-46a0-80e1-704245c01a0d admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:51.552413 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e9c9cb-2bac-46a0-80e1-704245c01a0d admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:51.558889 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101aa0e0-6a50-4951-bd03-72fd87f9bd83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:51.560113 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101aa0e0-6a50-4951-bd03-72fd87f9bd83 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:51.560499 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101aa0e0-6a50-4951-bd03-72fd87f9bd83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:51.560882 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101aa0e0-6a50-4951-bd03-72fd87f9bd83 admin admin] PATH_INFO: `/v3/projects/5f30bddd702f45398ccd5e752b02bd91/users/b800b602c5e44cc6997969ad479289d8/roles/3b880cef7dcf4baf87b50f8610c0c56e` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:51.563658 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101aa0e0-6a50-4951-bd03-72fd87f9bd83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f30bddd702f45398ccd5e752b02bd91, user_id=b800b602c5e44cc6997969ad479289d8, role_id=3b880cef7dcf4baf87b50f8610c0c56e)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:51.566617 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101aa0e0-6a50-4951-bd03-72fd87f9bd83 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:51.578883 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1341/2644] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:43:51 2022] PUT /identity/v3/projects/5f30bddd702f45398ccd5e752b02bd91/users/b800b602c5e44cc6997969ad479289d8/roles/3b880cef7dcf4baf87b50f8610c0c56e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:43:51.592108 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b654199-f987-4a08-8767-b9ba780f73c5 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:51.593070 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b654199-f987-4a08-8767-b9ba780f73c5 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:51.593420 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b654199-f987-4a08-8767-b9ba780f73c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:51.626975 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-1b654199-f987-4a08-8767-b9ba780f73c5 None None] MFA Rules not processed for user `b800b602c5e44cc6997969ad479289d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:43:51.628292 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-1b654199-f987-4a08-8767-b9ba780f73c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:51.724181 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1304/2645] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:43:51 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:43:51.739095 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101aa0e0-6a50-4951-bd03-72fd87f9bd83 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:51.742487 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-101aa0e0-6a50-4951-bd03-72fd87f9bd83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:51.815591 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101aa0e0-6a50-4951-bd03-72fd87f9bd83 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:51.823681 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028ea168-0959-4184-a575-2eac97529e8e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea647438ea1c438987f28cbe39c3ff2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:51.824292 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028ea168-0959-4184-a575-2eac97529e8e service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:51.824401 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028ea168-0959-4184-a575-2eac97529e8e service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:51.824928 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028ea168-0959-4184-a575-2eac97529e8e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:51.831063 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:43:51.896657 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028ea168-0959-4184-a575-2eac97529e8e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:51.898687 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028ea168-0959-4184-a575-2eac97529e8e service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:51.914254 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1342/2646] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:43:51 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:43:53.458736 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b654199-f987-4a08-8767-b9ba780f73c5 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:53.468313 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b654199-f987-4a08-8767-b9ba780f73c5 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:53.471865 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2405a9b4-088e-44ce-9785-78bb4c2a5819 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea647438ea1c438987f28cbe39c3ff2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:53.472515 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2405a9b4-088e-44ce-9785-78bb4c2a5819 service cinder] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:53.472796 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2405a9b4-088e-44ce-9785-78bb4c2a5819 service cinder] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:53.473166 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2405a9b4-088e-44ce-9785-78bb4c2a5819 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:53.536294 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2405a9b4-088e-44ce-9785-78bb4c2a5819 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:53.537911 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2405a9b4-088e-44ce-9785-78bb4c2a5819 service cinder] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:53.549634 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1305/2647] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:43:53 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:43:54.077494 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028ea168-0959-4184-a575-2eac97529e8e service cinder] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:54.079111 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-028ea168-0959-4184-a575-2eac97529e8e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:54.090473 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028ea168-0959-4184-a575-2eac97529e8e service cinder] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:54.094747 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8dd893-c280-4f50-bc08-8d88794f997c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea647438ea1c438987f28cbe39c3ff2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:54.095389 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8dd893-c280-4f50-bc08-8d88794f997c service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:54.095674 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8dd893-c280-4f50-bc08-8d88794f997c service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:54.095951 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8dd893-c280-4f50-bc08-8d88794f997c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:54.105572 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8dd893-c280-4f50-bc08-8d88794f997c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:54.107035 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8dd893-c280-4f50-bc08-8d88794f997c service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:54.117658 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1343/2648] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:43:54 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:43:54.657543 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2405a9b4-088e-44ce-9785-78bb4c2a5819 service cinder] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:54.659007 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-2405a9b4-088e-44ce-9785-78bb4c2a5819 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:54.714891 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2405a9b4-088e-44ce-9785-78bb4c2a5819 service cinder] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:54.718717 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259af943-cfb8-40e5-b053-0bc9996fa387 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b650be8114b64df0ac88441f1c50b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:54.719375 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259af943-cfb8-40e5-b053-0bc9996fa387 service neutron] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:54.719658 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259af943-cfb8-40e5-b053-0bc9996fa387 service neutron] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:54.719932 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259af943-cfb8-40e5-b053-0bc9996fa387 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:54.721877 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-259af943-cfb8-40e5-b053-0bc9996fa387 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:54.743329 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:43:54.785567 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259af943-cfb8-40e5-b053-0bc9996fa387 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:54.787046 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259af943-cfb8-40e5-b053-0bc9996fa387 service neutron] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:54.797225 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1306/2649] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:43:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:43:58.096549 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8dd893-c280-4f50-bc08-8d88794f997c service cinder] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:58.098513 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-2b8dd893-c280-4f50-bc08-8d88794f997c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:58.122634 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8dd893-c280-4f50-bc08-8d88794f997c service cinder] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:58.134286 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3878215-2d87-42d4-a393-4607e216bd15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:58.135780 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3878215-2d87-42d4-a393-4607e216bd15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:58.136344 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3878215-2d87-42d4-a393-4607e216bd15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:58.136791 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3878215-2d87-42d4-a393-4607e216bd15 admin admin] PATH_INFO: `/v3/users/bab083ba82d64af391d09c531b8647e0` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:58.138400 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3878215-2d87-42d4-a393-4607e216bd15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bab083ba82d64af391d09c531b8647e0)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:58.141949 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3878215-2d87-42d4-a393-4607e216bd15 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:58.153802 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259af943-cfb8-40e5-b053-0bc9996fa387 service neutron] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:58.165429 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259af943-cfb8-40e5-b053-0bc9996fa387 service neutron] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:58.170460 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3e9f2f-e51b-41a4-a39e-f4818ec8ce84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:58.171620 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e9f2f-e51b-41a4-a39e-f4818ec8ce84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:58.172131 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e9f2f-e51b-41a4-a39e-f4818ec8ce84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:58.172743 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e9f2f-e51b-41a4-a39e-f4818ec8ce84 admin admin] PATH_INFO: `/v3/users/3fbe9a87d709416da1010abb1a33d4e6` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:58.174165 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3e9f2f-e51b-41a4-a39e-f4818ec8ce84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fbe9a87d709416da1010abb1a33d4e6)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:58.180857 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3e9f2f-e51b-41a4-a39e-f4818ec8ce84 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:58.222752 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-e3878215-2d87-42d4-a393-4607e216bd15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bab083ba82d64af391d09c531b8647e0'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:58.231195 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-e3878215-2d87-42d4-a393-4607e216bd15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bab083ba82d64af391d09c531b8647e0'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:58.232230 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-e3878215-2d87-42d4-a393-4607e216bd15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bab083ba82d64af391d09c531b8647e0'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:58.234173 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-e3878215-2d87-42d4-a393-4607e216bd15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bab083ba82d64af391d09c531b8647e0'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:58.240989 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-2f3e9f2f-e51b-41a4-a39e-f4818ec8ce84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fbe9a87d709416da1010abb1a33d4e6'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:58.249102 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-2f3e9f2f-e51b-41a4-a39e-f4818ec8ce84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fbe9a87d709416da1010abb1a33d4e6'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:58.249802 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-2f3e9f2f-e51b-41a4-a39e-f4818ec8ce84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fbe9a87d709416da1010abb1a33d4e6'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:58.250445 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-2f3e9f2f-e51b-41a4-a39e-f4818ec8ce84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fbe9a87d709416da1010abb1a33d4e6'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:58.253523 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-e3878215-2d87-42d4-a393-4607e216bd15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bab083ba82d64af391d09c531b8647e0'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:58.265615 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-2f3e9f2f-e51b-41a4-a39e-f4818ec8ce84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fbe9a87d709416da1010abb1a33d4e6'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:58.274552 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1344/2650] 10.222.0.118 () {58 vars in 1228 bytes} [Thu Jul 14 15:43:58 2022] DELETE /identity/v3/users/bab083ba82d64af391d09c531b8647e0 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:43:58.282956 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1307/2651] 10.222.0.118 () {58 vars in 1228 bytes} [Thu Jul 14 15:43:58 2022] DELETE /identity/v3/users/3fbe9a87d709416da1010abb1a33d4e6 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:43:58.287645 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930c40aa-3e8e-4495-9bc8-5f3d6d211c36 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:58.288079 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930c40aa-3e8e-4495-9bc8-5f3d6d211c36 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:58.288270 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930c40aa-3e8e-4495-9bc8-5f3d6d211c36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:58.306199 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-930c40aa-3e8e-4495-9bc8-5f3d6d211c36 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:43:58.308082 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-930c40aa-3e8e-4495-9bc8-5f3d6d211c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:58.377339 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1345/2652] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:43:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:43:58.387324 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3e9f2f-e51b-41a4-a39e-f4818ec8ce84 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:58.389562 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-2f3e9f2f-e51b-41a4-a39e-f4818ec8ce84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:58.457441 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3e9f2f-e51b-41a4-a39e-f4818ec8ce84 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:58.461179 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a05255-8bee-46f1-833f-a4440fdd97b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b650be8114b64df0ac88441f1c50b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:58.461874 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a05255-8bee-46f1-833f-a4440fdd97b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:58.462192 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a05255-8bee-46f1-833f-a4440fdd97b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:58.462569 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a05255-8bee-46f1-833f-a4440fdd97b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:58.470485 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930c40aa-3e8e-4495-9bc8-5f3d6d211c36 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:58.472400 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-930c40aa-3e8e-4495-9bc8-5f3d6d211c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:58.481337 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:43:58.484476 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a05255-8bee-46f1-833f-a4440fdd97b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:58.486110 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a05255-8bee-46f1-833f-a4440fdd97b8 service neutron] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:58.499238 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1308/2653] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:43:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:43:58.500206 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a05255-8bee-46f1-833f-a4440fdd97b8 service neutron] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:58.501702 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-03a05255-8bee-46f1-833f-a4440fdd97b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:58.501828 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930c40aa-3e8e-4495-9bc8-5f3d6d211c36 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:58.508334 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e54bde3-f4e1-4e13-8dbb-d1e246f8acad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:58.510417 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e54bde3-f4e1-4e13-8dbb-d1e246f8acad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:58.510417 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e54bde3-f4e1-4e13-8dbb-d1e246f8acad admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:58.510615 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e54bde3-f4e1-4e13-8dbb-d1e246f8acad admin admin] PATH_INFO: `/v3/projects/3e75f82879d1401c95a3fbae144a118b` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:58.513226 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e54bde3-f4e1-4e13-8dbb-d1e246f8acad admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e75f82879d1401c95a3fbae144a118b)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:58.516300 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e54bde3-f4e1-4e13-8dbb-d1e246f8acad admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:58.517063 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a05255-8bee-46f1-833f-a4440fdd97b8 service neutron] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:58.522069 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c611c037-8176-4341-aa56-94220039a5de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:58.522942 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c611c037-8176-4341-aa56-94220039a5de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:58.523219 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c611c037-8176-4341-aa56-94220039a5de admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:58.523487 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c611c037-8176-4341-aa56-94220039a5de admin admin] PATH_INFO: `/v3/users/c721200a5f374f0780b59f08a675e183` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:58.524696 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c611c037-8176-4341-aa56-94220039a5de admin admin] RBAC: Authorizing `identity:delete_user(user_id=c721200a5f374f0780b59f08a675e183)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:58.526664 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c611c037-8176-4341-aa56-94220039a5de admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:58.566259 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:43:58.572296 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-8e54bde3-f4e1-4e13-8dbb-d1e246f8acad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e75f82879d1401c95a3fbae144a118b', 'request_id': 'req-8e54bde3-f4e1-4e13-8dbb-d1e246f8acad'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:58.579325 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-8e54bde3-f4e1-4e13-8dbb-d1e246f8acad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e75f82879d1401c95a3fbae144a118b', 'request_id': 'req-8e54bde3-f4e1-4e13-8dbb-d1e246f8acad'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:58.587527 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-8e54bde3-f4e1-4e13-8dbb-d1e246f8acad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e75f82879d1401c95a3fbae144a118b', 'request_id': 'req-8e54bde3-f4e1-4e13-8dbb-d1e246f8acad'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:58.590469 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-c611c037-8176-4341-aa56-94220039a5de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c721200a5f374f0780b59f08a675e183'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:58.598678 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-c611c037-8176-4341-aa56-94220039a5de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c721200a5f374f0780b59f08a675e183'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:58.599845 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-c611c037-8176-4341-aa56-94220039a5de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c721200a5f374f0780b59f08a675e183'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:58.600445 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-c611c037-8176-4341-aa56-94220039a5de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c721200a5f374f0780b59f08a675e183'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:58.605395 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-8e54bde3-f4e1-4e13-8dbb-d1e246f8acad admin admin] The token cache is being invalidate because project 3e75f82879d1401c95a3fbae144a118b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:43:58.605788 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-8e54bde3-f4e1-4e13-8dbb-d1e246f8acad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:58.606394 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-8e54bde3-f4e1-4e13-8dbb-d1e246f8acad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:58.610128 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1346/2654] 10.222.0.118 () {58 vars in 1237 bytes} [Thu Jul 14 15:43:58 2022] DELETE /identity/v3/projects/3e75f82879d1401c95a3fbae144a118b => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:43:58.614572 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0936ace1-bcc2-442c-81e4-842fed662acb None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:58.615114 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0936ace1-bcc2-442c-81e4-842fed662acb None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:58.615390 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0936ace1-bcc2-442c-81e4-842fed662acb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:58.616260 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-c611c037-8176-4341-aa56-94220039a5de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c721200a5f374f0780b59f08a675e183'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:58.632190 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1309/2655] 10.222.0.118 () {58 vars in 1228 bytes} [Thu Jul 14 15:43:58 2022] DELETE /identity/v3/users/c721200a5f374f0780b59f08a675e183 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:43:58.636590 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a179b150-bdd7-4d5e-97d0-280aefcbd06c None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:58.636875 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a179b150-bdd7-4d5e-97d0-280aefcbd06c None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:58.637145 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a179b150-bdd7-4d5e-97d0-280aefcbd06c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:58.640215 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-0936ace1-bcc2-442c-81e4-842fed662acb None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:43:58.641085 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-0936ace1-bcc2-442c-81e4-842fed662acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:58.655234 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-a179b150-bdd7-4d5e-97d0-280aefcbd06c None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:43:58.656445 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-a179b150-bdd7-4d5e-97d0-280aefcbd06c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:58.731608 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1347/2656] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:43:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:43:58.740076 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d749b1e8-cf68-4d07-a7eb-58ac593b02ed None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:58.740358 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d749b1e8-cf68-4d07-a7eb-58ac593b02ed None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:58.740628 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d749b1e8-cf68-4d07-a7eb-58ac593b02ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:58.747623 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1310/2657] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:43:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:43:58.757748 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a179b150-bdd7-4d5e-97d0-280aefcbd06c None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:58.759627 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-a179b150-bdd7-4d5e-97d0-280aefcbd06c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:58.764966 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-d749b1e8-cf68-4d07-a7eb-58ac593b02ed None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:43:58.766867 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-d749b1e8-cf68-4d07-a7eb-58ac593b02ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:58.778007 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1348/2658] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:43:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:43:58.780562 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d749b1e8-cf68-4d07-a7eb-58ac593b02ed None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:58.790894 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d749b1e8-cf68-4d07-a7eb-58ac593b02ed None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:58.798375 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df040feb-bb8b-418e-aa11-7ee93feff895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:58.799928 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df040feb-bb8b-418e-aa11-7ee93feff895 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:58.800354 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df040feb-bb8b-418e-aa11-7ee93feff895 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:58.800610 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df040feb-bb8b-418e-aa11-7ee93feff895 admin admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:58.801872 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df040feb-bb8b-418e-aa11-7ee93feff895 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:43:58.801872 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df040feb-bb8b-418e-aa11-7ee93feff895 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:58.803423 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df040feb-bb8b-418e-aa11-7ee93feff895 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:58.818488 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1349/2659] 10.222.0.118 () {58 vars in 1157 bytes} [Thu Jul 14 15:43:58 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:43:58.819161 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df040feb-bb8b-418e-aa11-7ee93feff895 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:58.822897 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-df040feb-bb8b-418e-aa11-7ee93feff895 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:58.827850 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a179b150-bdd7-4d5e-97d0-280aefcbd06c None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:58.832216 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fabb36-d488-448c-b11e-426c82ee0c5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b650be8114b64df0ac88441f1c50b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:58.832972 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fabb36-d488-448c-b11e-426c82ee0c5b service neutron] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:58.833396 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fabb36-d488-448c-b11e-426c82ee0c5b service neutron] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:58.833732 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fabb36-d488-448c-b11e-426c82ee0c5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:58.836664 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df040feb-bb8b-418e-aa11-7ee93feff895 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:58.842270 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3620227a-0af9-45ef-b3aa-fceb16af5521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:58.843297 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3620227a-0af9-45ef-b3aa-fceb16af5521 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:58.843673 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3620227a-0af9-45ef-b3aa-fceb16af5521 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:58.844052 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3620227a-0af9-45ef-b3aa-fceb16af5521 admin admin] PATH_INFO: `/v3/projects/1926e7b160384847be252e3f911c20cc` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:58.844806 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fabb36-d488-448c-b11e-426c82ee0c5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:58.845496 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3620227a-0af9-45ef-b3aa-fceb16af5521 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1926e7b160384847be252e3f911c20cc)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:58.846327 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fabb36-d488-448c-b11e-426c82ee0c5b service neutron] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:58.848596 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3620227a-0af9-45ef-b3aa-fceb16af5521 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:58.856721 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1311/2660] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:43:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:43:58.858080 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fabb36-d488-448c-b11e-426c82ee0c5b service neutron] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:58.867426 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fabb36-d488-448c-b11e-426c82ee0c5b service neutron] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:58.874529 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe85cba-3ff6-47b5-a067-7c34c799b754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:58.876205 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe85cba-3ff6-47b5-a067-7c34c799b754 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:58.876640 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe85cba-3ff6-47b5-a067-7c34c799b754 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:58.876995 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe85cba-3ff6-47b5-a067-7c34c799b754 admin admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:58.877772 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe85cba-3ff6-47b5-a067-7c34c799b754 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:58.880044 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe85cba-3ff6-47b5-a067-7c34c799b754 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:58.901506 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-3620227a-0af9-45ef-b3aa-fceb16af5521 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1926e7b160384847be252e3f911c20cc', 'request_id': 'req-3620227a-0af9-45ef-b3aa-fceb16af5521'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:58.908866 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-3620227a-0af9-45ef-b3aa-fceb16af5521 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1926e7b160384847be252e3f911c20cc', 'request_id': 'req-3620227a-0af9-45ef-b3aa-fceb16af5521'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:58.910513 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1312/2661] 10.222.0.118 () {60 vars in 1157 bytes} [Thu Jul 14 15:43:58 2022] POST /identity/v3/projects => generated 384 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:43:58.914679 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe85cba-3ff6-47b5-a067-7c34c799b754 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:58.917072 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-3620227a-0af9-45ef-b3aa-fceb16af5521 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1926e7b160384847be252e3f911c20cc', 'request_id': 'req-3620227a-0af9-45ef-b3aa-fceb16af5521'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:58.919071 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:43:58.933447 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-3620227a-0af9-45ef-b3aa-fceb16af5521 admin admin] The token cache is being invalidate because project 1926e7b160384847be252e3f911c20cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:43:58.934031 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-3620227a-0af9-45ef-b3aa-fceb16af5521 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:58.935074 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-3620227a-0af9-45ef-b3aa-fceb16af5521 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:58.936727 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1350/2662] 10.222.0.118 () {58 vars in 1237 bytes} [Thu Jul 14 15:43:58 2022] DELETE /identity/v3/projects/1926e7b160384847be252e3f911c20cc => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:43:58.940467 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3620227a-0af9-45ef-b3aa-fceb16af5521 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:58.941911 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-3620227a-0af9-45ef-b3aa-fceb16af5521 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:58.958779 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:43:59.004840 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe85cba-3ff6-47b5-a067-7c34c799b754 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:59.010828 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c777da-814a-4472-997f-f2712252ce4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:59.011774 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c777da-814a-4472-997f-f2712252ce4a admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:59.012433 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c777da-814a-4472-997f-f2712252ce4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:59.012588 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c777da-814a-4472-997f-f2712252ce4a admin admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:59.013298 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c777da-814a-4472-997f-f2712252ce4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:59.015484 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c777da-814a-4472-997f-f2712252ce4a admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:59.021557 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3620227a-0af9-45ef-b3aa-fceb16af5521 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:59.027379 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a80ecc-ef4e-45dd-b28a-613e9f41d28c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:59.028280 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a80ecc-ef4e-45dd-b28a-613e9f41d28c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:59.028613 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a80ecc-ef4e-45dd-b28a-613e9f41d28c admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:59.028949 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a80ecc-ef4e-45dd-b28a-613e9f41d28c admin admin] PATH_INFO: `/v3/users/a19cfa154d94418ebc4646179bd16aed` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:59.030701 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a80ecc-ef4e-45dd-b28a-613e9f41d28c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a19cfa154d94418ebc4646179bd16aed)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:59.032639 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a80ecc-ef4e-45dd-b28a-613e9f41d28c admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:59.057325 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1313/2663] 10.222.0.118 () {60 vars in 1148 bytes} [Thu Jul 14 15:43:58 2022] POST /identity/v3/users => generated 293 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:43:59.058595 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c777da-814a-4472-997f-f2712252ce4a admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:59.060707 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-63c777da-814a-4472-997f-f2712252ce4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:59.074642 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c777da-814a-4472-997f-f2712252ce4a admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:59.080411 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94539101-512d-4830-930e-d5d242bcc85c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:59.081005 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94539101-512d-4830-930e-d5d242bcc85c admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:59.081288 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94539101-512d-4830-930e-d5d242bcc85c admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:59.081561 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94539101-512d-4830-930e-d5d242bcc85c admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:59.082323 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94539101-512d-4830-930e-d5d242bcc85c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:59.084053 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94539101-512d-4830-930e-d5d242bcc85c admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:59.087038 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-82a80ecc-ef4e-45dd-b28a-613e9f41d28c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a19cfa154d94418ebc4646179bd16aed'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:59.095644 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-82a80ecc-ef4e-45dd-b28a-613e9f41d28c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a19cfa154d94418ebc4646179bd16aed'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:59.096482 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-82a80ecc-ef4e-45dd-b28a-613e9f41d28c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a19cfa154d94418ebc4646179bd16aed'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:59.097999 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-82a80ecc-ef4e-45dd-b28a-613e9f41d28c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a19cfa154d94418ebc4646179bd16aed'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:59.098578 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1314/2664] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:43:59 2022] GET /identity/v3/roles => generated 1427 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:43:59.101417 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94539101-512d-4830-930e-d5d242bcc85c admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:59.103244 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-94539101-512d-4830-930e-d5d242bcc85c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:59.115310 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-82a80ecc-ef4e-45dd-b28a-613e9f41d28c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a19cfa154d94418ebc4646179bd16aed'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:59.117826 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94539101-512d-4830-930e-d5d242bcc85c admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:59.124712 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f283b49b-434a-4875-895f-4610df1e1232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:59.125636 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f283b49b-434a-4875-895f-4610df1e1232 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:59.126024 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f283b49b-434a-4875-895f-4610df1e1232 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:59.126367 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f283b49b-434a-4875-895f-4610df1e1232 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:59.127635 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f283b49b-434a-4875-895f-4610df1e1232 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:59.129861 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f283b49b-434a-4875-895f-4610df1e1232 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:59.130857 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1351/2665] 10.222.0.118 () {58 vars in 1228 bytes} [Thu Jul 14 15:43:58 2022] DELETE /identity/v3/users/a19cfa154d94418ebc4646179bd16aed => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:43:59.142288 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1315/2666] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:43:59 2022] GET /identity/v3/roles => generated 1427 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:43:59.146695 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a80ecc-ef4e-45dd-b28a-613e9f41d28c admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:59.189313 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f283b49b-434a-4875-895f-4610df1e1232 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:59.191779 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-f283b49b-434a-4875-895f-4610df1e1232 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:59.206905 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f283b49b-434a-4875-895f-4610df1e1232 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:59.237879 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a80ecc-ef4e-45dd-b28a-613e9f41d28c admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:59.243410 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e74d0d-7d23-43f3-82dc-f321894627e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:59.244308 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e74d0d-7d23-43f3-82dc-f321894627e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:59.244621 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e74d0d-7d23-43f3-82dc-f321894627e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:59.244894 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e74d0d-7d23-43f3-82dc-f321894627e5 admin admin] PATH_INFO: `/v3/projects/6be128a79e094277a3e6bb0fe8e9b734/users/a965f69bb87f486d995bc603c851f50a/roles/4abcf5e5e7cd4b53ae1828fec6550d53` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:59.264319 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e74d0d-7d23-43f3-82dc-f321894627e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6be128a79e094277a3e6bb0fe8e9b734, user_id=a965f69bb87f486d995bc603c851f50a, role_id=4abcf5e5e7cd4b53ae1828fec6550d53)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:59.267036 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e74d0d-7d23-43f3-82dc-f321894627e5 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:59.269731 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:43:59.285663 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1352/2667] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:43:59 2022] PUT /identity/v3/projects/6be128a79e094277a3e6bb0fe8e9b734/users/a965f69bb87f486d995bc603c851f50a/roles/4abcf5e5e7cd4b53ae1828fec6550d53 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:43:59.289371 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bf8265-9ae5-45b4-b4c2-d29b6919b98d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:59.290302 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bf8265-9ae5-45b4-b4c2-d29b6919b98d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:59.290583 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bf8265-9ae5-45b4-b4c2-d29b6919b98d admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:59.290858 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bf8265-9ae5-45b4-b4c2-d29b6919b98d admin admin] PATH_INFO: `/v3/projects/620c93fd7b1f479fafbe6fc5860da99d` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:59.292078 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bf8265-9ae5-45b4-b4c2-d29b6919b98d admin admin] RBAC: Authorizing `identity:delete_project(project_id=620c93fd7b1f479fafbe6fc5860da99d)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:59.294074 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bf8265-9ae5-45b4-b4c2-d29b6919b98d admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:59.295885 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188b704f-a9a5-441a-bd0d-8977d943ca14 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:59.295885 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188b704f-a9a5-441a-bd0d-8977d943ca14 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:59.295885 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188b704f-a9a5-441a-bd0d-8977d943ca14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:59.330165 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-188b704f-a9a5-441a-bd0d-8977d943ca14 None None] MFA Rules not processed for user `a965f69bb87f486d995bc603c851f50a`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:43:59.331565 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-188b704f-a9a5-441a-bd0d-8977d943ca14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:59.356863 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-38bf8265-9ae5-45b4-b4c2-d29b6919b98d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '620c93fd7b1f479fafbe6fc5860da99d', 'request_id': 'req-38bf8265-9ae5-45b4-b4c2-d29b6919b98d'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:59.363455 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-38bf8265-9ae5-45b4-b4c2-d29b6919b98d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '620c93fd7b1f479fafbe6fc5860da99d', 'request_id': 'req-38bf8265-9ae5-45b4-b4c2-d29b6919b98d'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:59.371682 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-38bf8265-9ae5-45b4-b4c2-d29b6919b98d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '620c93fd7b1f479fafbe6fc5860da99d', 'request_id': 'req-38bf8265-9ae5-45b4-b4c2-d29b6919b98d'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:59.387952 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-38bf8265-9ae5-45b4-b4c2-d29b6919b98d admin admin] The token cache is being invalidate because project 620c93fd7b1f479fafbe6fc5860da99d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:43:59.388244 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-38bf8265-9ae5-45b4-b4c2-d29b6919b98d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:59.389415 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-38bf8265-9ae5-45b4-b4c2-d29b6919b98d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:59.391056 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1316/2668] 10.222.0.118 () {58 vars in 1237 bytes} [Thu Jul 14 15:43:59 2022] DELETE /identity/v3/projects/620c93fd7b1f479fafbe6fc5860da99d => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:43:59.395253 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bf8265-9ae5-45b4-b4c2-d29b6919b98d admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:59.396575 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-38bf8265-9ae5-45b4-b4c2-d29b6919b98d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:59.421637 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1353/2669] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:43:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:43:59.429036 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188b704f-a9a5-441a-bd0d-8977d943ca14 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:59.430492 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:43:59.430907 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-188b704f-a9a5-441a-bd0d-8977d943ca14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:59.479027 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bf8265-9ae5-45b4-b4c2-d29b6919b98d admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:59.484118 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5839848-152c-451f-8c22-06c9b3d28093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:59.485067 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5839848-152c-451f-8c22-06c9b3d28093 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:59.485411 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5839848-152c-451f-8c22-06c9b3d28093 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:59.485747 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5839848-152c-451f-8c22-06c9b3d28093 admin admin] PATH_INFO: `/v3/users/0fbb9a18c00c47e582fce1aee373cc90` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:59.487161 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5839848-152c-451f-8c22-06c9b3d28093 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fbb9a18c00c47e582fce1aee373cc90)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:59.489167 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5839848-152c-451f-8c22-06c9b3d28093 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:59.524298 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188b704f-a9a5-441a-bd0d-8977d943ca14 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:59.539373 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-f5839848-152c-451f-8c22-06c9b3d28093 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fbb9a18c00c47e582fce1aee373cc90'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:59.546993 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-f5839848-152c-451f-8c22-06c9b3d28093 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fbb9a18c00c47e582fce1aee373cc90'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:59.547683 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-f5839848-152c-451f-8c22-06c9b3d28093 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fbb9a18c00c47e582fce1aee373cc90'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:59.548430 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-f5839848-152c-451f-8c22-06c9b3d28093 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fbb9a18c00c47e582fce1aee373cc90'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:59.561422 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-f5839848-152c-451f-8c22-06c9b3d28093 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fbb9a18c00c47e582fce1aee373cc90'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:59.575382 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1317/2670] 10.222.0.118 () {58 vars in 1228 bytes} [Thu Jul 14 15:43:59 2022] DELETE /identity/v3/users/0fbb9a18c00c47e582fce1aee373cc90 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:43:59.576718 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5839848-152c-451f-8c22-06c9b3d28093 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:59.578118 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-f5839848-152c-451f-8c22-06c9b3d28093 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:59.594252 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5e6248-cb2a-4718-927e-f968c9b87941 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0177fc696ea40069902803da09f437c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:59.594977 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5e6248-cb2a-4718-927e-f968c9b87941 service nova] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:59.595326 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5e6248-cb2a-4718-927e-f968c9b87941 service nova] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:59.595890 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5e6248-cb2a-4718-927e-f968c9b87941 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:59.597538 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-0b5e6248-cb2a-4718-927e-f968c9b87941 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:59.619777 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:43:59.656405 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5839848-152c-451f-8c22-06c9b3d28093 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:59.661295 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36c384e-2d6d-4807-b600-7d2cbf21da2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:59.662231 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c384e-2d6d-4807-b600-7d2cbf21da2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:59.662518 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c384e-2d6d-4807-b600-7d2cbf21da2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:59.662792 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c384e-2d6d-4807-b600-7d2cbf21da2b admin admin] PATH_INFO: `/v3/projects/8762c6779d2f43579b270d15f2dbeefc` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:59.664135 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36c384e-2d6d-4807-b600-7d2cbf21da2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8762c6779d2f43579b270d15f2dbeefc)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:59.666111 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36c384e-2d6d-4807-b600-7d2cbf21da2b admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:59.670314 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5e6248-cb2a-4718-927e-f968c9b87941 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:59.672192 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5e6248-cb2a-4718-927e-f968c9b87941 service nova] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:59.683151 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1354/2671] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:43:59 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:43:59.720709 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:43:59.726138 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-a36c384e-2d6d-4807-b600-7d2cbf21da2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8762c6779d2f43579b270d15f2dbeefc', 'request_id': 'req-a36c384e-2d6d-4807-b600-7d2cbf21da2b'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:59.734451 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-a36c384e-2d6d-4807-b600-7d2cbf21da2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8762c6779d2f43579b270d15f2dbeefc', 'request_id': 'req-a36c384e-2d6d-4807-b600-7d2cbf21da2b'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:59.742177 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-a36c384e-2d6d-4807-b600-7d2cbf21da2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8762c6779d2f43579b270d15f2dbeefc', 'request_id': 'req-a36c384e-2d6d-4807-b600-7d2cbf21da2b'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:59.761030 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-a36c384e-2d6d-4807-b600-7d2cbf21da2b admin admin] The token cache is being invalidate because project 8762c6779d2f43579b270d15f2dbeefc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:43:59.761392 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-a36c384e-2d6d-4807-b600-7d2cbf21da2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:59.762786 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-a36c384e-2d6d-4807-b600-7d2cbf21da2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:59.765556 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1318/2672] 10.222.0.118 () {58 vars in 1237 bytes} [Thu Jul 14 15:43:59 2022] DELETE /identity/v3/projects/8762c6779d2f43579b270d15f2dbeefc => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:43:59.769742 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5e6248-cb2a-4718-927e-f968c9b87941 service nova] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:59.781903 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5e6248-cb2a-4718-927e-f968c9b87941 service nova] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:59.841899 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6ef092-b3a3-4f14-93f5-45a5b8c1b753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:59.842715 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6ef092-b3a3-4f14-93f5-45a5b8c1b753 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:59.842992 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6ef092-b3a3-4f14-93f5-45a5b8c1b753 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:59.843333 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6ef092-b3a3-4f14-93f5-45a5b8c1b753 admin admin] PATH_INFO: `/v3/users/b800b602c5e44cc6997969ad479289d8` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:59.844557 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6ef092-b3a3-4f14-93f5-45a5b8c1b753 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b800b602c5e44cc6997969ad479289d8)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:59.846664 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6ef092-b3a3-4f14-93f5-45a5b8c1b753 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:59.880585 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36c384e-2d6d-4807-b600-7d2cbf21da2b admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:59.882550 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-a36c384e-2d6d-4807-b600-7d2cbf21da2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:59.904561 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-9c6ef092-b3a3-4f14-93f5-45a5b8c1b753 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b800b602c5e44cc6997969ad479289d8'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:59.914044 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-9c6ef092-b3a3-4f14-93f5-45a5b8c1b753 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b800b602c5e44cc6997969ad479289d8'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:59.914727 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-9c6ef092-b3a3-4f14-93f5-45a5b8c1b753 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b800b602c5e44cc6997969ad479289d8'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:59.915349 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-9c6ef092-b3a3-4f14-93f5-45a5b8c1b753 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b800b602c5e44cc6997969ad479289d8'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:59.920478 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36c384e-2d6d-4807-b600-7d2cbf21da2b admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:59.926296 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a137ea-64b1-4b30-b2bf-415e743d4055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:59.927295 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a137ea-64b1-4b30-b2bf-415e743d4055 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:59.927720 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a137ea-64b1-4b30-b2bf-415e743d4055 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:59.928086 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a137ea-64b1-4b30-b2bf-415e743d4055 admin admin] PATH_INFO: `/v3/projects/91049923312c4c18bff1c03212978a81` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:59.929675 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a137ea-64b1-4b30-b2bf-415e743d4055 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91049923312c4c18bff1c03212978a81)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:59.930926 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-9c6ef092-b3a3-4f14-93f5-45a5b8c1b753 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b800b602c5e44cc6997969ad479289d8'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:43:59.931781 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a137ea-64b1-4b30-b2bf-415e743d4055 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:59.949371 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1355/2673] 10.222.0.118 () {58 vars in 1228 bytes} [Thu Jul 14 15:43:59 2022] DELETE /identity/v3/users/b800b602c5e44cc6997969ad479289d8 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:43:59.992249 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-a0a137ea-64b1-4b30-b2bf-415e743d4055 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91049923312c4c18bff1c03212978a81', 'request_id': 'req-a0a137ea-64b1-4b30-b2bf-415e743d4055'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:00.008834 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-a0a137ea-64b1-4b30-b2bf-415e743d4055 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91049923312c4c18bff1c03212978a81', 'request_id': 'req-a0a137ea-64b1-4b30-b2bf-415e743d4055'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:00.016679 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-a0a137ea-64b1-4b30-b2bf-415e743d4055 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91049923312c4c18bff1c03212978a81', 'request_id': 'req-a0a137ea-64b1-4b30-b2bf-415e743d4055'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:00.032585 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-a0a137ea-64b1-4b30-b2bf-415e743d4055 admin admin] The token cache is being invalidate because project 91049923312c4c18bff1c03212978a81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:44:00.033907 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-a0a137ea-64b1-4b30-b2bf-415e743d4055 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:00.034400 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-a0a137ea-64b1-4b30-b2bf-415e743d4055 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:00.036164 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1319/2674] 10.222.0.118 () {58 vars in 1237 bytes} [Thu Jul 14 15:43:59 2022] DELETE /identity/v3/projects/91049923312c4c18bff1c03212978a81 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:44:00.043461 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499ff78c-5c38-4a53-a531-21a4ca972d37 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:00.043978 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499ff78c-5c38-4a53-a531-21a4ca972d37 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:00.044399 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499ff78c-5c38-4a53-a531-21a4ca972d37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:00.077525 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-499ff78c-5c38-4a53-a531-21a4ca972d37 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:44:00.079458 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-499ff78c-5c38-4a53-a531-21a4ca972d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:44:00.132842 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:44:00.165095 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1356/2675] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:44:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:44:00.174600 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb0913-1b90-426d-b1ac-a85f2f7b9283 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:00.174886 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb0913-1b90-426d-b1ac-a85f2f7b9283 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:00.175659 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb0913-1b90-426d-b1ac-a85f2f7b9283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:00.198455 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-61eb0913-1b90-426d-b1ac-a85f2f7b9283 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:44:00.199332 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-61eb0913-1b90-426d-b1ac-a85f2f7b9283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:44:00.207871 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1320/2676] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:44:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:44:00.212500 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499ff78c-5c38-4a53-a531-21a4ca972d37 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:00.222897 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499ff78c-5c38-4a53-a531-21a4ca972d37 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:00.227566 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92367c5-5432-4c4a-9658-b82b6dfbe705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:00.228243 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92367c5-5432-4c4a-9658-b82b6dfbe705 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:00.228506 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92367c5-5432-4c4a-9658-b82b6dfbe705 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:00.228783 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92367c5-5432-4c4a-9658-b82b6dfbe705 admin admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:00.229591 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92367c5-5432-4c4a-9658-b82b6dfbe705 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:44:00.229913 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92367c5-5432-4c4a-9658-b82b6dfbe705 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:00.231663 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92367c5-5432-4c4a-9658-b82b6dfbe705 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:00.246000 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1357/2677] 10.222.0.118 () {58 vars in 1157 bytes} [Thu Jul 14 15:44:00 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:44:00.250953 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eb0913-1b90-426d-b1ac-a85f2f7b9283 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:00.261403 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eb0913-1b90-426d-b1ac-a85f2f7b9283 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:00.266667 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611597ee-28e0-4e13-b7b3-345baeb32a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:00.266878 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92367c5-5432-4c4a-9658-b82b6dfbe705 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:00.267356 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611597ee-28e0-4e13-b7b3-345baeb32a42 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:00.267637 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611597ee-28e0-4e13-b7b3-345baeb32a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:00.267917 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611597ee-28e0-4e13-b7b3-345baeb32a42 admin admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:00.268626 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611597ee-28e0-4e13-b7b3-345baeb32a42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:00.268747 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-e92367c5-5432-4c4a-9658-b82b6dfbe705 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:44:00.271100 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611597ee-28e0-4e13-b7b3-345baeb32a42 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:00.284464 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92367c5-5432-4c4a-9658-b82b6dfbe705 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:00.289538 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d40ad0-56ca-4287-bfe1-ae4a42ff9be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:00.290409 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d40ad0-56ca-4287-bfe1-ae4a42ff9be5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:00.290700 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d40ad0-56ca-4287-bfe1-ae4a42ff9be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:00.290952 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d40ad0-56ca-4287-bfe1-ae4a42ff9be5 admin admin] PATH_INFO: `/v3/projects/5f30bddd702f45398ccd5e752b02bd91` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:00.292852 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d40ad0-56ca-4287-bfe1-ae4a42ff9be5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f30bddd702f45398ccd5e752b02bd91)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:00.295537 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d40ad0-56ca-4287-bfe1-ae4a42ff9be5 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:00.313264 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1321/2678] 10.222.0.118 () {60 vars in 1157 bytes} [Thu Jul 14 15:44:00 2022] POST /identity/v3/projects => generated 410 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:44:00.318927 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611597ee-28e0-4e13-b7b3-345baeb32a42 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:00.348524 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-e7d40ad0-56ca-4287-bfe1-ae4a42ff9be5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f30bddd702f45398ccd5e752b02bd91', 'request_id': 'req-e7d40ad0-56ca-4287-bfe1-ae4a42ff9be5'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:00.353801 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-e7d40ad0-56ca-4287-bfe1-ae4a42ff9be5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f30bddd702f45398ccd5e752b02bd91', 'request_id': 'req-e7d40ad0-56ca-4287-bfe1-ae4a42ff9be5'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:00.361113 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-e7d40ad0-56ca-4287-bfe1-ae4a42ff9be5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f30bddd702f45398ccd5e752b02bd91', 'request_id': 'req-e7d40ad0-56ca-4287-bfe1-ae4a42ff9be5'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:00.374746 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-e7d40ad0-56ca-4287-bfe1-ae4a42ff9be5 admin admin] The token cache is being invalidate because project 5f30bddd702f45398ccd5e752b02bd91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:44:00.375034 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-e7d40ad0-56ca-4287-bfe1-ae4a42ff9be5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:00.375723 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-e7d40ad0-56ca-4287-bfe1-ae4a42ff9be5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:00.377351 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1358/2679] 10.222.0.118 () {58 vars in 1237 bytes} [Thu Jul 14 15:44:00 2022] DELETE /identity/v3/projects/5f30bddd702f45398ccd5e752b02bd91 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:44:00.382113 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb12e7a7-ad7c-4304-ae0d-dbc23fa6b0da None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:00.382393 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb12e7a7-ad7c-4304-ae0d-dbc23fa6b0da None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:00.382665 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb12e7a7-ad7c-4304-ae0d-dbc23fa6b0da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:00.383174 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611597ee-28e0-4e13-b7b3-345baeb32a42 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:00.399902 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-eb12e7a7-ad7c-4304-ae0d-dbc23fa6b0da None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:44:00.401139 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-eb12e7a7-ad7c-4304-ae0d-dbc23fa6b0da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:44:00.416616 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:DELETE=11,keystone:SELECT=86,keystone:INSERT=3 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:44:00.444505 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4074aa66-6916-4080-ac7a-7442b9a0e16e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:00.445182 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4074aa66-6916-4080-ac7a-7442b9a0e16e admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:00.445465 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4074aa66-6916-4080-ac7a-7442b9a0e16e admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:00.445740 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4074aa66-6916-4080-ac7a-7442b9a0e16e admin admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:00.446508 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4074aa66-6916-4080-ac7a-7442b9a0e16e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:00.448431 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4074aa66-6916-4080-ac7a-7442b9a0e16e admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:00.464326 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1359/2680] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:44:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:44:00.471944 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1322/2681] 10.222.0.118 () {60 vars in 1148 bytes} [Thu Jul 14 15:44:00 2022] POST /identity/v3/users => generated 306 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:44:00.472530 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703e6758-cfd4-41ac-bf87-9b0b173efcd9 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:00.472821 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703e6758-cfd4-41ac-bf87-9b0b173efcd9 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:00.472937 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4074aa66-6916-4080-ac7a-7442b9a0e16e admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:00.473100 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703e6758-cfd4-41ac-bf87-9b0b173efcd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:00.474586 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-4074aa66-6916-4080-ac7a-7442b9a0e16e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:44:00.487335 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4074aa66-6916-4080-ac7a-7442b9a0e16e admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:00.492242 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b68e63e-4b3d-45e5-8d1f-6f3f688bbd3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:00.492908 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b68e63e-4b3d-45e5-8d1f-6f3f688bbd3f admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:00.493031 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-703e6758-cfd4-41ac-bf87-9b0b173efcd9 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:44:00.493193 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b68e63e-4b3d-45e5-8d1f-6f3f688bbd3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:00.493470 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b68e63e-4b3d-45e5-8d1f-6f3f688bbd3f admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:00.494162 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-703e6758-cfd4-41ac-bf87-9b0b173efcd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:44:00.494280 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b68e63e-4b3d-45e5-8d1f-6f3f688bbd3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:00.495947 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b68e63e-4b3d-45e5-8d1f-6f3f688bbd3f admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:00.502088 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1360/2682] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:44:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:44:00.506319 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703e6758-cfd4-41ac-bf87-9b0b173efcd9 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:00.509742 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1323/2683] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:44:00 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:44:00.511009 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b68e63e-4b3d-45e5-8d1f-6f3f688bbd3f admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:00.516574 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703e6758-cfd4-41ac-bf87-9b0b173efcd9 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:00.521111 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b68e63e-4b3d-45e5-8d1f-6f3f688bbd3f admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:00.521686 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56461a38-857c-4829-9ca0-d0e2196ded81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:00.522614 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56461a38-857c-4829-9ca0-d0e2196ded81 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:00.522898 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56461a38-857c-4829-9ca0-d0e2196ded81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:00.523169 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56461a38-857c-4829-9ca0-d0e2196ded81 admin admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:00.524054 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56461a38-857c-4829-9ca0-d0e2196ded81 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:44:00.524382 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56461a38-857c-4829-9ca0-d0e2196ded81 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:00.525945 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56461a38-857c-4829-9ca0-d0e2196ded81 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:00.526094 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa3adb9-e3b5-45ab-ad2b-543eaf079930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:00.526739 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa3adb9-e3b5-45ab-ad2b-543eaf079930 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:00.527022 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa3adb9-e3b5-45ab-ad2b-543eaf079930 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:00.527296 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa3adb9-e3b5-45ab-ad2b-543eaf079930 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:00.528008 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa3adb9-e3b5-45ab-ad2b-543eaf079930 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:00.530175 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa3adb9-e3b5-45ab-ad2b-543eaf079930 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:00.541167 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1361/2684] 10.222.0.118 () {58 vars in 1157 bytes} [Thu Jul 14 15:44:00 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:44:00.541374 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1324/2685] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:44:00 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:44:00.543538 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56461a38-857c-4829-9ca0-d0e2196ded81 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:00.546715 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa3adb9-e3b5-45ab-ad2b-543eaf079930 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:00.554834 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56461a38-857c-4829-9ca0-d0e2196ded81 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:00.556746 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa3adb9-e3b5-45ab-ad2b-543eaf079930 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:00.560881 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d099784-1ff9-49aa-92fd-bfa6cec3ac46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:00.561565 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d099784-1ff9-49aa-92fd-bfa6cec3ac46 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:00.561825 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d099784-1ff9-49aa-92fd-bfa6cec3ac46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:00.562130 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d099784-1ff9-49aa-92fd-bfa6cec3ac46 admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:00.562835 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d099784-1ff9-49aa-92fd-bfa6cec3ac46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:00.564720 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d099784-1ff9-49aa-92fd-bfa6cec3ac46 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:00.567766 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea39d48-1610-492d-8840-07cd26ec025a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:00.568702 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea39d48-1610-492d-8840-07cd26ec025a admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:00.568986 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea39d48-1610-492d-8840-07cd26ec025a admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:00.569261 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea39d48-1610-492d-8840-07cd26ec025a admin admin] PATH_INFO: `/v3/projects/7d42ddb67a9447f58102f5a7edd9d6ca/users/c92714ea96e64ec4b0f533bf412b9853/roles/4abcf5e5e7cd4b53ae1828fec6550d53` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:00.584976 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea39d48-1610-492d-8840-07cd26ec025a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d42ddb67a9447f58102f5a7edd9d6ca, user_id=c92714ea96e64ec4b0f533bf412b9853, role_id=4abcf5e5e7cd4b53ae1828fec6550d53)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:00.588149 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea39d48-1610-492d-8840-07cd26ec025a admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:00.591179 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1362/2686] 10.222.0.118 () {60 vars in 1157 bytes} [Thu Jul 14 15:44:00 2022] POST /identity/v3/projects => generated 374 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:44:00.595999 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d099784-1ff9-49aa-92fd-bfa6cec3ac46 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:00.604438 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1325/2687] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:44:00 2022] PUT /identity/v3/projects/7d42ddb67a9447f58102f5a7edd9d6ca/users/c92714ea96e64ec4b0f533bf412b9853/roles/4abcf5e5e7cd4b53ae1828fec6550d53 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:44:00.604592 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:44:00.616337 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc06c46-b6f5-4204-b493-e690bd4f6376 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:00.616563 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc06c46-b6f5-4204-b493-e690bd4f6376 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:00.616833 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc06c46-b6f5-4204-b493-e690bd4f6376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:00.647550 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-0cc06c46-b6f5-4204-b493-e690bd4f6376 None None] MFA Rules not processed for user `c92714ea96e64ec4b0f533bf412b9853`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:44:00.648789 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-0cc06c46-b6f5-4204-b493-e690bd4f6376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:44:00.665793 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d099784-1ff9-49aa-92fd-bfa6cec3ac46 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:00.714787 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1326/2688] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:44:00 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:44:00.722064 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc06c46-b6f5-4204-b493-e690bd4f6376 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:00.730543 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf82fbb-30fd-46fd-a504-8bd3042aa33b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:00.731223 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf82fbb-30fd-46fd-a504-8bd3042aa33b admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:00.731503 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf82fbb-30fd-46fd-a504-8bd3042aa33b admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:00.731780 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf82fbb-30fd-46fd-a504-8bd3042aa33b admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:00.733033 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf82fbb-30fd-46fd-a504-8bd3042aa33b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:00.735107 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf82fbb-30fd-46fd-a504-8bd3042aa33b admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:00.755606 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1363/2689] 10.222.0.118 () {60 vars in 1148 bytes} [Thu Jul 14 15:44:00 2022] POST /identity/v3/users => generated 288 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:44:00.759695 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf82fbb-30fd-46fd-a504-8bd3042aa33b admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:00.769868 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf82fbb-30fd-46fd-a504-8bd3042aa33b admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:00.774830 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02276a0f-b4cf-4f13-a5ea-24dc787f8c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:00.775517 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02276a0f-b4cf-4f13-a5ea-24dc787f8c38 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:00.775848 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02276a0f-b4cf-4f13-a5ea-24dc787f8c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:00.776098 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02276a0f-b4cf-4f13-a5ea-24dc787f8c38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:00.776823 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02276a0f-b4cf-4f13-a5ea-24dc787f8c38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:00.778497 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02276a0f-b4cf-4f13-a5ea-24dc787f8c38 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:00.792538 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1364/2690] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:44:00 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:44:00.792720 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc06c46-b6f5-4204-b493-e690bd4f6376 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:00.793716 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02276a0f-b4cf-4f13-a5ea-24dc787f8c38 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:00.794953 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6f7af8-33cc-4db7-9a8a-d156933f13ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:00.795643 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6f7af8-33cc-4db7-9a8a-d156933f13ab admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:00.795995 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6f7af8-33cc-4db7-9a8a-d156933f13ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:00.796273 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6f7af8-33cc-4db7-9a8a-d156933f13ab admin admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:00.797050 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6f7af8-33cc-4db7-9a8a-d156933f13ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:00.799361 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6f7af8-33cc-4db7-9a8a-d156933f13ab admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:00.803782 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02276a0f-b4cf-4f13-a5ea-24dc787f8c38 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:00.808985 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1398bc34-a571-44d8-95bd-652d975ddff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:00.809658 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1398bc34-a571-44d8-95bd-652d975ddff7 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:00.809943 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1398bc34-a571-44d8-95bd-652d975ddff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:00.810245 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1398bc34-a571-44d8-95bd-652d975ddff7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:00.811007 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1398bc34-a571-44d8-95bd-652d975ddff7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:00.813008 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1398bc34-a571-44d8-95bd-652d975ddff7 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:00.813285 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:44:00.824617 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1365/2691] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:44:00 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:44:00.830287 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1327/2692] 10.222.0.118 () {60 vars in 1157 bytes} [Thu Jul 14 15:44:00 2022] POST /identity/v3/projects => generated 408 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:44:00.830422 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1398bc34-a571-44d8-95bd-652d975ddff7 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:00.831264 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6f7af8-33cc-4db7-9a8a-d156933f13ab admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:00.839488 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1398bc34-a571-44d8-95bd-652d975ddff7 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:00.893108 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6f7af8-33cc-4db7-9a8a-d156933f13ab admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:00.897396 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98ef8f8-99a9-4ce9-a1d5-d913f3bf3eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:00.897645 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8f4d2e-0034-485d-8bbc-08cdbbfc0b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:00.898310 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98ef8f8-99a9-4ce9-a1d5-d913f3bf3eeb admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:00.898440 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8f4d2e-0034-485d-8bbc-08cdbbfc0b62 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:00.898589 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98ef8f8-99a9-4ce9-a1d5-d913f3bf3eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:00.898692 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8f4d2e-0034-485d-8bbc-08cdbbfc0b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:00.898860 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8f4d2e-0034-485d-8bbc-08cdbbfc0b62 admin admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:00.898957 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98ef8f8-99a9-4ce9-a1d5-d913f3bf3eeb admin admin] PATH_INFO: `/v3/projects/8cdfc5df39e34df994ecba69009fe0f4/users/d07e0a9b6d8d4e29820210ae2c92a920/roles/4abcf5e5e7cd4b53ae1828fec6550d53` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:00.899540 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8f4d2e-0034-485d-8bbc-08cdbbfc0b62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:00.901489 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8f4d2e-0034-485d-8bbc-08cdbbfc0b62 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:00.915424 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98ef8f8-99a9-4ce9-a1d5-d913f3bf3eeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cdfc5df39e34df994ecba69009fe0f4, user_id=d07e0a9b6d8d4e29820210ae2c92a920, role_id=4abcf5e5e7cd4b53ae1828fec6550d53)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:00.918509 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98ef8f8-99a9-4ce9-a1d5-d913f3bf3eeb admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:00.922616 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1328/2693] 10.222.0.118 () {60 vars in 1148 bytes} [Thu Jul 14 15:44:00 2022] POST /identity/v3/users => generated 311 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:44:00.926650 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8f4d2e-0034-485d-8bbc-08cdbbfc0b62 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:00.932141 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1366/2694] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:44:00 2022] PUT /identity/v3/projects/8cdfc5df39e34df994ecba69009fe0f4/users/d07e0a9b6d8d4e29820210ae2c92a920/roles/4abcf5e5e7cd4b53ae1828fec6550d53 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:44:00.941851 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8f4d2e-0034-485d-8bbc-08cdbbfc0b62 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:00.943661 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb227c9-4332-49d2-ab30-690595629158 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:00.943949 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb227c9-4332-49d2-ab30-690595629158 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:00.944230 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb227c9-4332-49d2-ab30-690595629158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:00.950840 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:44:00.976436 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-8cb227c9-4332-49d2-ab30-690595629158 None None] MFA Rules not processed for user `d07e0a9b6d8d4e29820210ae2c92a920`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:44:00.977934 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-8cb227c9-4332-49d2-ab30-690595629158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:44:01.003774 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393cc354-3d75-4799-8f7c-ead2691f1f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:01.004491 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393cc354-3d75-4799-8f7c-ead2691f1f70 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:01.004781 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393cc354-3d75-4799-8f7c-ead2691f1f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:01.005056 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393cc354-3d75-4799-8f7c-ead2691f1f70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:01.005791 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393cc354-3d75-4799-8f7c-ead2691f1f70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:01.007439 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393cc354-3d75-4799-8f7c-ead2691f1f70 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:01.017657 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1329/2695] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:44:00 2022] GET /identity/v3/roles => generated 1427 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:44:01.021746 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393cc354-3d75-4799-8f7c-ead2691f1f70 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:01.033115 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393cc354-3d75-4799-8f7c-ead2691f1f70 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:01.038326 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c45fef7-dd52-423a-9bdd-4feaef288050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:01.039217 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c45fef7-dd52-423a-9bdd-4feaef288050 admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:01.039495 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c45fef7-dd52-423a-9bdd-4feaef288050 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:01.039765 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c45fef7-dd52-423a-9bdd-4feaef288050 admin admin] PATH_INFO: `/v3/projects/537606d4bc5444eba8affd4bb999314a/users/8372ea47f3554554b51e9d5ef8498974/roles/3b880cef7dcf4baf87b50f8610c0c56e` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:01.047534 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1367/2696] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:44:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:44:01.058082 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c45fef7-dd52-423a-9bdd-4feaef288050 admin admin] RBAC: Authorizing `identity:create_grant(project_id=537606d4bc5444eba8affd4bb999314a, user_id=8372ea47f3554554b51e9d5ef8498974, role_id=3b880cef7dcf4baf87b50f8610c0c56e)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:01.058965 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb227c9-4332-49d2-ab30-690595629158 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:01.061384 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-8cb227c9-4332-49d2-ab30-690595629158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:44:01.061511 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c45fef7-dd52-423a-9bdd-4feaef288050 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:01.075912 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1330/2697] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:44:01 2022] PUT /identity/v3/projects/537606d4bc5444eba8affd4bb999314a/users/8372ea47f3554554b51e9d5ef8498974/roles/3b880cef7dcf4baf87b50f8610c0c56e => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:44:01.081433 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c45fef7-dd52-423a-9bdd-4feaef288050 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:01.119822 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb227c9-4332-49d2-ab30-690595629158 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:01.140556 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:44:01.147869 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c45fef7-dd52-423a-9bdd-4feaef288050 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:01.156145 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db06350e-2af5-4318-8bc6-cc30806f20f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:01.156828 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db06350e-2af5-4318-8bc6-cc30806f20f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:01.157102 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db06350e-2af5-4318-8bc6-cc30806f20f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:01.157373 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db06350e-2af5-4318-8bc6-cc30806f20f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:01.158917 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db06350e-2af5-4318-8bc6-cc30806f20f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:01.160529 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db06350e-2af5-4318-8bc6-cc30806f20f5 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:01.175181 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1331/2698] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:44:01 2022] GET /identity/v3/roles => generated 1427 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:44:01.175402 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a576192-5f34-4508-b40f-56138977cf35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea647438ea1c438987f28cbe39c3ff2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:01.176047 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a576192-5f34-4508-b40f-56138977cf35 service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:01.176327 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a576192-5f34-4508-b40f-56138977cf35 service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:01.176602 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a576192-5f34-4508-b40f-56138977cf35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:01.176712 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db06350e-2af5-4318-8bc6-cc30806f20f5 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:01.187945 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db06350e-2af5-4318-8bc6-cc30806f20f5 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:01.193242 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c060ea-227f-4a80-ac8b-0656e9699370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:01.194247 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c060ea-227f-4a80-ac8b-0656e9699370 admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:01.194656 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c060ea-227f-4a80-ac8b-0656e9699370 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:01.194935 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c060ea-227f-4a80-ac8b-0656e9699370 admin admin] PATH_INFO: `/v3/projects/537606d4bc5444eba8affd4bb999314a/users/8372ea47f3554554b51e9d5ef8498974/roles/3b880cef7dcf4baf87b50f8610c0c56e` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:01.197263 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c060ea-227f-4a80-ac8b-0656e9699370 admin admin] RBAC: Authorizing `identity:create_grant(project_id=537606d4bc5444eba8affd4bb999314a, user_id=8372ea47f3554554b51e9d5ef8498974, role_id=3b880cef7dcf4baf87b50f8610c0c56e)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:01.200564 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c060ea-227f-4a80-ac8b-0656e9699370 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:01.212634 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1332/2699] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:44:01 2022] PUT /identity/v3/projects/537606d4bc5444eba8affd4bb999314a/users/8372ea47f3554554b51e9d5ef8498974/roles/3b880cef7dcf4baf87b50f8610c0c56e => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:44:01.223751 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b31c9b-908a-4a96-a5ac-deac0882f37d None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:01.224065 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b31c9b-908a-4a96-a5ac-deac0882f37d None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:01.224504 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b31c9b-908a-4a96-a5ac-deac0882f37d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:01.246117 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a576192-5f34-4508-b40f-56138977cf35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:01.247805 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a576192-5f34-4508-b40f-56138977cf35 service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:01.254261 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-91b31c9b-908a-4a96-a5ac-deac0882f37d None None] MFA Rules not processed for user `8372ea47f3554554b51e9d5ef8498974`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:44:01.255622 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-91b31c9b-908a-4a96-a5ac-deac0882f37d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:44:01.258050 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1368/2700] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:44:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:44:01.338451 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1333/2701] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:44:01 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:44:01.381467 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a576192-5f34-4508-b40f-56138977cf35 service cinder] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:01.383446 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-0a576192-5f34-4508-b40f-56138977cf35 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:44:01.395310 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:44:01.401499 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a576192-5f34-4508-b40f-56138977cf35 service cinder] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:01.465509 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00adf3e9-50a5-4d6e-a583-88f2ed3740f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea647438ea1c438987f28cbe39c3ff2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:01.466276 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00adf3e9-50a5-4d6e-a583-88f2ed3740f2 service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:01.467196 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00adf3e9-50a5-4d6e-a583-88f2ed3740f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:01.467540 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00adf3e9-50a5-4d6e-a583-88f2ed3740f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:01.479537 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00adf3e9-50a5-4d6e-a583-88f2ed3740f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:01.481584 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00adf3e9-50a5-4d6e-a583-88f2ed3740f2 service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:01.493895 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1369/2702] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:44:01 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:44:01.700795 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b31c9b-908a-4a96-a5ac-deac0882f37d None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:01.714307 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b31c9b-908a-4a96-a5ac-deac0882f37d None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:01.718796 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae97965-63bd-4852-907a-381bd73ecf91 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea647438ea1c438987f28cbe39c3ff2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:01.719485 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae97965-63bd-4852-907a-381bd73ecf91 service cinder] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:01.719765 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae97965-63bd-4852-907a-381bd73ecf91 service cinder] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:01.720043 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae97965-63bd-4852-907a-381bd73ecf91 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:01.786370 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae97965-63bd-4852-907a-381bd73ecf91 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:01.787835 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae97965-63bd-4852-907a-381bd73ecf91 service cinder] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:01.797412 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1334/2703] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:44:01 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:44:02.654104 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83be760-9beb-4ccb-b826-1799e1a7b717 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:02.655088 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83be760-9beb-4ccb-b826-1799e1a7b717 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:02.655204 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83be760-9beb-4ccb-b826-1799e1a7b717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:02.672715 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-a83be760-9beb-4ccb-b826-1799e1a7b717 None None] MFA Rules not processed for user `d07e0a9b6d8d4e29820210ae2c92a920`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:44:02.673951 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-a83be760-9beb-4ccb-b826-1799e1a7b717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:44:02.727786 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1370/2704] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:44:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:44:04.101939 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae97965-63bd-4852-907a-381bd73ecf91 service cinder] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:04.103379 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-cae97965-63bd-4852-907a-381bd73ecf91 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:44:04.168283 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae97965-63bd-4852-907a-381bd73ecf91 service cinder] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:04.173227 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e632466-aad3-499c-a4da-c12955e7e3ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:04.174133 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e632466-aad3-499c-a4da-c12955e7e3ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:04.174412 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e632466-aad3-499c-a4da-c12955e7e3ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:04.174682 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e632466-aad3-499c-a4da-c12955e7e3ba admin admin] PATH_INFO: `/v3/users/a965f69bb87f486d995bc603c851f50a` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:04.175876 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e632466-aad3-499c-a4da-c12955e7e3ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=a965f69bb87f486d995bc603c851f50a)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:04.177810 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e632466-aad3-499c-a4da-c12955e7e3ba admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:04.180221 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:44:04.224450 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-1e632466-aad3-499c-a4da-c12955e7e3ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a965f69bb87f486d995bc603c851f50a'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:04.231775 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-1e632466-aad3-499c-a4da-c12955e7e3ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a965f69bb87f486d995bc603c851f50a'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:04.233064 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-1e632466-aad3-499c-a4da-c12955e7e3ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a965f69bb87f486d995bc603c851f50a'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:04.233675 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-1e632466-aad3-499c-a4da-c12955e7e3ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a965f69bb87f486d995bc603c851f50a'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:04.247001 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-1e632466-aad3-499c-a4da-c12955e7e3ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a965f69bb87f486d995bc603c851f50a'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:04.260301 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1335/2705] 10.222.0.118 () {58 vars in 1228 bytes} [Thu Jul 14 15:44:04 2022] DELETE /identity/v3/users/a965f69bb87f486d995bc603c851f50a => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:44:04.265071 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216de0fe-a558-43e8-addd-e314e7a6d5de None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:04.265581 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216de0fe-a558-43e8-addd-e314e7a6d5de None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:04.265682 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216de0fe-a558-43e8-addd-e314e7a6d5de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:04.284413 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-216de0fe-a558-43e8-addd-e314e7a6d5de None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:44:04.285621 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-216de0fe-a558-43e8-addd-e314e7a6d5de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:44:04.363375 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1371/2706] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:44:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:44:04.373488 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e632466-aad3-499c-a4da-c12955e7e3ba admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:04.375784 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-1e632466-aad3-499c-a4da-c12955e7e3ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:44:04.475978 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e632466-aad3-499c-a4da-c12955e7e3ba admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:04.480614 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c0e312-9292-4258-8e19-3f27fb18db81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b650be8114b64df0ac88441f1c50b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:04.481419 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c0e312-9292-4258-8e19-3f27fb18db81 service neutron] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:04.481749 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c0e312-9292-4258-8e19-3f27fb18db81 service neutron] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:04.482197 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c0e312-9292-4258-8e19-3f27fb18db81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:04.494082 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c0e312-9292-4258-8e19-3f27fb18db81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:04.495657 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c0e312-9292-4258-8e19-3f27fb18db81 service neutron] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:04.509185 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1336/2707] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:44:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:44:05.026619 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216de0fe-a558-43e8-addd-e314e7a6d5de None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:05.028197 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-216de0fe-a558-43e8-addd-e314e7a6d5de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:44:05.043365 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216de0fe-a558-43e8-addd-e314e7a6d5de None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:05.048696 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045092b0-10ca-4928-9e45-0d4914b6dbc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:05.050074 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045092b0-10ca-4928-9e45-0d4914b6dbc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:05.050544 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045092b0-10ca-4928-9e45-0d4914b6dbc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:05.051025 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045092b0-10ca-4928-9e45-0d4914b6dbc0 admin admin] PATH_INFO: `/v3/projects/6be128a79e094277a3e6bb0fe8e9b734` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:05.053047 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045092b0-10ca-4928-9e45-0d4914b6dbc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6be128a79e094277a3e6bb0fe8e9b734)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:05.056782 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045092b0-10ca-4928-9e45-0d4914b6dbc0 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:05.115744 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:44:05.116984 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-045092b0-10ca-4928-9e45-0d4914b6dbc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6be128a79e094277a3e6bb0fe8e9b734', 'request_id': 'req-045092b0-10ca-4928-9e45-0d4914b6dbc0'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:05.124410 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-045092b0-10ca-4928-9e45-0d4914b6dbc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6be128a79e094277a3e6bb0fe8e9b734', 'request_id': 'req-045092b0-10ca-4928-9e45-0d4914b6dbc0'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:05.130760 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-045092b0-10ca-4928-9e45-0d4914b6dbc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6be128a79e094277a3e6bb0fe8e9b734', 'request_id': 'req-045092b0-10ca-4928-9e45-0d4914b6dbc0'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:05.144578 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-045092b0-10ca-4928-9e45-0d4914b6dbc0 admin admin] The token cache is being invalidate because project 6be128a79e094277a3e6bb0fe8e9b734 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:44:05.144864 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-045092b0-10ca-4928-9e45-0d4914b6dbc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:05.145484 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-045092b0-10ca-4928-9e45-0d4914b6dbc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:05.147823 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1372/2708] 10.222.0.118 () {58 vars in 1237 bytes} [Thu Jul 14 15:44:05 2022] DELETE /identity/v3/projects/6be128a79e094277a3e6bb0fe8e9b734 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:44:05.152386 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490504b4-4c2b-441e-9a6d-20f959f9588b None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:05.152849 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490504b4-4c2b-441e-9a6d-20f959f9588b None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:05.152961 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490504b4-4c2b-441e-9a6d-20f959f9588b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:05.170929 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-490504b4-4c2b-441e-9a6d-20f959f9588b None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:44:05.172392 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-490504b4-4c2b-441e-9a6d-20f959f9588b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:44:05.241768 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1337/2709] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:44:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:44:05.251245 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a712907-4438-4ecd-a13a-7802c36fbe5d None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:05.251687 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a712907-4438-4ecd-a13a-7802c36fbe5d None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:05.251998 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a712907-4438-4ecd-a13a-7802c36fbe5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:05.272706 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-9a712907-4438-4ecd-a13a-7802c36fbe5d None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:44:05.274078 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-9a712907-4438-4ecd-a13a-7802c36fbe5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:44:05.282804 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1373/2710] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:44:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:44:05.286992 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490504b4-4c2b-441e-9a6d-20f959f9588b None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:05.298342 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490504b4-4c2b-441e-9a6d-20f959f9588b None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:05.305016 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d21e770-5fda-47d1-9856-983b9a1b512f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:05.305152 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d21e770-5fda-47d1-9856-983b9a1b512f admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:05.305484 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d21e770-5fda-47d1-9856-983b9a1b512f admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:05.305812 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d21e770-5fda-47d1-9856-983b9a1b512f admin admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:05.306646 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d21e770-5fda-47d1-9856-983b9a1b512f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:44:05.307359 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d21e770-5fda-47d1-9856-983b9a1b512f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:05.308827 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d21e770-5fda-47d1-9856-983b9a1b512f admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:05.323419 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1338/2711] 10.222.0.118 () {58 vars in 1157 bytes} [Thu Jul 14 15:44:05 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:44:05.327770 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a712907-4438-4ecd-a13a-7802c36fbe5d None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:05.339949 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a712907-4438-4ecd-a13a-7802c36fbe5d None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:05.345625 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8de465-5665-4c79-867b-ab17bfc1b98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:05.346457 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8de465-5665-4c79-867b-ab17bfc1b98e admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:05.346765 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8de465-5665-4c79-867b-ab17bfc1b98e admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:05.347157 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8de465-5665-4c79-867b-ab17bfc1b98e admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:05.347879 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8de465-5665-4c79-867b-ab17bfc1b98e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:05.350039 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8de465-5665-4c79-867b-ab17bfc1b98e admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:05.390277 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d21e770-5fda-47d1-9856-983b9a1b512f admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:05.394078 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1374/2712] 10.222.0.118 () {60 vars in 1157 bytes} [Thu Jul 14 15:44:05 2022] POST /identity/v3/projects => generated 406 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:44:05.401734 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d21e770-5fda-47d1-9856-983b9a1b512f admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:05.410349 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:44:05.471590 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89df85b7-5fb4-4887-914e-49ffca90de7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:05.472261 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89df85b7-5fb4-4887-914e-49ffca90de7f admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:05.472536 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89df85b7-5fb4-4887-914e-49ffca90de7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:05.472801 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89df85b7-5fb4-4887-914e-49ffca90de7f admin admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:05.473483 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89df85b7-5fb4-4887-914e-49ffca90de7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:05.475414 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89df85b7-5fb4-4887-914e-49ffca90de7f admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:05.498809 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1339/2713] 10.222.0.118 () {60 vars in 1148 bytes} [Thu Jul 14 15:44:05 2022] POST /identity/v3/users => generated 304 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:44:05.501845 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8de465-5665-4c79-867b-ab17bfc1b98e admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:05.515168 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8de465-5665-4c79-867b-ab17bfc1b98e admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:05.520307 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e3f95f-fc57-4743-8125-f6734278e74b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:05.521009 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e3f95f-fc57-4743-8125-f6734278e74b admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:05.521295 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e3f95f-fc57-4743-8125-f6734278e74b admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:05.521570 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e3f95f-fc57-4743-8125-f6734278e74b admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:05.522520 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e3f95f-fc57-4743-8125-f6734278e74b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:05.524141 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e3f95f-fc57-4743-8125-f6734278e74b admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:05.539680 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1375/2714] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:44:05 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:44:05.539995 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89df85b7-5fb4-4887-914e-49ffca90de7f admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:05.550680 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89df85b7-5fb4-4887-914e-49ffca90de7f admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:05.555599 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec6728b-0337-4bd5-9997-dfa1df538fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:05.556272 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec6728b-0337-4bd5-9997-dfa1df538fa5 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:05.556554 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec6728b-0337-4bd5-9997-dfa1df538fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:05.556831 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec6728b-0337-4bd5-9997-dfa1df538fa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:05.557605 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec6728b-0337-4bd5-9997-dfa1df538fa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:05.559248 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec6728b-0337-4bd5-9997-dfa1df538fa5 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:05.571414 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1340/2715] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:44:05 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:44:05.575567 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e3f95f-fc57-4743-8125-f6734278e74b admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:05.585650 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e3f95f-fc57-4743-8125-f6734278e74b admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:05.590845 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ecc4ce-b29d-41e5-85f3-6e1a67f27252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:05.591929 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ecc4ce-b29d-41e5-85f3-6e1a67f27252 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:05.592215 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ecc4ce-b29d-41e5-85f3-6e1a67f27252 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:05.592490 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ecc4ce-b29d-41e5-85f3-6e1a67f27252 admin admin] PATH_INFO: `/v3/projects/4294c1970adc4b50808e740a0d228f1f/users/956f828b57414a0dbac6c676e57bf63d/roles/4abcf5e5e7cd4b53ae1828fec6550d53` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:05.607758 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ecc4ce-b29d-41e5-85f3-6e1a67f27252 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4294c1970adc4b50808e740a0d228f1f, user_id=956f828b57414a0dbac6c676e57bf63d, role_id=4abcf5e5e7cd4b53ae1828fec6550d53)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:05.610466 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ecc4ce-b29d-41e5-85f3-6e1a67f27252 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:05.627687 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1376/2716] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:44:05 2022] PUT /identity/v3/projects/4294c1970adc4b50808e740a0d228f1f/users/956f828b57414a0dbac6c676e57bf63d/roles/4abcf5e5e7cd4b53ae1828fec6550d53 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:44:05.632745 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71be146d-e6eb-4717-b446-f50e099a8b1d None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:05.633030 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71be146d-e6eb-4717-b446-f50e099a8b1d None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:05.633306 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71be146d-e6eb-4717-b446-f50e099a8b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:05.652533 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-71be146d-e6eb-4717-b446-f50e099a8b1d None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:44:05.653879 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-71be146d-e6eb-4717-b446-f50e099a8b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:44:05.717094 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1341/2717] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:44:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:44:05.728840 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ecc4ce-b29d-41e5-85f3-6e1a67f27252 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:05.730734 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-31ecc4ce-b29d-41e5-85f3-6e1a67f27252 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:44:05.799121 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ecc4ce-b29d-41e5-85f3-6e1a67f27252 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:05.809693 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b72070-8ebc-43fc-9528-e28e9aaec809 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b650be8114b64df0ac88441f1c50b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:05.810592 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b72070-8ebc-43fc-9528-e28e9aaec809 service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:05.810927 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b72070-8ebc-43fc-9528-e28e9aaec809 service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:05.811252 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b72070-8ebc-43fc-9528-e28e9aaec809 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:05.824200 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b72070-8ebc-43fc-9528-e28e9aaec809 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:05.825844 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b72070-8ebc-43fc-9528-e28e9aaec809 service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:05.837303 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1377/2718] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:44:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:44:06.867603 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb0ca27-b3b6-426c-92eb-ac39eff849f6 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:06.868100 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb0ca27-b3b6-426c-92eb-ac39eff849f6 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:06.868243 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb0ca27-b3b6-426c-92eb-ac39eff849f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:06.895602 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-6cb0ca27-b3b6-426c-92eb-ac39eff849f6 None None] MFA Rules not processed for user `956f828b57414a0dbac6c676e57bf63d`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:44:06.896998 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-6cb0ca27-b3b6-426c-92eb-ac39eff849f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:44:06.969169 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1342/2719] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:44:06 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:44:06.973752 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b72070-8ebc-43fc-9528-e28e9aaec809 service neutron] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:06.984773 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b72070-8ebc-43fc-9528-e28e9aaec809 service neutron] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:06.990279 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85137cc-edd0-45c4-8a50-0b41b2ce0ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:06.990959 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85137cc-edd0-45c4-8a50-0b41b2ce0ddc admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:06.991242 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85137cc-edd0-45c4-8a50-0b41b2ce0ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:06.991526 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85137cc-edd0-45c4-8a50-0b41b2ce0ddc admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:06.992236 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85137cc-edd0-45c4-8a50-0b41b2ce0ddc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:06.994221 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85137cc-edd0-45c4-8a50-0b41b2ce0ddc admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:07.027302 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1378/2720] 10.222.0.118 () {60 vars in 1157 bytes} [Thu Jul 14 15:44:06 2022] POST /identity/v3/projects => generated 404 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:44:07.031526 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb0ca27-b3b6-426c-92eb-ac39eff849f6 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:07.043618 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb0ca27-b3b6-426c-92eb-ac39eff849f6 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:07.066186 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:44:07.120796 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace7748f-b8e5-4e91-9fb4-5ec491248ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:07.121799 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace7748f-b8e5-4e91-9fb4-5ec491248ab8 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:07.122236 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace7748f-b8e5-4e91-9fb4-5ec491248ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:07.122635 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace7748f-b8e5-4e91-9fb4-5ec491248ab8 admin admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:07.124021 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace7748f-b8e5-4e91-9fb4-5ec491248ab8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:07.126119 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace7748f-b8e5-4e91-9fb4-5ec491248ab8 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:07.152096 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1343/2721] 10.222.0.118 () {60 vars in 1148 bytes} [Thu Jul 14 15:44:07 2022] POST /identity/v3/users => generated 309 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:44:07.156592 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85137cc-edd0-45c4-8a50-0b41b2ce0ddc admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:07.170490 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85137cc-edd0-45c4-8a50-0b41b2ce0ddc admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:07.178107 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53aa09e-3b9c-4a6b-b23d-3d0b6942c327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:07.178819 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53aa09e-3b9c-4a6b-b23d-3d0b6942c327 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:07.179103 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53aa09e-3b9c-4a6b-b23d-3d0b6942c327 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:07.179436 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53aa09e-3b9c-4a6b-b23d-3d0b6942c327 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:07.180212 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53aa09e-3b9c-4a6b-b23d-3d0b6942c327 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:07.182674 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53aa09e-3b9c-4a6b-b23d-3d0b6942c327 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:07.196970 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1379/2722] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:44:07 2022] GET /identity/v3/roles => generated 1427 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:44:07.201379 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace7748f-b8e5-4e91-9fb4-5ec491248ab8 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:07.212921 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace7748f-b8e5-4e91-9fb4-5ec491248ab8 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:07.218599 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2581816-1806-4c72-a948-452fa7058519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:07.219701 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2581816-1806-4c72-a948-452fa7058519 admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:07.219913 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2581816-1806-4c72-a948-452fa7058519 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:07.220234 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2581816-1806-4c72-a948-452fa7058519 admin admin] PATH_INFO: `/v3/projects/aa428102e9b24dbf9181f9b0d6cca915/users/7a18ea8775ef4b91b15cefa03c69bec5/roles/3b880cef7dcf4baf87b50f8610c0c56e` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:07.237287 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53aa09e-3b9c-4a6b-b23d-3d0b6942c327 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:07.237997 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2581816-1806-4c72-a948-452fa7058519 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa428102e9b24dbf9181f9b0d6cca915, user_id=7a18ea8775ef4b91b15cefa03c69bec5, role_id=3b880cef7dcf4baf87b50f8610c0c56e)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:07.239059 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-a53aa09e-3b9c-4a6b-b23d-3d0b6942c327 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:44:07.241087 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2581816-1806-4c72-a948-452fa7058519 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:07.253802 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53aa09e-3b9c-4a6b-b23d-3d0b6942c327 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:07.260526 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1344/2723] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:44:07 2022] PUT /identity/v3/projects/aa428102e9b24dbf9181f9b0d6cca915/users/7a18ea8775ef4b91b15cefa03c69bec5/roles/3b880cef7dcf4baf87b50f8610c0c56e => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:44:07.261869 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2581816-1806-4c72-a948-452fa7058519 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:07.299858 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:44:07.320853 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44dc65d-32e9-4c32-baa4-c86f3de8861d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:07.321738 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44dc65d-32e9-4c32-baa4-c86f3de8861d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:07.322033 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44dc65d-32e9-4c32-baa4-c86f3de8861d admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:07.322573 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44dc65d-32e9-4c32-baa4-c86f3de8861d admin admin] PATH_INFO: `/v3/users/c92714ea96e64ec4b0f533bf412b9853` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:07.323520 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44dc65d-32e9-4c32-baa4-c86f3de8861d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c92714ea96e64ec4b0f533bf412b9853)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:07.325437 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44dc65d-32e9-4c32-baa4-c86f3de8861d admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:07.336076 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2581816-1806-4c72-a948-452fa7058519 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:07.341215 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e705ce-a8ef-4fa0-9537-e4c46e980fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:07.342614 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e705ce-a8ef-4fa0-9537-e4c46e980fd7 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:07.342898 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e705ce-a8ef-4fa0-9537-e4c46e980fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:07.343172 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e705ce-a8ef-4fa0-9537-e4c46e980fd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:07.343905 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e705ce-a8ef-4fa0-9537-e4c46e980fd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:07.345518 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e705ce-a8ef-4fa0-9537-e4c46e980fd7 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:07.356494 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1345/2724] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:44:07 2022] GET /identity/v3/roles => generated 1427 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:44:07.361438 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e705ce-a8ef-4fa0-9537-e4c46e980fd7 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:07.372242 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e705ce-a8ef-4fa0-9537-e4c46e980fd7 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:07.376038 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-d44dc65d-32e9-4c32-baa4-c86f3de8861d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c92714ea96e64ec4b0f533bf412b9853'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:07.377006 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea68c589-b8d6-4ef7-8125-469cf49037b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:07.377901 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea68c589-b8d6-4ef7-8125-469cf49037b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:07.378439 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea68c589-b8d6-4ef7-8125-469cf49037b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:07.378563 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea68c589-b8d6-4ef7-8125-469cf49037b0 admin admin] PATH_INFO: `/v3/projects/aa428102e9b24dbf9181f9b0d6cca915/users/7a18ea8775ef4b91b15cefa03c69bec5/roles/3b880cef7dcf4baf87b50f8610c0c56e` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:07.380428 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea68c589-b8d6-4ef7-8125-469cf49037b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa428102e9b24dbf9181f9b0d6cca915, user_id=7a18ea8775ef4b91b15cefa03c69bec5, role_id=3b880cef7dcf4baf87b50f8610c0c56e)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:07.383098 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea68c589-b8d6-4ef7-8125-469cf49037b0 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:07.383292 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-d44dc65d-32e9-4c32-baa4-c86f3de8861d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c92714ea96e64ec4b0f533bf412b9853'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:07.383984 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-d44dc65d-32e9-4c32-baa4-c86f3de8861d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c92714ea96e64ec4b0f533bf412b9853'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:07.384596 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-d44dc65d-32e9-4c32-baa4-c86f3de8861d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c92714ea96e64ec4b0f533bf412b9853'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:07.394623 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1346/2725] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:44:07 2022] PUT /identity/v3/projects/aa428102e9b24dbf9181f9b0d6cca915/users/7a18ea8775ef4b91b15cefa03c69bec5/roles/3b880cef7dcf4baf87b50f8610c0c56e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:44:07.400379 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-d44dc65d-32e9-4c32-baa4-c86f3de8861d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c92714ea96e64ec4b0f533bf412b9853'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:07.414543 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1380/2726] 10.222.0.118 () {58 vars in 1228 bytes} [Thu Jul 14 15:44:07 2022] DELETE /identity/v3/users/c92714ea96e64ec4b0f533bf412b9853 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:44:07.419243 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b8714b-cde6-46a0-845c-b16767145741 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:07.419591 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b8714b-cde6-46a0-845c-b16767145741 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:07.420415 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b8714b-cde6-46a0-845c-b16767145741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:07.439322 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-a2b8714b-cde6-46a0-845c-b16767145741 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:44:07.440676 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-a2b8714b-cde6-46a0-845c-b16767145741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:44:07.511876 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1347/2727] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:44:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:44:07.523610 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44dc65d-32e9-4c32-baa4-c86f3de8861d admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:07.525209 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-d44dc65d-32e9-4c32-baa4-c86f3de8861d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:44:07.590395 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44dc65d-32e9-4c32-baa4-c86f3de8861d admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:07.594959 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89a334d-c5c2-4118-8886-88c49a35d5be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b650be8114b64df0ac88441f1c50b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:07.595614 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a334d-c5c2-4118-8886-88c49a35d5be service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:07.595899 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a334d-c5c2-4118-8886-88c49a35d5be service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:07.596175 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a334d-c5c2-4118-8886-88c49a35d5be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:07.606837 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89a334d-c5c2-4118-8886-88c49a35d5be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:07.608278 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89a334d-c5c2-4118-8886-88c49a35d5be service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:07.618491 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1381/2728] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:44:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:44:07.915013 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b8714b-cde6-46a0-845c-b16767145741 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:07.916798 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-a2b8714b-cde6-46a0-845c-b16767145741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:44:07.945943 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b8714b-cde6-46a0-845c-b16767145741 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:07.966967 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7889d1f-6b7d-4d04-a351-d8748ad0d6af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:07.967444 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7889d1f-6b7d-4d04-a351-d8748ad0d6af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:07.967732 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7889d1f-6b7d-4d04-a351-d8748ad0d6af admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:07.968065 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7889d1f-6b7d-4d04-a351-d8748ad0d6af admin admin] PATH_INFO: `/v3/projects/7d42ddb67a9447f58102f5a7edd9d6ca` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:07.970114 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7889d1f-6b7d-4d04-a351-d8748ad0d6af admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d42ddb67a9447f58102f5a7edd9d6ca)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:07.972073 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7889d1f-6b7d-4d04-a351-d8748ad0d6af admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:07.982581 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:44:08.072969 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-e7889d1f-6b7d-4d04-a351-d8748ad0d6af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d42ddb67a9447f58102f5a7edd9d6ca', 'request_id': 'req-e7889d1f-6b7d-4d04-a351-d8748ad0d6af'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:08.082604 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-e7889d1f-6b7d-4d04-a351-d8748ad0d6af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d42ddb67a9447f58102f5a7edd9d6ca', 'request_id': 'req-e7889d1f-6b7d-4d04-a351-d8748ad0d6af'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:08.091220 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-e7889d1f-6b7d-4d04-a351-d8748ad0d6af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d42ddb67a9447f58102f5a7edd9d6ca', 'request_id': 'req-e7889d1f-6b7d-4d04-a351-d8748ad0d6af'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:08.107202 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-e7889d1f-6b7d-4d04-a351-d8748ad0d6af admin admin] The token cache is being invalidate because project 7d42ddb67a9447f58102f5a7edd9d6ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:44:08.107825 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-e7889d1f-6b7d-4d04-a351-d8748ad0d6af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:08.109772 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-e7889d1f-6b7d-4d04-a351-d8748ad0d6af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:08.112384 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1348/2729] 10.222.0.118 () {58 vars in 1237 bytes} [Thu Jul 14 15:44:07 2022] DELETE /identity/v3/projects/7d42ddb67a9447f58102f5a7edd9d6ca => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:44:08.117728 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89a334d-c5c2-4118-8886-88c49a35d5be service neutron] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:08.133595 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89a334d-c5c2-4118-8886-88c49a35d5be service neutron] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:08.214337 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b45d70f-3e99-4489-8bfb-b12bbfc97369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:08.215386 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b45d70f-3e99-4489-8bfb-b12bbfc97369 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:08.215733 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b45d70f-3e99-4489-8bfb-b12bbfc97369 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:08.217166 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b45d70f-3e99-4489-8bfb-b12bbfc97369 admin admin] PATH_INFO: `/v3/users/8372ea47f3554554b51e9d5ef8498974` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:08.218861 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b45d70f-3e99-4489-8bfb-b12bbfc97369 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8372ea47f3554554b51e9d5ef8498974)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:08.221202 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b45d70f-3e99-4489-8bfb-b12bbfc97369 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:08.229061 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:44:08.317410 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-8b45d70f-3e99-4489-8bfb-b12bbfc97369 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8372ea47f3554554b51e9d5ef8498974'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:08.333136 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-8b45d70f-3e99-4489-8bfb-b12bbfc97369 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8372ea47f3554554b51e9d5ef8498974'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:08.334775 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-8b45d70f-3e99-4489-8bfb-b12bbfc97369 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8372ea47f3554554b51e9d5ef8498974'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:08.337451 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-8b45d70f-3e99-4489-8bfb-b12bbfc97369 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8372ea47f3554554b51e9d5ef8498974'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:08.361048 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-8b45d70f-3e99-4489-8bfb-b12bbfc97369 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8372ea47f3554554b51e9d5ef8498974'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:08.363440 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6684739a-b9ea-4676-9d7b-c8f3533de194 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:08.363755 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6684739a-b9ea-4676-9d7b-c8f3533de194 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:08.364034 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6684739a-b9ea-4676-9d7b-c8f3533de194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:08.395293 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1382/2730] 10.222.0.118 () {58 vars in 1228 bytes} [Thu Jul 14 15:44:08 2022] DELETE /identity/v3/users/8372ea47f3554554b51e9d5ef8498974 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:44:08.411200 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-6684739a-b9ea-4676-9d7b-c8f3533de194 None None] MFA Rules not processed for user `7a18ea8775ef4b91b15cefa03c69bec5`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:44:08.413082 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-6684739a-b9ea-4676-9d7b-c8f3533de194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:44:08.537429 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1349/2731] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:44:08 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:44:08.717368 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b45d70f-3e99-4489-8bfb-b12bbfc97369 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:08.719502 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-8b45d70f-3e99-4489-8bfb-b12bbfc97369 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:44:08.808424 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b45d70f-3e99-4489-8bfb-b12bbfc97369 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:08.814637 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210493eb-5b83-4f2f-be1e-f25b6cdbde68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:08.815472 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210493eb-5b83-4f2f-be1e-f25b6cdbde68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:08.815753 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210493eb-5b83-4f2f-be1e-f25b6cdbde68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:08.816066 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210493eb-5b83-4f2f-be1e-f25b6cdbde68 admin admin] PATH_INFO: `/v3/projects/537606d4bc5444eba8affd4bb999314a` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:08.817289 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210493eb-5b83-4f2f-be1e-f25b6cdbde68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=537606d4bc5444eba8affd4bb999314a)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:08.819369 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210493eb-5b83-4f2f-be1e-f25b6cdbde68 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:08.884354 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-210493eb-5b83-4f2f-be1e-f25b6cdbde68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '537606d4bc5444eba8affd4bb999314a', 'request_id': 'req-210493eb-5b83-4f2f-be1e-f25b6cdbde68'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:08.890395 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-210493eb-5b83-4f2f-be1e-f25b6cdbde68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '537606d4bc5444eba8affd4bb999314a', 'request_id': 'req-210493eb-5b83-4f2f-be1e-f25b6cdbde68'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:08.896854 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-210493eb-5b83-4f2f-be1e-f25b6cdbde68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '537606d4bc5444eba8affd4bb999314a', 'request_id': 'req-210493eb-5b83-4f2f-be1e-f25b6cdbde68'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:08.910940 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-210493eb-5b83-4f2f-be1e-f25b6cdbde68 admin admin] The token cache is being invalidate because project 537606d4bc5444eba8affd4bb999314a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:44:08.911234 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-210493eb-5b83-4f2f-be1e-f25b6cdbde68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:08.912029 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-210493eb-5b83-4f2f-be1e-f25b6cdbde68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:08.913598 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1383/2732] 10.222.0.118 () {58 vars in 1237 bytes} [Thu Jul 14 15:44:08 2022] DELETE /identity/v3/projects/537606d4bc5444eba8affd4bb999314a => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:44:08.919361 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0705a5-1900-41cc-9147-c5fdae720d1e None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:08.920399 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0705a5-1900-41cc-9147-c5fdae720d1e None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:08.920741 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0705a5-1900-41cc-9147-c5fdae720d1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:08.938985 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-fd0705a5-1900-41cc-9147-c5fdae720d1e None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:44:08.940211 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-fd0705a5-1900-41cc-9147-c5fdae720d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:44:09.003158 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1350/2733] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:44:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:44:09.011193 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de3ce2-56de-4492-ac64-fbf1a9bf1287 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:09.011526 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de3ce2-56de-4492-ac64-fbf1a9bf1287 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:09.011754 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de3ce2-56de-4492-ac64-fbf1a9bf1287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:09.032612 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-88de3ce2-56de-4492-ac64-fbf1a9bf1287 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:44:09.033864 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-88de3ce2-56de-4492-ac64-fbf1a9bf1287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:44:09.044253 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1384/2734] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:44:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:44:09.050001 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0705a5-1900-41cc-9147-c5fdae720d1e None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:09.060430 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0705a5-1900-41cc-9147-c5fdae720d1e None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:09.066398 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a885f47d-1518-4b21-8070-2d852bd3ec8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:09.067726 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a885f47d-1518-4b21-8070-2d852bd3ec8d admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:09.068063 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a885f47d-1518-4b21-8070-2d852bd3ec8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:09.068339 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a885f47d-1518-4b21-8070-2d852bd3ec8d admin admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:09.069086 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a885f47d-1518-4b21-8070-2d852bd3ec8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:44:09.069399 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a885f47d-1518-4b21-8070-2d852bd3ec8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:09.071073 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a885f47d-1518-4b21-8070-2d852bd3ec8d admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:09.090563 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1351/2735] 10.222.0.118 () {58 vars in 1157 bytes} [Thu Jul 14 15:44:09 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:44:09.098872 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88de3ce2-56de-4492-ac64-fbf1a9bf1287 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:09.112364 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88de3ce2-56de-4492-ac64-fbf1a9bf1287 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:09.118275 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e98d09-83a2-460a-8357-76bd204b3587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:09.119156 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e98d09-83a2-460a-8357-76bd204b3587 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:09.119437 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e98d09-83a2-460a-8357-76bd204b3587 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:09.119709 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e98d09-83a2-460a-8357-76bd204b3587 admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:09.120775 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e98d09-83a2-460a-8357-76bd204b3587 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:09.123655 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e98d09-83a2-460a-8357-76bd204b3587 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:09.128017 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:44:09.169827 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1385/2736] 10.222.0.118 () {60 vars in 1157 bytes} [Thu Jul 14 15:44:09 2022] POST /identity/v3/projects => generated 384 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:44:09.173883 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a885f47d-1518-4b21-8070-2d852bd3ec8d admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:09.182280 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:44:09.190452 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a885f47d-1518-4b21-8070-2d852bd3ec8d admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:09.255496 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdedf273-9d6d-45d2-9fbc-8bbcf825a0a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:09.256108 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdedf273-9d6d-45d2-9fbc-8bbcf825a0a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:09.256368 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdedf273-9d6d-45d2-9fbc-8bbcf825a0a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:09.256644 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdedf273-9d6d-45d2-9fbc-8bbcf825a0a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:09.257759 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdedf273-9d6d-45d2-9fbc-8bbcf825a0a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:09.259402 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdedf273-9d6d-45d2-9fbc-8bbcf825a0a8 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:09.281609 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1352/2737] 10.222.0.118 () {60 vars in 1148 bytes} [Thu Jul 14 15:44:09 2022] POST /identity/v3/users => generated 293 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:44:09.285751 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e98d09-83a2-460a-8357-76bd204b3587 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:09.296030 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e98d09-83a2-460a-8357-76bd204b3587 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:09.300753 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91091737-1a9c-4188-bb47-9324cd453d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:09.301419 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91091737-1a9c-4188-bb47-9324cd453d8a admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:09.301701 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91091737-1a9c-4188-bb47-9324cd453d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:09.301992 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91091737-1a9c-4188-bb47-9324cd453d8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:09.302786 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91091737-1a9c-4188-bb47-9324cd453d8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:09.304371 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91091737-1a9c-4188-bb47-9324cd453d8a admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:09.314537 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1386/2738] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:44:09 2022] GET /identity/v3/roles => generated 1427 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:44:09.318570 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdedf273-9d6d-45d2-9fbc-8bbcf825a0a8 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:09.329251 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdedf273-9d6d-45d2-9fbc-8bbcf825a0a8 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:09.333892 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9510bb5f-bd56-4631-b178-aef98e6b7fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:09.334590 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9510bb5f-bd56-4631-b178-aef98e6b7fa1 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:09.334872 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9510bb5f-bd56-4631-b178-aef98e6b7fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:09.335145 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9510bb5f-bd56-4631-b178-aef98e6b7fa1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:09.335871 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9510bb5f-bd56-4631-b178-aef98e6b7fa1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:09.337577 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9510bb5f-bd56-4631-b178-aef98e6b7fa1 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:09.348866 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1353/2739] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:44:09 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:44:09.353232 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91091737-1a9c-4188-bb47-9324cd453d8a admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:09.364274 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91091737-1a9c-4188-bb47-9324cd453d8a admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:09.369409 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a83f69-af77-4096-b433-2bab54f81546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:09.370347 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a83f69-af77-4096-b433-2bab54f81546 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:09.370616 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a83f69-af77-4096-b433-2bab54f81546 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:09.370884 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a83f69-af77-4096-b433-2bab54f81546 admin admin] PATH_INFO: `/v3/projects/67b8eaf7f8bb407e8dc62e57f95f4d15/users/5c8b9eff12894ebb8cd21fccffd2ea8f/roles/4abcf5e5e7cd4b53ae1828fec6550d53` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:09.386205 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a83f69-af77-4096-b433-2bab54f81546 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67b8eaf7f8bb407e8dc62e57f95f4d15, user_id=5c8b9eff12894ebb8cd21fccffd2ea8f, role_id=4abcf5e5e7cd4b53ae1828fec6550d53)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:09.390787 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a83f69-af77-4096-b433-2bab54f81546 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:09.408898 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1387/2740] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:44:09 2022] PUT /identity/v3/projects/67b8eaf7f8bb407e8dc62e57f95f4d15/users/5c8b9eff12894ebb8cd21fccffd2ea8f/roles/4abcf5e5e7cd4b53ae1828fec6550d53 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:44:09.419379 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719ce111-ae4b-4bf2-a833-1a44717af94c None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:09.419653 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719ce111-ae4b-4bf2-a833-1a44717af94c None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:09.419963 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719ce111-ae4b-4bf2-a833-1a44717af94c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:09.448250 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-719ce111-ae4b-4bf2-a833-1a44717af94c None None] MFA Rules not processed for user `5c8b9eff12894ebb8cd21fccffd2ea8f`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:44:09.449578 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-719ce111-ae4b-4bf2-a833-1a44717af94c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:44:09.518595 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1354/2741] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:44:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:44:09.523010 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a83f69-af77-4096-b433-2bab54f81546 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:09.613846 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a83f69-af77-4096-b433-2bab54f81546 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:09.619216 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3673a1f9-4176-4547-9535-1cd85e8de2a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:09.620198 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3673a1f9-4176-4547-9535-1cd85e8de2a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:09.620486 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3673a1f9-4176-4547-9535-1cd85e8de2a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:09.620760 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3673a1f9-4176-4547-9535-1cd85e8de2a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:09.621477 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3673a1f9-4176-4547-9535-1cd85e8de2a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:09.623954 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3673a1f9-4176-4547-9535-1cd85e8de2a6 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:09.658199 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1388/2742] 10.222.0.118 () {60 vars in 1157 bytes} [Thu Jul 14 15:44:09 2022] POST /identity/v3/projects => generated 384 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:44:09.661598 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719ce111-ae4b-4bf2-a833-1a44717af94c None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:09.674910 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719ce111-ae4b-4bf2-a833-1a44717af94c None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:09.745884 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3673a1f9-4176-4547-9535-1cd85e8de2a6 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:09.748231 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-3673a1f9-4176-4547-9535-1cd85e8de2a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:44:09.755167 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d2b837-07a7-4821-a230-a2c565ee9e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:09.756257 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d2b837-07a7-4821-a230-a2c565ee9e79 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:09.756696 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d2b837-07a7-4821-a230-a2c565ee9e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:09.757177 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d2b837-07a7-4821-a230-a2c565ee9e79 admin admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:09.757879 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d2b837-07a7-4821-a230-a2c565ee9e79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:09.759892 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d2b837-07a7-4821-a230-a2c565ee9e79 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:09.762620 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3673a1f9-4176-4547-9535-1cd85e8de2a6 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:09.767905 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4485c2-6f63-4990-b8d7-9f27348484c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:09.768841 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4485c2-6f63-4990-b8d7-9f27348484c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:09.769061 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4485c2-6f63-4990-b8d7-9f27348484c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:09.769335 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4485c2-6f63-4990-b8d7-9f27348484c0 admin admin] PATH_INFO: `/v3/users/956f828b57414a0dbac6c676e57bf63d` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:09.771059 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4485c2-6f63-4990-b8d7-9f27348484c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=956f828b57414a0dbac6c676e57bf63d)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:09.772678 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4485c2-6f63-4990-b8d7-9f27348484c0 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:09.785371 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1355/2743] 10.222.0.118 () {60 vars in 1148 bytes} [Thu Jul 14 15:44:09 2022] POST /identity/v3/users => generated 299 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:44:09.786630 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d2b837-07a7-4821-a230-a2c565ee9e79 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:09.793051 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:44:09.802265 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d2b837-07a7-4821-a230-a2c565ee9e79 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:09.807923 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0866525-aa86-4bdd-9807-e5547952d49a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:09.808599 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0866525-aa86-4bdd-9807-e5547952d49a admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:09.808885 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0866525-aa86-4bdd-9807-e5547952d49a admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:09.809161 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0866525-aa86-4bdd-9807-e5547952d49a admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:09.809937 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0866525-aa86-4bdd-9807-e5547952d49a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:09.812359 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0866525-aa86-4bdd-9807-e5547952d49a admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:09.826007 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1356/2744] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:44:09 2022] GET /identity/v3/roles => generated 1427 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:44:09.827195 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-cf4485c2-6f63-4990-b8d7-9f27348484c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '956f828b57414a0dbac6c676e57bf63d'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:09.827626 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0866525-aa86-4bdd-9807-e5547952d49a admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:09.834703 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-cf4485c2-6f63-4990-b8d7-9f27348484c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '956f828b57414a0dbac6c676e57bf63d'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:09.835403 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-cf4485c2-6f63-4990-b8d7-9f27348484c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '956f828b57414a0dbac6c676e57bf63d'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:09.836019 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-cf4485c2-6f63-4990-b8d7-9f27348484c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '956f828b57414a0dbac6c676e57bf63d'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:09.837215 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0866525-aa86-4bdd-9807-e5547952d49a admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:09.842481 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f1ccdd-c132-487b-adb3-69e77a42f746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:09.843349 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f1ccdd-c132-487b-adb3-69e77a42f746 admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:09.843629 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f1ccdd-c132-487b-adb3-69e77a42f746 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:09.843900 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f1ccdd-c132-487b-adb3-69e77a42f746 admin admin] PATH_INFO: `/v3/projects/b51d1542d8cd44418b46c020f62303fa/users/7ba08a931f6c4ee29f440472441148b1/roles/3b880cef7dcf4baf87b50f8610c0c56e` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:09.848642 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-cf4485c2-6f63-4990-b8d7-9f27348484c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '956f828b57414a0dbac6c676e57bf63d'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:09.859585 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f1ccdd-c132-487b-adb3-69e77a42f746 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b51d1542d8cd44418b46c020f62303fa, user_id=7ba08a931f6c4ee29f440472441148b1, role_id=3b880cef7dcf4baf87b50f8610c0c56e)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:09.862245 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f1ccdd-c132-487b-adb3-69e77a42f746 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:09.862382 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1389/2745] 10.222.0.118 () {58 vars in 1228 bytes} [Thu Jul 14 15:44:09 2022] DELETE /identity/v3/users/956f828b57414a0dbac6c676e57bf63d => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:44:09.877024 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1357/2746] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:44:09 2022] PUT /identity/v3/projects/b51d1542d8cd44418b46c020f62303fa/users/7ba08a931f6c4ee29f440472441148b1/roles/3b880cef7dcf4baf87b50f8610c0c56e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:44:09.881255 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4485c2-6f63-4990-b8d7-9f27348484c0 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:09.882668 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-cf4485c2-6f63-4990-b8d7-9f27348484c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:44:09.892636 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:44:09.950645 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4485c2-6f63-4990-b8d7-9f27348484c0 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:10.007090 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b44613-9a94-4e9b-8a4b-3bb05c98e38a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:10.007759 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b44613-9a94-4e9b-8a4b-3bb05c98e38a admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:10.008036 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b44613-9a94-4e9b-8a4b-3bb05c98e38a admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:10.008309 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b44613-9a94-4e9b-8a4b-3bb05c98e38a admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:10.009035 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b44613-9a94-4e9b-8a4b-3bb05c98e38a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:10.010738 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b44613-9a94-4e9b-8a4b-3bb05c98e38a admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:10.020804 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1390/2747] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:44:09 2022] GET /identity/v3/roles => generated 1427 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:44:10.024842 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f1ccdd-c132-487b-adb3-69e77a42f746 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:10.037521 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f1ccdd-c132-487b-adb3-69e77a42f746 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:10.043189 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f84cff-017c-4aa2-850b-e9637cb9dd04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:10.044168 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f84cff-017c-4aa2-850b-e9637cb9dd04 admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:10.045059 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f84cff-017c-4aa2-850b-e9637cb9dd04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:10.045344 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f84cff-017c-4aa2-850b-e9637cb9dd04 admin admin] PATH_INFO: `/v3/projects/b51d1542d8cd44418b46c020f62303fa/users/7ba08a931f6c4ee29f440472441148b1/roles/3b880cef7dcf4baf87b50f8610c0c56e` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:10.047578 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f84cff-017c-4aa2-850b-e9637cb9dd04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b51d1542d8cd44418b46c020f62303fa, user_id=7ba08a931f6c4ee29f440472441148b1, role_id=3b880cef7dcf4baf87b50f8610c0c56e)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:10.047784 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b44613-9a94-4e9b-8a4b-3bb05c98e38a admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:10.049531 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-18b44613-9a94-4e9b-8a4b-3bb05c98e38a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:44:10.050664 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f84cff-017c-4aa2-850b-e9637cb9dd04 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:10.064935 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b44613-9a94-4e9b-8a4b-3bb05c98e38a admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:10.065796 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1358/2748] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:44:10 2022] PUT /identity/v3/projects/b51d1542d8cd44418b46c020f62303fa/users/7ba08a931f6c4ee29f440472441148b1/roles/3b880cef7dcf4baf87b50f8610c0c56e => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:44:10.077376 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34305f1e-f51b-430e-9924-92d9469bb69d None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:10.078014 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34305f1e-f51b-430e-9924-92d9469bb69d None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:10.078369 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34305f1e-f51b-430e-9924-92d9469bb69d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:10.106359 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-34305f1e-f51b-430e-9924-92d9469bb69d None None] MFA Rules not processed for user `7ba08a931f6c4ee29f440472441148b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:44:10.108088 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-34305f1e-f51b-430e-9924-92d9469bb69d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:44:10.129002 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba31a1e-34da-4a6b-8341-78f7c8f9d38b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:10.129855 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba31a1e-34da-4a6b-8341-78f7c8f9d38b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:10.130186 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba31a1e-34da-4a6b-8341-78f7c8f9d38b admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:10.130719 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba31a1e-34da-4a6b-8341-78f7c8f9d38b admin admin] PATH_INFO: `/v3/projects/4294c1970adc4b50808e740a0d228f1f` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:10.131648 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba31a1e-34da-4a6b-8341-78f7c8f9d38b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4294c1970adc4b50808e740a0d228f1f)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:10.133566 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba31a1e-34da-4a6b-8341-78f7c8f9d38b admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:10.179956 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1359/2749] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:44:10 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:44:10.185065 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-3ba31a1e-34da-4a6b-8341-78f7c8f9d38b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4294c1970adc4b50808e740a0d228f1f', 'request_id': 'req-3ba31a1e-34da-4a6b-8341-78f7c8f9d38b'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:10.187162 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:44:10.190936 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34305f1e-f51b-430e-9924-92d9469bb69d None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:10.192505 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-34305f1e-f51b-430e-9924-92d9469bb69d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:44:10.192641 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-3ba31a1e-34da-4a6b-8341-78f7c8f9d38b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4294c1970adc4b50808e740a0d228f1f', 'request_id': 'req-3ba31a1e-34da-4a6b-8341-78f7c8f9d38b'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:10.199252 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-3ba31a1e-34da-4a6b-8341-78f7c8f9d38b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4294c1970adc4b50808e740a0d228f1f', 'request_id': 'req-3ba31a1e-34da-4a6b-8341-78f7c8f9d38b'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:10.213096 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-3ba31a1e-34da-4a6b-8341-78f7c8f9d38b admin admin] The token cache is being invalidate because project 4294c1970adc4b50808e740a0d228f1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:44:10.213384 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-3ba31a1e-34da-4a6b-8341-78f7c8f9d38b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:10.214103 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-3ba31a1e-34da-4a6b-8341-78f7c8f9d38b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:10.215692 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1391/2750] 10.222.0.118 () {58 vars in 1237 bytes} [Thu Jul 14 15:44:10 2022] DELETE /identity/v3/projects/4294c1970adc4b50808e740a0d228f1f => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:44:10.220293 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba31a1e-34da-4a6b-8341-78f7c8f9d38b admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:10.221736 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-3ba31a1e-34da-4a6b-8341-78f7c8f9d38b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:44:10.252106 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34305f1e-f51b-430e-9924-92d9469bb69d None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:10.287651 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba31a1e-34da-4a6b-8341-78f7c8f9d38b admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:10.292332 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d3d7d6-03a8-44f6-9d8f-63a76d0ebe66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:10.293207 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d3d7d6-03a8-44f6-9d8f-63a76d0ebe66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:10.293610 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d3d7d6-03a8-44f6-9d8f-63a76d0ebe66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:10.293895 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d3d7d6-03a8-44f6-9d8f-63a76d0ebe66 admin admin] PATH_INFO: `/v3/users/7a18ea8775ef4b91b15cefa03c69bec5` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:10.295825 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d3d7d6-03a8-44f6-9d8f-63a76d0ebe66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a18ea8775ef4b91b15cefa03c69bec5)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:10.297765 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d3d7d6-03a8-44f6-9d8f-63a76d0ebe66 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:10.301926 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66ae308-afb1-4f24-bbe3-e9b382bcc63f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea647438ea1c438987f28cbe39c3ff2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:10.302604 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ae308-afb1-4f24-bbe3-e9b382bcc63f service cinder] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:10.302884 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ae308-afb1-4f24-bbe3-e9b382bcc63f service cinder] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:10.303161 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ae308-afb1-4f24-bbe3-e9b382bcc63f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:10.304958 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-a66ae308-afb1-4f24-bbe3-e9b382bcc63f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:44:10.314170 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:44:10.346599 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-c3d3d7d6-03a8-44f6-9d8f-63a76d0ebe66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a18ea8775ef4b91b15cefa03c69bec5'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:10.354084 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-c3d3d7d6-03a8-44f6-9d8f-63a76d0ebe66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a18ea8775ef4b91b15cefa03c69bec5'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:10.354774 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-c3d3d7d6-03a8-44f6-9d8f-63a76d0ebe66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a18ea8775ef4b91b15cefa03c69bec5'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:10.355378 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-c3d3d7d6-03a8-44f6-9d8f-63a76d0ebe66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a18ea8775ef4b91b15cefa03c69bec5'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:10.367228 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66ae308-afb1-4f24-bbe3-e9b382bcc63f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:10.367798 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-c3d3d7d6-03a8-44f6-9d8f-63a76d0ebe66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a18ea8775ef4b91b15cefa03c69bec5'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:10.368669 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66ae308-afb1-4f24-bbe3-e9b382bcc63f service cinder] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:10.378286 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1360/2751] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:44:10 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:44:10.382043 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1392/2752] 10.222.0.118 () {58 vars in 1228 bytes} [Thu Jul 14 15:44:10 2022] DELETE /identity/v3/users/7a18ea8775ef4b91b15cefa03c69bec5 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:44:10.559408 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66ae308-afb1-4f24-bbe3-e9b382bcc63f service cinder] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:10.582903 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66ae308-afb1-4f24-bbe3-e9b382bcc63f service cinder] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:10.651518 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99dc228-ff57-4558-8608-061d81c1b386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:10.652177 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99dc228-ff57-4558-8608-061d81c1b386 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:10.652457 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99dc228-ff57-4558-8608-061d81c1b386 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:10.652978 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99dc228-ff57-4558-8608-061d81c1b386 admin admin] PATH_INFO: `/v3/projects/aa428102e9b24dbf9181f9b0d6cca915` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:10.655104 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99dc228-ff57-4558-8608-061d81c1b386 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa428102e9b24dbf9181f9b0d6cca915)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:10.657183 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99dc228-ff57-4558-8608-061d81c1b386 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:10.741987 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-f99dc228-ff57-4558-8608-061d81c1b386 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa428102e9b24dbf9181f9b0d6cca915', 'request_id': 'req-f99dc228-ff57-4558-8608-061d81c1b386'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:10.750142 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-f99dc228-ff57-4558-8608-061d81c1b386 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa428102e9b24dbf9181f9b0d6cca915', 'request_id': 'req-f99dc228-ff57-4558-8608-061d81c1b386'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:10.766117 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-f99dc228-ff57-4558-8608-061d81c1b386 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa428102e9b24dbf9181f9b0d6cca915', 'request_id': 'req-f99dc228-ff57-4558-8608-061d81c1b386'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:10.791820 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-f99dc228-ff57-4558-8608-061d81c1b386 admin admin] The token cache is being invalidate because project aa428102e9b24dbf9181f9b0d6cca915 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:44:10.792277 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-f99dc228-ff57-4558-8608-061d81c1b386 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:10.793085 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-f99dc228-ff57-4558-8608-061d81c1b386 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:10.795202 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1361/2753] 10.222.0.118 () {58 vars in 1237 bytes} [Thu Jul 14 15:44:10 2022] DELETE /identity/v3/projects/aa428102e9b24dbf9181f9b0d6cca915 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:44:10.800283 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20738570-21f5-46f8-b2fb-9322f13108c1 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:10.801052 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20738570-21f5-46f8-b2fb-9322f13108c1 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:10.801052 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20738570-21f5-46f8-b2fb-9322f13108c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:10.822796 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-20738570-21f5-46f8-b2fb-9322f13108c1 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:44:10.826211 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-20738570-21f5-46f8-b2fb-9322f13108c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:44:10.899898 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:44:10.914015 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1393/2754] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:44:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:44:10.920030 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee59dd3-04f6-497b-9a95-9140712fef8f None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:10.920317 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee59dd3-04f6-497b-9a95-9140712fef8f None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:10.920578 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee59dd3-04f6-497b-9a95-9140712fef8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:10.949614 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-bee59dd3-04f6-497b-9a95-9140712fef8f None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:44:10.951565 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-bee59dd3-04f6-497b-9a95-9140712fef8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:44:10.960021 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1362/2755] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:44:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:44:10.964240 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20738570-21f5-46f8-b2fb-9322f13108c1 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:10.975028 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20738570-21f5-46f8-b2fb-9322f13108c1 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:10.981011 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bf2bac-fa6a-41c4-94ac-5e0d9cb4fc4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:10.981802 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bf2bac-fa6a-41c4-94ac-5e0d9cb4fc4d admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:10.982129 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bf2bac-fa6a-41c4-94ac-5e0d9cb4fc4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:10.982408 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bf2bac-fa6a-41c4-94ac-5e0d9cb4fc4d admin admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:10.983170 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bf2bac-fa6a-41c4-94ac-5e0d9cb4fc4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:44:10.983459 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bf2bac-fa6a-41c4-94ac-5e0d9cb4fc4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:10.985162 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bf2bac-fa6a-41c4-94ac-5e0d9cb4fc4d admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:11.002361 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1394/2756] 10.222.0.118 () {58 vars in 1157 bytes} [Thu Jul 14 15:44:10 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:44:11.003479 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee59dd3-04f6-497b-9a95-9140712fef8f None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:11.014629 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee59dd3-04f6-497b-9a95-9140712fef8f None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:11.019892 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0703b4-12c9-42bc-b8df-a44dacb6ebb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:11.020772 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0703b4-12c9-42bc-b8df-a44dacb6ebb4 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:11.021053 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0703b4-12c9-42bc-b8df-a44dacb6ebb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:11.021319 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0703b4-12c9-42bc-b8df-a44dacb6ebb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:11.022048 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0703b4-12c9-42bc-b8df-a44dacb6ebb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:11.023993 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0703b4-12c9-42bc-b8df-a44dacb6ebb4 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:11.050582 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1363/2757] 10.222.0.118 () {60 vars in 1157 bytes} [Thu Jul 14 15:44:11 2022] POST /identity/v3/projects => generated 378 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:44:11.054897 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bf2bac-fa6a-41c4-94ac-5e0d9cb4fc4d admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:11.065933 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bf2bac-fa6a-41c4-94ac-5e0d9cb4fc4d admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:11.136182 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c37c2a4-6c3e-4546-a042-ab3d60ad3c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:11.136890 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c37c2a4-6c3e-4546-a042-ab3d60ad3c12 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:11.137136 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c37c2a4-6c3e-4546-a042-ab3d60ad3c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:11.137411 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c37c2a4-6c3e-4546-a042-ab3d60ad3c12 admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:11.138913 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c37c2a4-6c3e-4546-a042-ab3d60ad3c12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:11.140846 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c37c2a4-6c3e-4546-a042-ab3d60ad3c12 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:11.160099 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1395/2758] 10.222.0.118 () {60 vars in 1148 bytes} [Thu Jul 14 15:44:11 2022] POST /identity/v3/users => generated 290 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:44:11.164177 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0703b4-12c9-42bc-b8df-a44dacb6ebb4 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:11.174721 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0703b4-12c9-42bc-b8df-a44dacb6ebb4 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:11.179323 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fe0bfc-0c52-4586-bce7-b55fc0fa5df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:11.179980 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fe0bfc-0c52-4586-bce7-b55fc0fa5df5 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:11.180259 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fe0bfc-0c52-4586-bce7-b55fc0fa5df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:11.180530 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fe0bfc-0c52-4586-bce7-b55fc0fa5df5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:11.181251 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fe0bfc-0c52-4586-bce7-b55fc0fa5df5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:11.182941 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fe0bfc-0c52-4586-bce7-b55fc0fa5df5 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:11.188597 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:44:11.194350 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1364/2759] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:44:11 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:44:11.198517 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c37c2a4-6c3e-4546-a042-ab3d60ad3c12 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:11.209183 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c37c2a4-6c3e-4546-a042-ab3d60ad3c12 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:11.213838 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6890786a-e226-4d53-86f5-7bf4b66c8c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:11.214528 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6890786a-e226-4d53-86f5-7bf4b66c8c06 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:11.214805 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6890786a-e226-4d53-86f5-7bf4b66c8c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:11.215075 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6890786a-e226-4d53-86f5-7bf4b66c8c06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:11.215796 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6890786a-e226-4d53-86f5-7bf4b66c8c06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:11.217380 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6890786a-e226-4d53-86f5-7bf4b66c8c06 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:11.227422 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1396/2760] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:44:11 2022] GET /identity/v3/roles => generated 1427 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:44:11.231576 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fe0bfc-0c52-4586-bce7-b55fc0fa5df5 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:11.241838 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fe0bfc-0c52-4586-bce7-b55fc0fa5df5 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:11.246480 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddac731c-18b7-44ab-86d9-78273e5a0e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:11.247375 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddac731c-18b7-44ab-86d9-78273e5a0e70 admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:11.248168 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddac731c-18b7-44ab-86d9-78273e5a0e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:11.248435 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddac731c-18b7-44ab-86d9-78273e5a0e70 admin admin] PATH_INFO: `/v3/projects/b2da6f7e09e04504a51be958f176190a/users/ee5635a4d3b744ffa92778ca56c76614/roles/4abcf5e5e7cd4b53ae1828fec6550d53` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:11.264325 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddac731c-18b7-44ab-86d9-78273e5a0e70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2da6f7e09e04504a51be958f176190a, user_id=ee5635a4d3b744ffa92778ca56c76614, role_id=4abcf5e5e7cd4b53ae1828fec6550d53)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:11.266999 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddac731c-18b7-44ab-86d9-78273e5a0e70 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:11.280358 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1365/2761] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:44:11 2022] PUT /identity/v3/projects/b2da6f7e09e04504a51be958f176190a/users/ee5635a4d3b744ffa92778ca56c76614/roles/4abcf5e5e7cd4b53ae1828fec6550d53 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:44:11.290639 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e3b4c9-64a0-4157-b253-b4447531ab81 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:11.291123 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e3b4c9-64a0-4157-b253-b4447531ab81 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:11.291261 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e3b4c9-64a0-4157-b253-b4447531ab81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:11.318112 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-65e3b4c9-64a0-4157-b253-b4447531ab81 None None] MFA Rules not processed for user `ee5635a4d3b744ffa92778ca56c76614`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:44:11.319236 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-65e3b4c9-64a0-4157-b253-b4447531ab81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:44:11.382891 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1397/2762] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:44:11 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:44:11.387415 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddac731c-18b7-44ab-86d9-78273e5a0e70 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:11.448465 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddac731c-18b7-44ab-86d9-78273e5a0e70 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:11.453080 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7291d06f-a1ea-4662-b19e-78763021625b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:11.453732 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7291d06f-a1ea-4662-b19e-78763021625b admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:11.454042 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7291d06f-a1ea-4662-b19e-78763021625b admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:11.454316 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7291d06f-a1ea-4662-b19e-78763021625b admin admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:11.455010 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7291d06f-a1ea-4662-b19e-78763021625b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:11.456893 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7291d06f-a1ea-4662-b19e-78763021625b admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:11.484548 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1366/2763] 10.222.0.118 () {60 vars in 1157 bytes} [Thu Jul 14 15:44:11 2022] POST /identity/v3/projects => generated 376 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:44:11.488509 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e3b4c9-64a0-4157-b253-b4447531ab81 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:11.500258 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e3b4c9-64a0-4157-b253-b4447531ab81 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:11.551238 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:44:11.558724 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55d9e84-23e0-450e-b6f0-d4677c17523b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:11.559396 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55d9e84-23e0-450e-b6f0-d4677c17523b admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:11.559856 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55d9e84-23e0-450e-b6f0-d4677c17523b admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:11.560669 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55d9e84-23e0-450e-b6f0-d4677c17523b admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:11.561356 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55d9e84-23e0-450e-b6f0-d4677c17523b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:11.563274 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55d9e84-23e0-450e-b6f0-d4677c17523b admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:11.582565 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1398/2764] 10.222.0.118 () {60 vars in 1148 bytes} [Thu Jul 14 15:44:11 2022] POST /identity/v3/users => generated 295 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:44:11.586556 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7291d06f-a1ea-4662-b19e-78763021625b admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:11.596746 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7291d06f-a1ea-4662-b19e-78763021625b admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:11.601334 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8462d9cf-4c23-4dbf-92e5-0f9e29faedef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:11.602677 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8462d9cf-4c23-4dbf-92e5-0f9e29faedef admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:11.602965 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8462d9cf-4c23-4dbf-92e5-0f9e29faedef admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:11.603243 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8462d9cf-4c23-4dbf-92e5-0f9e29faedef admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:11.604048 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8462d9cf-4c23-4dbf-92e5-0f9e29faedef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:11.605687 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8462d9cf-4c23-4dbf-92e5-0f9e29faedef admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:11.617233 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1367/2765] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:44:11 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:44:11.621446 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55d9e84-23e0-450e-b6f0-d4677c17523b admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:11.631975 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55d9e84-23e0-450e-b6f0-d4677c17523b admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:11.636539 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801412ac-b01d-4af9-8670-a6a8d3f51635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:11.637409 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801412ac-b01d-4af9-8670-a6a8d3f51635 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:11.637685 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801412ac-b01d-4af9-8670-a6a8d3f51635 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:11.637954 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801412ac-b01d-4af9-8670-a6a8d3f51635 admin admin] PATH_INFO: `/v3/projects/9219272fd73e45718b8fd1a534803320/users/3406b2733b0f402288effa2f3b8ad9a0/roles/3b880cef7dcf4baf87b50f8610c0c56e` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:11.652493 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801412ac-b01d-4af9-8670-a6a8d3f51635 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9219272fd73e45718b8fd1a534803320, user_id=3406b2733b0f402288effa2f3b8ad9a0, role_id=3b880cef7dcf4baf87b50f8610c0c56e)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:11.655691 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801412ac-b01d-4af9-8670-a6a8d3f51635 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:11.668684 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1399/2766] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:44:11 2022] PUT /identity/v3/projects/9219272fd73e45718b8fd1a534803320/users/3406b2733b0f402288effa2f3b8ad9a0/roles/3b880cef7dcf4baf87b50f8610c0c56e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:44:11.673206 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8462d9cf-4c23-4dbf-92e5-0f9e29faedef admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:11.683196 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8462d9cf-4c23-4dbf-92e5-0f9e29faedef admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:11.740932 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5abbe60-2acf-4ffb-8db2-0d186d3f3c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:11.741609 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5abbe60-2acf-4ffb-8db2-0d186d3f3c01 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:11.741889 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5abbe60-2acf-4ffb-8db2-0d186d3f3c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:11.742195 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5abbe60-2acf-4ffb-8db2-0d186d3f3c01 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:11.742956 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5abbe60-2acf-4ffb-8db2-0d186d3f3c01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:11.744555 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5abbe60-2acf-4ffb-8db2-0d186d3f3c01 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:11.754348 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1368/2767] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:44:11 2022] GET /identity/v3/roles => generated 1427 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:44:11.758594 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801412ac-b01d-4af9-8670-a6a8d3f51635 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:11.768821 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801412ac-b01d-4af9-8670-a6a8d3f51635 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:11.773427 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6096569d-a82e-46ce-b704-889ab56ecceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:11.774331 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6096569d-a82e-46ce-b704-889ab56ecceb admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:11.774615 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6096569d-a82e-46ce-b704-889ab56ecceb admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:11.774893 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6096569d-a82e-46ce-b704-889ab56ecceb admin admin] PATH_INFO: `/v3/projects/9219272fd73e45718b8fd1a534803320/users/3406b2733b0f402288effa2f3b8ad9a0/roles/3b880cef7dcf4baf87b50f8610c0c56e` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:11.777130 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6096569d-a82e-46ce-b704-889ab56ecceb admin admin] RBAC: Authorizing `identity:create_grant(project_id=9219272fd73e45718b8fd1a534803320, user_id=3406b2733b0f402288effa2f3b8ad9a0, role_id=3b880cef7dcf4baf87b50f8610c0c56e)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:11.780318 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6096569d-a82e-46ce-b704-889ab56ecceb admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:11.792619 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1400/2768] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:44:11 2022] PUT /identity/v3/projects/9219272fd73e45718b8fd1a534803320/users/3406b2733b0f402288effa2f3b8ad9a0/roles/3b880cef7dcf4baf87b50f8610c0c56e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:44:11.803979 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b5ad11-efdb-45b2-ab04-f50642c0c30e None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:11.804276 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b5ad11-efdb-45b2-ab04-f50642c0c30e None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:11.804555 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b5ad11-efdb-45b2-ab04-f50642c0c30e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:11.831958 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-60b5ad11-efdb-45b2-ab04-f50642c0c30e None None] MFA Rules not processed for user `3406b2733b0f402288effa2f3b8ad9a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:44:11.833329 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-60b5ad11-efdb-45b2-ab04-f50642c0c30e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:44:11.869034 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:44:11.911771 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1369/2769] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:44:11 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:44:11.924298 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6096569d-a82e-46ce-b704-889ab56ecceb admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:11.926171 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-6096569d-a82e-46ce-b704-889ab56ecceb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:44:11.985677 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6096569d-a82e-46ce-b704-889ab56ecceb admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:11.990014 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6950401-83b1-46f0-adb2-621fcfec4f0c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea647438ea1c438987f28cbe39c3ff2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:11.990670 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6950401-83b1-46f0-adb2-621fcfec4f0c service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:11.990947 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6950401-83b1-46f0-adb2-621fcfec4f0c service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:11.991219 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6950401-83b1-46f0-adb2-621fcfec4f0c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:12.060147 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6950401-83b1-46f0-adb2-621fcfec4f0c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:12.061645 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6950401-83b1-46f0-adb2-621fcfec4f0c service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:12.074686 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1401/2770] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:44:11 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:44:14.718527 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b5ad11-efdb-45b2-ab04-f50642c0c30e None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:14.722473 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-60b5ad11-efdb-45b2-ab04-f50642c0c30e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:44:14.742387 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b5ad11-efdb-45b2-ab04-f50642c0c30e None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:14.747799 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6950401-83b1-46f0-adb2-621fcfec4f0c service cinder] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:14.748291 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80719993-1559-4418-8668-dd242be9d0b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea647438ea1c438987f28cbe39c3ff2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:14.748708 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80719993-1559-4418-8668-dd242be9d0b7 service cinder] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:14.748989 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80719993-1559-4418-8668-dd242be9d0b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:14.749262 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80719993-1559-4418-8668-dd242be9d0b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:14.751094 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-80719993-1559-4418-8668-dd242be9d0b7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:44:14.757570 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6950401-83b1-46f0-adb2-621fcfec4f0c service cinder] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:14.761590 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82290427-d677-4de2-a2dd-285405218e82 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea647438ea1c438987f28cbe39c3ff2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:14.762541 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82290427-d677-4de2-a2dd-285405218e82 service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:14.762929 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82290427-d677-4de2-a2dd-285405218e82 service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:14.763309 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82290427-d677-4de2-a2dd-285405218e82 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:14.779187 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82290427-d677-4de2-a2dd-285405218e82 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:14.781182 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82290427-d677-4de2-a2dd-285405218e82 service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:14.792429 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1402/2771] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:44:14 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:44:14.826951 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80719993-1559-4418-8668-dd242be9d0b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:14.828423 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80719993-1559-4418-8668-dd242be9d0b7 service cinder] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:14.840603 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1370/2772] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:44:14 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:44:16.072915 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a75023-02a4-41b5-872e-d58441b38999 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:16.073375 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a75023-02a4-41b5-872e-d58441b38999 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:16.073466 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a75023-02a4-41b5-872e-d58441b38999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:16.090532 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-90a75023-02a4-41b5-872e-d58441b38999 None None] MFA Rules not processed for user `f7ad5ae70939416e8157693e02997a58`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:44:16.091877 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-90a75023-02a4-41b5-872e-d58441b38999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:44:16.137259 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:44:16.149338 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1403/2773] 10.222.0.118 () {58 vars in 1014 bytes} [Thu Jul 14 15:44:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:44:16.199967 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80719993-1559-4418-8668-dd242be9d0b7 service cinder] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:16.201626 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-80719993-1559-4418-8668-dd242be9d0b7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:44:16.284283 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80719993-1559-4418-8668-dd242be9d0b7 service cinder] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:16.289449 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e5216a-2f12-41ee-bd88-b55c11a2774c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b672a6a601584d2d826147069e90a10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:16.290139 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e5216a-2f12-41ee-bd88-b55c11a2774c service swift] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:16.290420 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e5216a-2f12-41ee-bd88-b55c11a2774c service swift] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:16.291461 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e5216a-2f12-41ee-bd88-b55c11a2774c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:16.304074 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e5216a-2f12-41ee-bd88-b55c11a2774c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:16.308061 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e5216a-2f12-41ee-bd88-b55c11a2774c service swift] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:16.319556 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1371/2774] 10.222.0.118 () {60 vars in 1389 bytes} [Thu Jul 14 15:44:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 15:44:16.852810 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e248ef4-3d57-4a7c-964f-0dd35d2ded73 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:16.853189 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e248ef4-3d57-4a7c-964f-0dd35d2ded73 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:16.853486 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e248ef4-3d57-4a7c-964f-0dd35d2ded73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:16.872839 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-3e248ef4-3d57-4a7c-964f-0dd35d2ded73 None None] MFA Rules not processed for user `f7ad5ae70939416e8157693e02997a58`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:44:16.874179 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-3e248ef4-3d57-4a7c-964f-0dd35d2ded73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:44:16.881317 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1404/2775] 10.222.0.118 () {58 vars in 972 bytes} [Thu Jul 14 15:44:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:44:16.893433 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e5216a-2f12-41ee-bd88-b55c11a2774c service swift] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:16.904435 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e5216a-2f12-41ee-bd88-b55c11a2774c service swift] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:16.909494 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f4d9d9-4d0a-4ab5-9993-4e26b795d170 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b672a6a601584d2d826147069e90a10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:16.910165 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f4d9d9-4d0a-4ab5-9993-4e26b795d170 service swift] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:16.910447 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f4d9d9-4d0a-4ab5-9993-4e26b795d170 service swift] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:16.910721 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f4d9d9-4d0a-4ab5-9993-4e26b795d170 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:16.918774 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f4d9d9-4d0a-4ab5-9993-4e26b795d170 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:16.920983 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f4d9d9-4d0a-4ab5-9993-4e26b795d170 service swift] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:16.929045 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1372/2776] 10.222.0.118 () {60 vars in 1389 bytes} [Thu Jul 14 15:44:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 15:44:17.121540 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac77635-f199-41e8-9484-e4db9341b6bf None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:17.122069 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac77635-f199-41e8-9484-e4db9341b6bf None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:17.122298 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac77635-f199-41e8-9484-e4db9341b6bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:17.139589 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-0ac77635-f199-41e8-9484-e4db9341b6bf None None] MFA Rules not processed for user `f7ad5ae70939416e8157693e02997a58`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:44:17.140791 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-0ac77635-f199-41e8-9484-e4db9341b6bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:44:17.147942 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1405/2777] 10.222.0.118 () {58 vars in 1014 bytes} [Thu Jul 14 15:44:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:44:17.160217 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f4d9d9-4d0a-4ab5-9993-4e26b795d170 service swift] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:17.171405 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f4d9d9-4d0a-4ab5-9993-4e26b795d170 service swift] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:17.176466 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f878ad53-f961-4212-99ac-18cf4d3fca8e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b672a6a601584d2d826147069e90a10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:17.177101 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f878ad53-f961-4212-99ac-18cf4d3fca8e service swift] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:17.177376 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f878ad53-f961-4212-99ac-18cf4d3fca8e service swift] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:17.177649 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f878ad53-f961-4212-99ac-18cf4d3fca8e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:17.186154 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f878ad53-f961-4212-99ac-18cf4d3fca8e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:17.187719 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f878ad53-f961-4212-99ac-18cf4d3fca8e service swift] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:17.195750 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1373/2778] 10.222.0.118 () {60 vars in 1389 bytes} [Thu Jul 14 15:44:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 15:44:17.514827 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f009d09-a867-4192-96fa-d6ea9606e2a4 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:17.515088 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f009d09-a867-4192-96fa-d6ea9606e2a4 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:17.515823 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f009d09-a867-4192-96fa-d6ea9606e2a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:17.539038 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-4f009d09-a867-4192-96fa-d6ea9606e2a4 None None] MFA Rules not processed for user `f7ad5ae70939416e8157693e02997a58`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:44:17.540323 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-4f009d09-a867-4192-96fa-d6ea9606e2a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:44:17.550361 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1406/2779] 10.222.0.118 () {58 vars in 972 bytes} [Thu Jul 14 15:44:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:44:17.563072 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f878ad53-f961-4212-99ac-18cf4d3fca8e service swift] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:17.576361 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f878ad53-f961-4212-99ac-18cf4d3fca8e service swift] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:17.582523 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf7cc94-10fc-4dbb-9cf7-32bf15cf329f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b672a6a601584d2d826147069e90a10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:17.583337 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf7cc94-10fc-4dbb-9cf7-32bf15cf329f service swift] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:17.583618 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf7cc94-10fc-4dbb-9cf7-32bf15cf329f service swift] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:17.583925 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf7cc94-10fc-4dbb-9cf7-32bf15cf329f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:17.596182 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf7cc94-10fc-4dbb-9cf7-32bf15cf329f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:17.598334 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf7cc94-10fc-4dbb-9cf7-32bf15cf329f service swift] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:17.607082 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1374/2780] 10.222.0.118 () {60 vars in 1389 bytes} [Thu Jul 14 15:44:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 15:44:19.679648 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f009d09-a867-4192-96fa-d6ea9606e2a4 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:19.681057 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-4f009d09-a867-4192-96fa-d6ea9606e2a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:44:19.752720 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f009d09-a867-4192-96fa-d6ea9606e2a4 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:19.757361 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66773a7c-db0c-4cb1-abac-bc2037090f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:19.758264 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66773a7c-db0c-4cb1-abac-bc2037090f0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:19.758550 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66773a7c-db0c-4cb1-abac-bc2037090f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:19.758822 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66773a7c-db0c-4cb1-abac-bc2037090f0e admin admin] PATH_INFO: `/v3/users/d07e0a9b6d8d4e29820210ae2c92a920` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:19.760034 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66773a7c-db0c-4cb1-abac-bc2037090f0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d07e0a9b6d8d4e29820210ae2c92a920)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:19.762007 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66773a7c-db0c-4cb1-abac-bc2037090f0e admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:19.808112 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-66773a7c-db0c-4cb1-abac-bc2037090f0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd07e0a9b6d8d4e29820210ae2c92a920'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:19.815553 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-66773a7c-db0c-4cb1-abac-bc2037090f0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd07e0a9b6d8d4e29820210ae2c92a920'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:19.816220 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-66773a7c-db0c-4cb1-abac-bc2037090f0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd07e0a9b6d8d4e29820210ae2c92a920'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:19.816831 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-66773a7c-db0c-4cb1-abac-bc2037090f0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd07e0a9b6d8d4e29820210ae2c92a920'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:19.829696 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-66773a7c-db0c-4cb1-abac-bc2037090f0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd07e0a9b6d8d4e29820210ae2c92a920'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:19.842657 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf7cc94-10fc-4dbb-9cf7-32bf15cf329f service swift] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:19.844199 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-cdf7cc94-10fc-4dbb-9cf7-32bf15cf329f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:44:19.845954 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1407/2781] 10.222.0.118 () {58 vars in 1228 bytes} [Thu Jul 14 15:44:19 2022] DELETE /identity/v3/users/d07e0a9b6d8d4e29820210ae2c92a920 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:44:19.851203 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc77690-6b13-413d-b5c1-ae56f8c7b55c None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:19.851576 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc77690-6b13-413d-b5c1-ae56f8c7b55c None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:19.851922 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc77690-6b13-413d-b5c1-ae56f8c7b55c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:19.859959 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf7cc94-10fc-4dbb-9cf7-32bf15cf329f service swift] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:19.873994 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:44:19.875833 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-5fc77690-6b13-413d-b5c1-ae56f8c7b55c None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:44:19.876923 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-5fc77690-6b13-413d-b5c1-ae56f8c7b55c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:44:19.927029 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc2f634-16b5-42db-8386-31cdb7c596c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:19.927908 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc2f634-16b5-42db-8386-31cdb7c596c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:19.928194 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc2f634-16b5-42db-8386-31cdb7c596c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:19.928471 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc2f634-16b5-42db-8386-31cdb7c596c1 admin admin] PATH_INFO: `/v3/users/5c8b9eff12894ebb8cd21fccffd2ea8f` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:19.929680 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc2f634-16b5-42db-8386-31cdb7c596c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c8b9eff12894ebb8cd21fccffd2ea8f)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:19.931842 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc2f634-16b5-42db-8386-31cdb7c596c1 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:19.934403 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:44:19.956388 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1408/2782] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:44:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:44:19.963274 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc77690-6b13-413d-b5c1-ae56f8c7b55c None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:19.964971 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-5fc77690-6b13-413d-b5c1-ae56f8c7b55c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:44:19.993403 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-7cc2f634-16b5-42db-8386-31cdb7c596c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c8b9eff12894ebb8cd21fccffd2ea8f'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:20.000964 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-7cc2f634-16b5-42db-8386-31cdb7c596c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c8b9eff12894ebb8cd21fccffd2ea8f'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:20.001833 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-7cc2f634-16b5-42db-8386-31cdb7c596c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c8b9eff12894ebb8cd21fccffd2ea8f'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:20.002487 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-7cc2f634-16b5-42db-8386-31cdb7c596c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c8b9eff12894ebb8cd21fccffd2ea8f'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:20.016273 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-7cc2f634-16b5-42db-8386-31cdb7c596c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c8b9eff12894ebb8cd21fccffd2ea8f'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:20.031809 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1375/2783] 10.222.0.118 () {58 vars in 1228 bytes} [Thu Jul 14 15:44:19 2022] DELETE /identity/v3/users/5c8b9eff12894ebb8cd21fccffd2ea8f => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:44:20.037323 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ccda29-8153-412a-a161-a4378feedfc7 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:20.038003 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ccda29-8153-412a-a161-a4378feedfc7 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:20.038492 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ccda29-8153-412a-a161-a4378feedfc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:20.047227 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc77690-6b13-413d-b5c1-ae56f8c7b55c None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:20.064787 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-b7ccda29-8153-412a-a161-a4378feedfc7 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:44:20.066261 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-b7ccda29-8153-412a-a161-a4378feedfc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:44:20.104258 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c368c7cf-827c-40b8-8eb8-cea372228f66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b650be8114b64df0ac88441f1c50b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:20.104258 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c368c7cf-827c-40b8-8eb8-cea372228f66 service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:20.104258 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c368c7cf-827c-40b8-8eb8-cea372228f66 service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:20.104258 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c368c7cf-827c-40b8-8eb8-cea372228f66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:20.105568 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-c368c7cf-827c-40b8-8eb8-cea372228f66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:44:20.142180 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1376/2784] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:44:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:44:20.151713 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ccda29-8153-412a-a161-a4378feedfc7 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:20.158042 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-b7ccda29-8153-412a-a161-a4378feedfc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:44:20.171774 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ccda29-8153-412a-a161-a4378feedfc7 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:20.175666 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cdfd4d-3172-46ab-a4a1-1b8ae4661970 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b650be8114b64df0ac88441f1c50b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:20.176319 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cdfd4d-3172-46ab-a4a1-1b8ae4661970 service neutron] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:20.176600 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cdfd4d-3172-46ab-a4a1-1b8ae4661970 service neutron] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:20.176874 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cdfd4d-3172-46ab-a4a1-1b8ae4661970 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:20.188228 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cdfd4d-3172-46ab-a4a1-1b8ae4661970 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:20.189683 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cdfd4d-3172-46ab-a4a1-1b8ae4661970 service neutron] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:20.199595 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1377/2785] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:44:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:44:20.203717 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c368c7cf-827c-40b8-8eb8-cea372228f66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:20.205170 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c368c7cf-827c-40b8-8eb8-cea372228f66 service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:20.215570 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1409/2786] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:44:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:44:20.440349 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cdfd4d-3172-46ab-a4a1-1b8ae4661970 service neutron] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:20.441850 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-a4cdfd4d-3172-46ab-a4a1-1b8ae4661970 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:44:20.461283 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cdfd4d-3172-46ab-a4a1-1b8ae4661970 service neutron] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:20.467212 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6b2c01-c227-4186-9058-ce8dba0a8e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:20.468075 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b2c01-c227-4186-9058-ce8dba0a8e11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:20.468348 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b2c01-c227-4186-9058-ce8dba0a8e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:20.468624 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b2c01-c227-4186-9058-ce8dba0a8e11 admin admin] PATH_INFO: `/v3/projects/8cdfc5df39e34df994ecba69009fe0f4` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:20.469910 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6b2c01-c227-4186-9058-ce8dba0a8e11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8cdfc5df39e34df994ecba69009fe0f4)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:20.471942 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6b2c01-c227-4186-9058-ce8dba0a8e11 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:20.492659 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:44:20.532087 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-ad6b2c01-c227-4186-9058-ce8dba0a8e11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8cdfc5df39e34df994ecba69009fe0f4', 'request_id': 'req-ad6b2c01-c227-4186-9058-ce8dba0a8e11'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:20.540543 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-ad6b2c01-c227-4186-9058-ce8dba0a8e11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8cdfc5df39e34df994ecba69009fe0f4', 'request_id': 'req-ad6b2c01-c227-4186-9058-ce8dba0a8e11'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:20.547501 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-ad6b2c01-c227-4186-9058-ce8dba0a8e11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8cdfc5df39e34df994ecba69009fe0f4', 'request_id': 'req-ad6b2c01-c227-4186-9058-ce8dba0a8e11'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:20.551796 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c368c7cf-827c-40b8-8eb8-cea372228f66 service neutron] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:20.553745 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-c368c7cf-827c-40b8-8eb8-cea372228f66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:44:20.566127 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-ad6b2c01-c227-4186-9058-ce8dba0a8e11 admin admin] The token cache is being invalidate because project 8cdfc5df39e34df994ecba69009fe0f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:44:20.566502 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-ad6b2c01-c227-4186-9058-ce8dba0a8e11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:20.567233 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-ad6b2c01-c227-4186-9058-ce8dba0a8e11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:20.568924 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1378/2787] 10.222.0.118 () {58 vars in 1237 bytes} [Thu Jul 14 15:44:20 2022] DELETE /identity/v3/projects/8cdfc5df39e34df994ecba69009fe0f4 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:44:20.580569 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c368c7cf-827c-40b8-8eb8-cea372228f66 service neutron] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:20.657817 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49d7161-9523-42bf-b2f4-431dfab31721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:20.658844 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49d7161-9523-42bf-b2f4-431dfab31721 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:20.659120 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49d7161-9523-42bf-b2f4-431dfab31721 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:20.659396 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49d7161-9523-42bf-b2f4-431dfab31721 admin admin] PATH_INFO: `/v3/projects/67b8eaf7f8bb407e8dc62e57f95f4d15` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:20.660634 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49d7161-9523-42bf-b2f4-431dfab31721 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67b8eaf7f8bb407e8dc62e57f95f4d15)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:20.662646 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49d7161-9523-42bf-b2f4-431dfab31721 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:20.664401 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:44:20.731572 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-f49d7161-9523-42bf-b2f4-431dfab31721 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67b8eaf7f8bb407e8dc62e57f95f4d15', 'request_id': 'req-f49d7161-9523-42bf-b2f4-431dfab31721'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:20.738882 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-f49d7161-9523-42bf-b2f4-431dfab31721 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67b8eaf7f8bb407e8dc62e57f95f4d15', 'request_id': 'req-f49d7161-9523-42bf-b2f4-431dfab31721'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:20.746835 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-f49d7161-9523-42bf-b2f4-431dfab31721 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67b8eaf7f8bb407e8dc62e57f95f4d15', 'request_id': 'req-f49d7161-9523-42bf-b2f4-431dfab31721'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:20.761421 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-f49d7161-9523-42bf-b2f4-431dfab31721 admin admin] The token cache is being invalidate because project 67b8eaf7f8bb407e8dc62e57f95f4d15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:44:20.761711 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-f49d7161-9523-42bf-b2f4-431dfab31721 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:20.762389 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-f49d7161-9523-42bf-b2f4-431dfab31721 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:20.764547 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1410/2788] 10.222.0.118 () {58 vars in 1237 bytes} [Thu Jul 14 15:44:20 2022] DELETE /identity/v3/projects/67b8eaf7f8bb407e8dc62e57f95f4d15 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:44:20.768714 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6b2c01-c227-4186-9058-ce8dba0a8e11 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:20.770195 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-ad6b2c01-c227-4186-9058-ce8dba0a8e11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:44:20.784181 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6b2c01-c227-4186-9058-ce8dba0a8e11 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:20.846638 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e146fa-4b93-402a-a54d-07ed03d1bd1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:20.847708 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e146fa-4b93-402a-a54d-07ed03d1bd1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:20.848093 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e146fa-4b93-402a-a54d-07ed03d1bd1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:20.848471 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e146fa-4b93-402a-a54d-07ed03d1bd1f admin admin] PATH_INFO: `/v3/users/7ba08a931f6c4ee29f440472441148b1` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:20.850180 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e146fa-4b93-402a-a54d-07ed03d1bd1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ba08a931f6c4ee29f440472441148b1)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:20.852769 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e146fa-4b93-402a-a54d-07ed03d1bd1f admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:20.904214 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-a4e146fa-4b93-402a-a54d-07ed03d1bd1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ba08a931f6c4ee29f440472441148b1'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:20.911405 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-a4e146fa-4b93-402a-a54d-07ed03d1bd1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ba08a931f6c4ee29f440472441148b1'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:20.912005 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-a4e146fa-4b93-402a-a54d-07ed03d1bd1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ba08a931f6c4ee29f440472441148b1'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:20.912612 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-a4e146fa-4b93-402a-a54d-07ed03d1bd1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ba08a931f6c4ee29f440472441148b1'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:20.924497 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-a4e146fa-4b93-402a-a54d-07ed03d1bd1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ba08a931f6c4ee29f440472441148b1'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:20.938682 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1379/2789] 10.222.0.118 () {58 vars in 1228 bytes} [Thu Jul 14 15:44:20 2022] DELETE /identity/v3/users/7ba08a931f6c4ee29f440472441148b1 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:44:21.234056 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49d7161-9523-42bf-b2f4-431dfab31721 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:21.235567 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-f49d7161-9523-42bf-b2f4-431dfab31721 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:44:21.251025 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49d7161-9523-42bf-b2f4-431dfab31721 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:21.328176 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fd048c-bb17-4ada-a2ae-f93ea9ff85b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:21.329116 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fd048c-bb17-4ada-a2ae-f93ea9ff85b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:21.329866 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fd048c-bb17-4ada-a2ae-f93ea9ff85b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:21.330345 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fd048c-bb17-4ada-a2ae-f93ea9ff85b8 admin admin] PATH_INFO: `/v3/projects/b51d1542d8cd44418b46c020f62303fa` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:21.332324 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fd048c-bb17-4ada-a2ae-f93ea9ff85b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b51d1542d8cd44418b46c020f62303fa)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:21.334995 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fd048c-bb17-4ada-a2ae-f93ea9ff85b8 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:21.386712 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-99fd048c-bb17-4ada-a2ae-f93ea9ff85b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b51d1542d8cd44418b46c020f62303fa', 'request_id': 'req-99fd048c-bb17-4ada-a2ae-f93ea9ff85b8'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:21.392787 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-99fd048c-bb17-4ada-a2ae-f93ea9ff85b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b51d1542d8cd44418b46c020f62303fa', 'request_id': 'req-99fd048c-bb17-4ada-a2ae-f93ea9ff85b8'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:21.399208 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-99fd048c-bb17-4ada-a2ae-f93ea9ff85b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b51d1542d8cd44418b46c020f62303fa', 'request_id': 'req-99fd048c-bb17-4ada-a2ae-f93ea9ff85b8'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:21.412450 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-99fd048c-bb17-4ada-a2ae-f93ea9ff85b8 admin admin] The token cache is being invalidate because project b51d1542d8cd44418b46c020f62303fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:44:21.412736 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-99fd048c-bb17-4ada-a2ae-f93ea9ff85b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:21.413356 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-99fd048c-bb17-4ada-a2ae-f93ea9ff85b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:21.415184 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1411/2790] 10.222.0.118 () {58 vars in 1237 bytes} [Thu Jul 14 15:44:21 2022] DELETE /identity/v3/projects/b51d1542d8cd44418b46c020f62303fa => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:44:21.423261 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0ee1bc-e19d-47dc-aa95-55b25e6b9269 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:21.423549 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0ee1bc-e19d-47dc-aa95-55b25e6b9269 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:21.423826 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0ee1bc-e19d-47dc-aa95-55b25e6b9269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:21.443296 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-1b0ee1bc-e19d-47dc-aa95-55b25e6b9269 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:44:21.444547 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-1b0ee1bc-e19d-47dc-aa95-55b25e6b9269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:44:21.465093 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:44:21.517664 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1380/2791] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:44:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:44:21.528141 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9eaed3-347c-4263-8d2b-33d86e9286a7 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:21.528694 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9eaed3-347c-4263-8d2b-33d86e9286a7 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:21.529102 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9eaed3-347c-4263-8d2b-33d86e9286a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:21.550462 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-4f9eaed3-347c-4263-8d2b-33d86e9286a7 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:44:21.551686 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-4f9eaed3-347c-4263-8d2b-33d86e9286a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:44:21.560565 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1412/2792] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:44:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:44:21.565241 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0ee1bc-e19d-47dc-aa95-55b25e6b9269 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:21.575881 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0ee1bc-e19d-47dc-aa95-55b25e6b9269 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:21.580529 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b91540b-7740-40b9-b00b-dba31d835990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:21.581191 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b91540b-7740-40b9-b00b-dba31d835990 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:21.581474 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b91540b-7740-40b9-b00b-dba31d835990 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:21.581751 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b91540b-7740-40b9-b00b-dba31d835990 admin admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:21.582546 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b91540b-7740-40b9-b00b-dba31d835990 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:44:21.582899 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b91540b-7740-40b9-b00b-dba31d835990 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:21.584648 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b91540b-7740-40b9-b00b-dba31d835990 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:21.597538 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1381/2793] 10.222.0.118 () {58 vars in 1157 bytes} [Thu Jul 14 15:44:21 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:44:21.601939 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9eaed3-347c-4263-8d2b-33d86e9286a7 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:21.611896 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9eaed3-347c-4263-8d2b-33d86e9286a7 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:21.617166 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0021ea-fc40-49fd-900f-01a984f58259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:21.617811 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0021ea-fc40-49fd-900f-01a984f58259 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:21.618131 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0021ea-fc40-49fd-900f-01a984f58259 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:21.618409 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0021ea-fc40-49fd-900f-01a984f58259 admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:21.619096 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0021ea-fc40-49fd-900f-01a984f58259 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:21.620992 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0021ea-fc40-49fd-900f-01a984f58259 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:21.632458 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:44:21.650915 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1413/2794] 10.222.0.118 () {60 vars in 1157 bytes} [Thu Jul 14 15:44:21 2022] POST /identity/v3/projects => generated 374 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:44:21.655606 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b91540b-7740-40b9-b00b-dba31d835990 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:21.666317 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b91540b-7740-40b9-b00b-dba31d835990 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:21.729160 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e16890-d4f0-463c-b632-cb795ef23883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:21.729947 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e16890-d4f0-463c-b632-cb795ef23883 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:21.730322 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e16890-d4f0-463c-b632-cb795ef23883 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:21.730699 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e16890-d4f0-463c-b632-cb795ef23883 admin admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:21.731656 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e16890-d4f0-463c-b632-cb795ef23883 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:21.734316 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e16890-d4f0-463c-b632-cb795ef23883 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:21.759057 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1382/2795] 10.222.0.118 () {60 vars in 1148 bytes} [Thu Jul 14 15:44:21 2022] POST /identity/v3/users => generated 288 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:44:21.763654 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0021ea-fc40-49fd-900f-01a984f58259 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:21.775027 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0021ea-fc40-49fd-900f-01a984f58259 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:21.781162 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129b5dba-0f73-4f07-b269-b0281f3d55b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:21.781817 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129b5dba-0f73-4f07-b269-b0281f3d55b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:21.782130 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129b5dba-0f73-4f07-b269-b0281f3d55b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:21.782406 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129b5dba-0f73-4f07-b269-b0281f3d55b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:21.783133 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129b5dba-0f73-4f07-b269-b0281f3d55b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:21.784734 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129b5dba-0f73-4f07-b269-b0281f3d55b3 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:21.796607 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1414/2796] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:44:21 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:44:21.801325 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e16890-d4f0-463c-b632-cb795ef23883 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:21.812602 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e16890-d4f0-463c-b632-cb795ef23883 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:21.817276 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372327cd-e31e-4f5d-9248-3a229e211e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:21.818077 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372327cd-e31e-4f5d-9248-3a229e211e99 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:21.818341 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372327cd-e31e-4f5d-9248-3a229e211e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:21.818620 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372327cd-e31e-4f5d-9248-3a229e211e99 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:21.819449 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372327cd-e31e-4f5d-9248-3a229e211e99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:21.821139 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372327cd-e31e-4f5d-9248-3a229e211e99 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:21.832403 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1383/2797] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:44:21 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:44:21.836556 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129b5dba-0f73-4f07-b269-b0281f3d55b3 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:21.846912 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129b5dba-0f73-4f07-b269-b0281f3d55b3 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:21.852486 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dba87d-541f-4e18-b95f-d59f12ea40bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:21.853596 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dba87d-541f-4e18-b95f-d59f12ea40bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:21.853955 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dba87d-541f-4e18-b95f-d59f12ea40bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:21.854304 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dba87d-541f-4e18-b95f-d59f12ea40bc admin admin] PATH_INFO: `/v3/projects/22b7c000e72845498904e740f775d18d/users/9f2d1efbd5fd44669581bd6a33c01cf7/roles/4abcf5e5e7cd4b53ae1828fec6550d53` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:21.873904 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dba87d-541f-4e18-b95f-d59f12ea40bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=22b7c000e72845498904e740f775d18d, user_id=9f2d1efbd5fd44669581bd6a33c01cf7, role_id=4abcf5e5e7cd4b53ae1828fec6550d53)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:21.876604 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dba87d-541f-4e18-b95f-d59f12ea40bc admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:21.891277 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1415/2798] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:44:21 2022] PUT /identity/v3/projects/22b7c000e72845498904e740f775d18d/users/9f2d1efbd5fd44669581bd6a33c01cf7/roles/4abcf5e5e7cd4b53ae1828fec6550d53 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:44:21.897139 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b29a229-14de-4f83-aaf7-cbac676895c9 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:21.897601 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b29a229-14de-4f83-aaf7-cbac676895c9 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:21.897698 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b29a229-14de-4f83-aaf7-cbac676895c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:21.915784 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-5b29a229-14de-4f83-aaf7-cbac676895c9 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:44:21.917044 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-5b29a229-14de-4f83-aaf7-cbac676895c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:44:21.983676 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1384/2799] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:44:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:44:21.994440 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dba87d-541f-4e18-b95f-d59f12ea40bc admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:21.996180 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-f8dba87d-541f-4e18-b95f-d59f12ea40bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:44:22.056643 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dba87d-541f-4e18-b95f-d59f12ea40bc admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:22.061199 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8329e02-a808-412e-8412-630793364131 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b650be8114b64df0ac88441f1c50b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:22.062111 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8329e02-a808-412e-8412-630793364131 service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:22.062470 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8329e02-a808-412e-8412-630793364131 service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:22.062860 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8329e02-a808-412e-8412-630793364131 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:22.073259 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8329e02-a808-412e-8412-630793364131 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:22.074758 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8329e02-a808-412e-8412-630793364131 service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:22.085272 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1416/2800] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:44:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:44:26.461814 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c3cc5f-6e45-4e88-8039-b3088f0fd119 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:26.462567 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c3cc5f-6e45-4e88-8039-b3088f0fd119 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:26.462567 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c3cc5f-6e45-4e88-8039-b3088f0fd119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:26.494031 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-48c3cc5f-6e45-4e88-8039-b3088f0fd119 None None] MFA Rules not processed for user `9f2d1efbd5fd44669581bd6a33c01cf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:44:26.495286 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-48c3cc5f-6e45-4e88-8039-b3088f0fd119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:44:26.520511 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:44:26.583599 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1385/2801] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:44:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:44:26.589685 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8329e02-a808-412e-8412-630793364131 service neutron] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:26.601246 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8329e02-a808-412e-8412-630793364131 service neutron] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:26.607093 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1fd0ad-1ddf-446c-bebb-96019d2bb422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:26.608124 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1fd0ad-1ddf-446c-bebb-96019d2bb422 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:26.608485 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1fd0ad-1ddf-446c-bebb-96019d2bb422 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:26.608874 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1fd0ad-1ddf-446c-bebb-96019d2bb422 admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:26.609708 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1fd0ad-1ddf-446c-bebb-96019d2bb422 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:26.612108 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1fd0ad-1ddf-446c-bebb-96019d2bb422 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:26.644810 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1417/2802] 10.222.0.118 () {60 vars in 1157 bytes} [Thu Jul 14 15:44:26 2022] POST /identity/v3/projects => generated 374 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:44:26.649207 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c3cc5f-6e45-4e88-8039-b3088f0fd119 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:26.665444 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c3cc5f-6e45-4e88-8039-b3088f0fd119 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:26.738224 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df82e2c5-266f-4c2a-b81a-7d65c3fc3d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:26.738930 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df82e2c5-266f-4c2a-b81a-7d65c3fc3d4d admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:26.739539 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df82e2c5-266f-4c2a-b81a-7d65c3fc3d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:26.739861 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df82e2c5-266f-4c2a-b81a-7d65c3fc3d4d admin admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:26.740593 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df82e2c5-266f-4c2a-b81a-7d65c3fc3d4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:26.742672 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df82e2c5-266f-4c2a-b81a-7d65c3fc3d4d admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:26.764775 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1386/2803] 10.222.0.118 () {60 vars in 1148 bytes} [Thu Jul 14 15:44:26 2022] POST /identity/v3/users => generated 294 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:44:26.769055 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1fd0ad-1ddf-446c-bebb-96019d2bb422 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:26.780407 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1fd0ad-1ddf-446c-bebb-96019d2bb422 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:26.785264 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58563f00-5c62-48cd-b939-31c9734277a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:26.785938 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58563f00-5c62-48cd-b939-31c9734277a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:26.786246 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58563f00-5c62-48cd-b939-31c9734277a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:26.786531 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58563f00-5c62-48cd-b939-31c9734277a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:26.787246 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58563f00-5c62-48cd-b939-31c9734277a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:26.789219 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58563f00-5c62-48cd-b939-31c9734277a3 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:26.802885 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1418/2804] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:44:26 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:44:26.807349 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df82e2c5-266f-4c2a-b81a-7d65c3fc3d4d admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:26.818434 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df82e2c5-266f-4c2a-b81a-7d65c3fc3d4d admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:26.823155 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af11d3a-eb17-4718-b5e3-a250cd99f77f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:26.824071 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af11d3a-eb17-4718-b5e3-a250cd99f77f admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:26.824345 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af11d3a-eb17-4718-b5e3-a250cd99f77f admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:26.824617 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af11d3a-eb17-4718-b5e3-a250cd99f77f admin admin] PATH_INFO: `/v3/projects/9b7c221ddc3745afa9e214214cc3a6ba/users/6e3d7ca5f6ce447484b64000c290ea6b/roles/3b880cef7dcf4baf87b50f8610c0c56e` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:26.841879 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af11d3a-eb17-4718-b5e3-a250cd99f77f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b7c221ddc3745afa9e214214cc3a6ba, user_id=6e3d7ca5f6ce447484b64000c290ea6b, role_id=3b880cef7dcf4baf87b50f8610c0c56e)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:26.844843 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af11d3a-eb17-4718-b5e3-a250cd99f77f admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:26.860684 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1387/2805] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:44:26 2022] PUT /identity/v3/projects/9b7c221ddc3745afa9e214214cc3a6ba/users/6e3d7ca5f6ce447484b64000c290ea6b/roles/3b880cef7dcf4baf87b50f8610c0c56e => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:44:26.865644 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58563f00-5c62-48cd-b939-31c9734277a3 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:26.876715 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58563f00-5c62-48cd-b939-31c9734277a3 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:26.945151 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74ce196-bedd-4ea6-bc91-45d58c94a7cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:26.946099 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ce196-bedd-4ea6-bc91-45d58c94a7cb admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:26.946527 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ce196-bedd-4ea6-bc91-45d58c94a7cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:26.946882 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ce196-bedd-4ea6-bc91-45d58c94a7cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:26.947854 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74ce196-bedd-4ea6-bc91-45d58c94a7cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:26.949554 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74ce196-bedd-4ea6-bc91-45d58c94a7cb admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:26.960759 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1419/2806] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:44:26 2022] GET /identity/v3/roles => generated 1427 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:44:26.965948 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af11d3a-eb17-4718-b5e3-a250cd99f77f admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:26.976698 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af11d3a-eb17-4718-b5e3-a250cd99f77f admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:26.982809 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba62c3fb-472f-4418-8fc7-29eea0bb2582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:26.984038 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba62c3fb-472f-4418-8fc7-29eea0bb2582 admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:26.984426 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba62c3fb-472f-4418-8fc7-29eea0bb2582 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:26.984838 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba62c3fb-472f-4418-8fc7-29eea0bb2582 admin admin] PATH_INFO: `/v3/projects/9b7c221ddc3745afa9e214214cc3a6ba/users/6e3d7ca5f6ce447484b64000c290ea6b/roles/3b880cef7dcf4baf87b50f8610c0c56e` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:26.988012 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba62c3fb-472f-4418-8fc7-29eea0bb2582 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b7c221ddc3745afa9e214214cc3a6ba, user_id=6e3d7ca5f6ce447484b64000c290ea6b, role_id=3b880cef7dcf4baf87b50f8610c0c56e)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:26.991115 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba62c3fb-472f-4418-8fc7-29eea0bb2582 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:27.001607 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1388/2807] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:44:26 2022] PUT /identity/v3/projects/9b7c221ddc3745afa9e214214cc3a6ba/users/6e3d7ca5f6ce447484b64000c290ea6b/roles/3b880cef7dcf4baf87b50f8610c0c56e => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:44:27.721143 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74ce196-bedd-4ea6-bc91-45d58c94a7cb admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:27.723127 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-c74ce196-bedd-4ea6-bc91-45d58c94a7cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:44:27.738094 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74ce196-bedd-4ea6-bc91-45d58c94a7cb admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:27.765664 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:44:27.819278 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928cbb28-ebf5-46c5-9fa9-6153f13173d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:27.820570 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928cbb28-ebf5-46c5-9fa9-6153f13173d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:27.821038 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928cbb28-ebf5-46c5-9fa9-6153f13173d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:27.821505 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928cbb28-ebf5-46c5-9fa9-6153f13173d8 admin admin] PATH_INFO: `/v3/users/ee5635a4d3b744ffa92778ca56c76614` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:27.823542 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928cbb28-ebf5-46c5-9fa9-6153f13173d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee5635a4d3b744ffa92778ca56c76614)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:27.826245 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928cbb28-ebf5-46c5-9fa9-6153f13173d8 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:27.889663 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-928cbb28-ebf5-46c5-9fa9-6153f13173d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee5635a4d3b744ffa92778ca56c76614'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:27.898123 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-928cbb28-ebf5-46c5-9fa9-6153f13173d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee5635a4d3b744ffa92778ca56c76614'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:27.901152 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-928cbb28-ebf5-46c5-9fa9-6153f13173d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee5635a4d3b744ffa92778ca56c76614'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:27.902093 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-928cbb28-ebf5-46c5-9fa9-6153f13173d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee5635a4d3b744ffa92778ca56c76614'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:27.920417 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-928cbb28-ebf5-46c5-9fa9-6153f13173d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee5635a4d3b744ffa92778ca56c76614'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:27.939541 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1420/2808] 10.222.0.118 () {58 vars in 1228 bytes} [Thu Jul 14 15:44:27 2022] DELETE /identity/v3/users/ee5635a4d3b744ffa92778ca56c76614 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:44:27.946277 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaa7795-2da0-4660-ad91-2843646d7c3a None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:27.947032 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaa7795-2da0-4660-ad91-2843646d7c3a None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:27.947608 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaa7795-2da0-4660-ad91-2843646d7c3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:27.970529 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-cbaa7795-2da0-4660-ad91-2843646d7c3a None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:44:27.972441 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-cbaa7795-2da0-4660-ad91-2843646d7c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:44:28.054946 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1389/2809] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:44:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:44:28.064388 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928cbb28-ebf5-46c5-9fa9-6153f13173d8 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:28.066113 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-928cbb28-ebf5-46c5-9fa9-6153f13173d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:44:28.164344 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928cbb28-ebf5-46c5-9fa9-6153f13173d8 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:28.169112 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8730aa19-550e-4c36-83c3-7266208dcc51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b650be8114b64df0ac88441f1c50b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:28.170093 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8730aa19-550e-4c36-83c3-7266208dcc51 service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:28.170378 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8730aa19-550e-4c36-83c3-7266208dcc51 service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:28.170655 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8730aa19-550e-4c36-83c3-7266208dcc51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:28.188632 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8730aa19-550e-4c36-83c3-7266208dcc51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:28.189759 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8730aa19-550e-4c36-83c3-7266208dcc51 service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:28.204693 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1421/2810] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:44:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:44:28.519368 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaa7795-2da0-4660-ad91-2843646d7c3a None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:28.521547 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-cbaa7795-2da0-4660-ad91-2843646d7c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:44:28.536354 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaa7795-2da0-4660-ad91-2843646d7c3a None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:28.544873 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0526e1-7168-453e-a71f-e8e6827634b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:28.546365 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0526e1-7168-453e-a71f-e8e6827634b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:28.546877 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0526e1-7168-453e-a71f-e8e6827634b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:28.547240 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0526e1-7168-453e-a71f-e8e6827634b3 admin admin] PATH_INFO: `/v3/projects/b2da6f7e09e04504a51be958f176190a` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:28.548836 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0526e1-7168-453e-a71f-e8e6827634b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2da6f7e09e04504a51be958f176190a)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:28.551829 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0526e1-7168-453e-a71f-e8e6827634b3 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:28.562632 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:44:28.614987 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-bf0526e1-7168-453e-a71f-e8e6827634b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2da6f7e09e04504a51be958f176190a', 'request_id': 'req-bf0526e1-7168-453e-a71f-e8e6827634b3'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:28.625603 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-bf0526e1-7168-453e-a71f-e8e6827634b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2da6f7e09e04504a51be958f176190a', 'request_id': 'req-bf0526e1-7168-453e-a71f-e8e6827634b3'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:28.633237 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-bf0526e1-7168-453e-a71f-e8e6827634b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2da6f7e09e04504a51be958f176190a', 'request_id': 'req-bf0526e1-7168-453e-a71f-e8e6827634b3'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:28.656295 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-bf0526e1-7168-453e-a71f-e8e6827634b3 admin admin] The token cache is being invalidate because project b2da6f7e09e04504a51be958f176190a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:44:28.656787 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-bf0526e1-7168-453e-a71f-e8e6827634b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:28.657462 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-bf0526e1-7168-453e-a71f-e8e6827634b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:28.659330 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1390/2811] 10.222.0.118 () {58 vars in 1237 bytes} [Thu Jul 14 15:44:28 2022] DELETE /identity/v3/projects/b2da6f7e09e04504a51be958f176190a => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:44:28.663613 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8730aa19-550e-4c36-83c3-7266208dcc51 service neutron] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:28.673901 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8730aa19-550e-4c36-83c3-7266208dcc51 service neutron] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:28.740731 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:44:28.761995 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eb3e64-44b6-4dba-9d3a-4ad80efb9f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:28.762965 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eb3e64-44b6-4dba-9d3a-4ad80efb9f29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:28.763248 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eb3e64-44b6-4dba-9d3a-4ad80efb9f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:28.763523 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eb3e64-44b6-4dba-9d3a-4ad80efb9f29 admin admin] PATH_INFO: `/v3/users/3406b2733b0f402288effa2f3b8ad9a0` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:28.764830 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7eb3e64-44b6-4dba-9d3a-4ad80efb9f29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3406b2733b0f402288effa2f3b8ad9a0)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:28.766798 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7eb3e64-44b6-4dba-9d3a-4ad80efb9f29 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:28.832251 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-c7eb3e64-44b6-4dba-9d3a-4ad80efb9f29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3406b2733b0f402288effa2f3b8ad9a0'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:28.843104 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-c7eb3e64-44b6-4dba-9d3a-4ad80efb9f29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3406b2733b0f402288effa2f3b8ad9a0'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:28.844723 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-c7eb3e64-44b6-4dba-9d3a-4ad80efb9f29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3406b2733b0f402288effa2f3b8ad9a0'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:28.845240 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-c7eb3e64-44b6-4dba-9d3a-4ad80efb9f29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3406b2733b0f402288effa2f3b8ad9a0'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:28.866662 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-c7eb3e64-44b6-4dba-9d3a-4ad80efb9f29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3406b2733b0f402288effa2f3b8ad9a0'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:28.890206 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1422/2812] 10.222.0.118 () {58 vars in 1228 bytes} [Thu Jul 14 15:44:28 2022] DELETE /identity/v3/users/3406b2733b0f402288effa2f3b8ad9a0 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:44:29.252840 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0526e1-7168-453e-a71f-e8e6827634b3 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:29.258481 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-bf0526e1-7168-453e-a71f-e8e6827634b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:44:29.290522 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0526e1-7168-453e-a71f-e8e6827634b3 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:29.393929 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64bbf3a-6717-4e87-99d6-09a7a08d1272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:29.395419 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64bbf3a-6717-4e87-99d6-09a7a08d1272 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:29.395944 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64bbf3a-6717-4e87-99d6-09a7a08d1272 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:29.396451 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64bbf3a-6717-4e87-99d6-09a7a08d1272 admin admin] PATH_INFO: `/v3/projects/9219272fd73e45718b8fd1a534803320` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:29.398838 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64bbf3a-6717-4e87-99d6-09a7a08d1272 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9219272fd73e45718b8fd1a534803320)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:29.401556 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64bbf3a-6717-4e87-99d6-09a7a08d1272 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:29.474747 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-d64bbf3a-6717-4e87-99d6-09a7a08d1272 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9219272fd73e45718b8fd1a534803320', 'request_id': 'req-d64bbf3a-6717-4e87-99d6-09a7a08d1272'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:29.487473 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-d64bbf3a-6717-4e87-99d6-09a7a08d1272 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9219272fd73e45718b8fd1a534803320', 'request_id': 'req-d64bbf3a-6717-4e87-99d6-09a7a08d1272'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:29.496024 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-d64bbf3a-6717-4e87-99d6-09a7a08d1272 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9219272fd73e45718b8fd1a534803320', 'request_id': 'req-d64bbf3a-6717-4e87-99d6-09a7a08d1272'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:29.530075 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-d64bbf3a-6717-4e87-99d6-09a7a08d1272 admin admin] The token cache is being invalidate because project 9219272fd73e45718b8fd1a534803320 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:44:29.548256 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-d64bbf3a-6717-4e87-99d6-09a7a08d1272 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:29.550433 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-d64bbf3a-6717-4e87-99d6-09a7a08d1272 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:29.555851 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1391/2813] 10.222.0.118 () {58 vars in 1237 bytes} [Thu Jul 14 15:44:29 2022] DELETE /identity/v3/projects/9219272fd73e45718b8fd1a534803320 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:44:29.558837 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa10d0-ba31-48fb-af8e-c388560ef92b None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:29.558837 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa10d0-ba31-48fb-af8e-c388560ef92b None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:29.558837 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa10d0-ba31-48fb-af8e-c388560ef92b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:29.587536 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-f4aa10d0-ba31-48fb-af8e-c388560ef92b None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:44:29.588888 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-f4aa10d0-ba31-48fb-af8e-c388560ef92b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:44:29.702198 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1423/2814] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:44:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:44:29.711063 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cad3153-1fb2-403b-811d-acae74375a9a None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:29.712297 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cad3153-1fb2-403b-811d-acae74375a9a None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:29.712954 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cad3153-1fb2-403b-811d-acae74375a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:29.736688 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-1cad3153-1fb2-403b-811d-acae74375a9a None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:44:29.738156 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-1cad3153-1fb2-403b-811d-acae74375a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:44:29.752012 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aa10d0-ba31-48fb-af8e-c388560ef92b None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:29.757219 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1392/2815] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:44:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:44:29.764607 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aa10d0-ba31-48fb-af8e-c388560ef92b None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:29.789518 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cad51e7-ac12-44d6-8241-692441e5589b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:29.794741 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cad51e7-ac12-44d6-8241-692441e5589b admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:29.795278 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cad51e7-ac12-44d6-8241-692441e5589b admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:29.795765 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cad51e7-ac12-44d6-8241-692441e5589b admin admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:29.796758 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cad51e7-ac12-44d6-8241-692441e5589b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:44:29.797281 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cad51e7-ac12-44d6-8241-692441e5589b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:29.799795 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cad51e7-ac12-44d6-8241-692441e5589b admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:29.819836 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1424/2816] 10.222.0.118 () {58 vars in 1157 bytes} [Thu Jul 14 15:44:29 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:44:29.825644 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cad3153-1fb2-403b-811d-acae74375a9a None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:29.841008 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cad3153-1fb2-403b-811d-acae74375a9a None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:29.851993 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f27c5c5-01e9-4e5a-9c9b-04c411dbdde2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:29.852838 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f27c5c5-01e9-4e5a-9c9b-04c411dbdde2 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:29.853077 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f27c5c5-01e9-4e5a-9c9b-04c411dbdde2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:29.853364 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f27c5c5-01e9-4e5a-9c9b-04c411dbdde2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:29.853920 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f27c5c5-01e9-4e5a-9c9b-04c411dbdde2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:29.855935 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f27c5c5-01e9-4e5a-9c9b-04c411dbdde2 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:29.906415 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:44:29.916400 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1393/2817] 10.222.0.118 () {60 vars in 1157 bytes} [Thu Jul 14 15:44:29 2022] POST /identity/v3/projects => generated 380 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:44:29.920415 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cad51e7-ac12-44d6-8241-692441e5589b admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:29.940790 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cad51e7-ac12-44d6-8241-692441e5589b admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:30.034200 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:44:30.062141 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb31f98-8e88-4199-a0d5-580650b53fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:30.062847 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb31f98-8e88-4199-a0d5-580650b53fba admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:30.063127 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb31f98-8e88-4199-a0d5-580650b53fba admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:30.063520 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb31f98-8e88-4199-a0d5-580650b53fba admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:30.064099 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb31f98-8e88-4199-a0d5-580650b53fba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:30.066060 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb31f98-8e88-4199-a0d5-580650b53fba admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:30.115147 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1425/2818] 10.222.0.118 () {60 vars in 1148 bytes} [Thu Jul 14 15:44:29 2022] POST /identity/v3/users => generated 291 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:44:30.119381 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f27c5c5-01e9-4e5a-9c9b-04c411dbdde2 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:30.143592 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f27c5c5-01e9-4e5a-9c9b-04c411dbdde2 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:30.153283 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c1c0f1-ad71-43aa-bed9-dc487cffd819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:30.154422 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c1c0f1-ad71-43aa-bed9-dc487cffd819 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:30.154891 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c1c0f1-ad71-43aa-bed9-dc487cffd819 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:30.155328 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c1c0f1-ad71-43aa-bed9-dc487cffd819 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:30.157415 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c1c0f1-ad71-43aa-bed9-dc487cffd819 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:30.159381 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c1c0f1-ad71-43aa-bed9-dc487cffd819 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:30.187198 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1394/2819] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:44:30 2022] GET /identity/v3/roles => generated 1427 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:44:30.191367 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb31f98-8e88-4199-a0d5-580650b53fba admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:30.205485 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb31f98-8e88-4199-a0d5-580650b53fba admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:30.223288 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739cfb0e-bdd5-4730-8101-0cf559442310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:30.224309 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739cfb0e-bdd5-4730-8101-0cf559442310 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:30.225492 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739cfb0e-bdd5-4730-8101-0cf559442310 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:30.226114 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739cfb0e-bdd5-4730-8101-0cf559442310 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:30.227286 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739cfb0e-bdd5-4730-8101-0cf559442310 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:30.240272 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739cfb0e-bdd5-4730-8101-0cf559442310 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:30.257343 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1426/2820] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:44:30 2022] GET /identity/v3/roles => generated 1427 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:44:30.262019 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c1c0f1-ad71-43aa-bed9-dc487cffd819 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:30.276567 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c1c0f1-ad71-43aa-bed9-dc487cffd819 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:30.286191 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c10e63-6806-4f26-b4b8-cef0ab486660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:30.287408 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c10e63-6806-4f26-b4b8-cef0ab486660 admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:30.287901 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c10e63-6806-4f26-b4b8-cef0ab486660 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:30.288360 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c10e63-6806-4f26-b4b8-cef0ab486660 admin admin] PATH_INFO: `/v3/projects/f56d74ebdc32430dbc0e3b62e3d807ab/users/6fbccdf7070145c699514e4a4e5764d9/roles/4abcf5e5e7cd4b53ae1828fec6550d53` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:30.329000 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c10e63-6806-4f26-b4b8-cef0ab486660 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f56d74ebdc32430dbc0e3b62e3d807ab, user_id=6fbccdf7070145c699514e4a4e5764d9, role_id=4abcf5e5e7cd4b53ae1828fec6550d53)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:30.332677 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c10e63-6806-4f26-b4b8-cef0ab486660 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:30.359546 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1395/2821] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:44:30 2022] PUT /identity/v3/projects/f56d74ebdc32430dbc0e3b62e3d807ab/users/6fbccdf7070145c699514e4a4e5764d9/roles/4abcf5e5e7cd4b53ae1828fec6550d53 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:44:30.372098 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02874dc1-2dc5-49a1-b77c-1b0cdede416b None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:30.372811 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02874dc1-2dc5-49a1-b77c-1b0cdede416b None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:30.373414 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02874dc1-2dc5-49a1-b77c-1b0cdede416b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:30.437194 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-02874dc1-2dc5-49a1-b77c-1b0cdede416b None None] MFA Rules not processed for user `6fbccdf7070145c699514e4a4e5764d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:44:30.446791 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-02874dc1-2dc5-49a1-b77c-1b0cdede416b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:44:30.614878 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1427/2822] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:44:30 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:44:30.619207 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c10e63-6806-4f26-b4b8-cef0ab486660 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:30.774912 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c10e63-6806-4f26-b4b8-cef0ab486660 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:30.780593 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6e135e-40b4-46a0-ad0a-1d70c3781010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:30.781422 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6e135e-40b4-46a0-ad0a-1d70c3781010 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:30.781775 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6e135e-40b4-46a0-ad0a-1d70c3781010 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:30.782315 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6e135e-40b4-46a0-ad0a-1d70c3781010 admin admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:30.783094 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6e135e-40b4-46a0-ad0a-1d70c3781010 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:30.785102 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6e135e-40b4-46a0-ad0a-1d70c3781010 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:30.837870 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1396/2823] 10.222.0.118 () {60 vars in 1157 bytes} [Thu Jul 14 15:44:30 2022] POST /identity/v3/projects => generated 380 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:44:30.840433 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02874dc1-2dc5-49a1-b77c-1b0cdede416b None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:30.853931 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02874dc1-2dc5-49a1-b77c-1b0cdede416b None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:30.979241 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c86589-e6a7-47a2-ae17-794794c1654d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:30.979987 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c86589-e6a7-47a2-ae17-794794c1654d admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:30.980214 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c86589-e6a7-47a2-ae17-794794c1654d admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:30.980482 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c86589-e6a7-47a2-ae17-794794c1654d admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:30.981219 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c86589-e6a7-47a2-ae17-794794c1654d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:30.986154 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c86589-e6a7-47a2-ae17-794794c1654d admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:31.032455 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1428/2824] 10.222.0.118 () {60 vars in 1148 bytes} [Thu Jul 14 15:44:30 2022] POST /identity/v3/users => generated 297 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:44:31.036453 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6e135e-40b4-46a0-ad0a-1d70c3781010 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:31.050410 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6e135e-40b4-46a0-ad0a-1d70c3781010 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:31.078246 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d11c3c-bcaf-4dbf-b50d-90d6a93ad542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:31.078553 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d11c3c-bcaf-4dbf-b50d-90d6a93ad542 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:31.078904 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d11c3c-bcaf-4dbf-b50d-90d6a93ad542 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:31.079249 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d11c3c-bcaf-4dbf-b50d-90d6a93ad542 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:31.080067 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d11c3c-bcaf-4dbf-b50d-90d6a93ad542 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:31.081777 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d11c3c-bcaf-4dbf-b50d-90d6a93ad542 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:31.095712 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1397/2825] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:44:31 2022] GET /identity/v3/roles => generated 1427 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:44:31.099992 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c86589-e6a7-47a2-ae17-794794c1654d admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:31.110739 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c86589-e6a7-47a2-ae17-794794c1654d admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:31.116834 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2a92bd-6454-44d2-962f-faeae439a383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:31.118095 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2a92bd-6454-44d2-962f-faeae439a383 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:31.118613 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2a92bd-6454-44d2-962f-faeae439a383 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:31.119201 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2a92bd-6454-44d2-962f-faeae439a383 admin admin] PATH_INFO: `/v3/projects/ebbc97de484d48b4805bdb2a2143bfad/users/ee858f7e786f44ba9e933198051beb53/roles/3b880cef7dcf4baf87b50f8610c0c56e` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:31.147929 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2a92bd-6454-44d2-962f-faeae439a383 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebbc97de484d48b4805bdb2a2143bfad, user_id=ee858f7e786f44ba9e933198051beb53, role_id=3b880cef7dcf4baf87b50f8610c0c56e)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:31.156967 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2a92bd-6454-44d2-962f-faeae439a383 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:31.187003 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1429/2826] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:44:31 2022] PUT /identity/v3/projects/ebbc97de484d48b4805bdb2a2143bfad/users/ee858f7e786f44ba9e933198051beb53/roles/3b880cef7dcf4baf87b50f8610c0c56e => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:44:31.188193 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d11c3c-bcaf-4dbf-b50d-90d6a93ad542 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:31.207158 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d11c3c-bcaf-4dbf-b50d-90d6a93ad542 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:31.303256 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f433601a-07b1-4c41-b6b0-095fb81bc484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:31.303943 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f433601a-07b1-4c41-b6b0-095fb81bc484 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:31.304225 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f433601a-07b1-4c41-b6b0-095fb81bc484 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:31.304512 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f433601a-07b1-4c41-b6b0-095fb81bc484 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:31.305260 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f433601a-07b1-4c41-b6b0-095fb81bc484 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:31.306983 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f433601a-07b1-4c41-b6b0-095fb81bc484 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:31.325622 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1398/2827] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:44:31 2022] GET /identity/v3/roles => generated 1427 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:44:31.329712 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2a92bd-6454-44d2-962f-faeae439a383 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:31.341018 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2a92bd-6454-44d2-962f-faeae439a383 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:31.347184 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803037db-a287-4668-b8a0-15bfa511b3da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:31.349221 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803037db-a287-4668-b8a0-15bfa511b3da admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:31.350384 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803037db-a287-4668-b8a0-15bfa511b3da admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:31.351061 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803037db-a287-4668-b8a0-15bfa511b3da admin admin] PATH_INFO: `/v3/projects/ebbc97de484d48b4805bdb2a2143bfad/users/ee858f7e786f44ba9e933198051beb53/roles/3b880cef7dcf4baf87b50f8610c0c56e` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:31.354767 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803037db-a287-4668-b8a0-15bfa511b3da admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebbc97de484d48b4805bdb2a2143bfad, user_id=ee858f7e786f44ba9e933198051beb53, role_id=3b880cef7dcf4baf87b50f8610c0c56e)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:31.357851 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803037db-a287-4668-b8a0-15bfa511b3da admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:31.385851 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1430/2828] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:44:31 2022] PUT /identity/v3/projects/ebbc97de484d48b4805bdb2a2143bfad/users/ee858f7e786f44ba9e933198051beb53/roles/3b880cef7dcf4baf87b50f8610c0c56e => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:44:31.398721 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6384bf79-6a4b-421b-85b8-93b10ded8c89 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:31.399056 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6384bf79-6a4b-421b-85b8-93b10ded8c89 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:31.399273 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6384bf79-6a4b-421b-85b8-93b10ded8c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:31.444316 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-6384bf79-6a4b-421b-85b8-93b10ded8c89 None None] MFA Rules not processed for user `ee858f7e786f44ba9e933198051beb53`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:44:31.446016 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-6384bf79-6a4b-421b-85b8-93b10ded8c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:44:31.496601 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:44:31.590032 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1399/2829] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:44:31 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:44:31.603066 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803037db-a287-4668-b8a0-15bfa511b3da admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:31.604847 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-803037db-a287-4668-b8a0-15bfa511b3da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:44:31.639532 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:44:31.745322 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803037db-a287-4668-b8a0-15bfa511b3da admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:31.749773 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e6a6d2-0c34-48b8-adb4-b6306dd6d594 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea647438ea1c438987f28cbe39c3ff2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:31.751548 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e6a6d2-0c34-48b8-adb4-b6306dd6d594 service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:31.752096 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e6a6d2-0c34-48b8-adb4-b6306dd6d594 service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:31.752567 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e6a6d2-0c34-48b8-adb4-b6306dd6d594 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:31.765542 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e6a6d2-0c34-48b8-adb4-b6306dd6d594 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:31.767575 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e6a6d2-0c34-48b8-adb4-b6306dd6d594 service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:31.790542 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1431/2830] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:44:31 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:44:32.407819 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6384bf79-6a4b-421b-85b8-93b10ded8c89 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:32.503276 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6384bf79-6a4b-421b-85b8-93b10ded8c89 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:32.512816 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1db60a-e700-4121-a1a0-1bb2d033e47d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:32.513898 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1db60a-e700-4121-a1a0-1bb2d033e47d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:32.514319 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1db60a-e700-4121-a1a0-1bb2d033e47d admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:32.514642 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1db60a-e700-4121-a1a0-1bb2d033e47d admin admin] PATH_INFO: `/v3/users/6fbccdf7070145c699514e4a4e5764d9` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:32.516124 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1db60a-e700-4121-a1a0-1bb2d033e47d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fbccdf7070145c699514e4a4e5764d9)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:32.519161 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1db60a-e700-4121-a1a0-1bb2d033e47d admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:32.596507 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-bc1db60a-e700-4121-a1a0-1bb2d033e47d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fbccdf7070145c699514e4a4e5764d9'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:32.608774 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-bc1db60a-e700-4121-a1a0-1bb2d033e47d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fbccdf7070145c699514e4a4e5764d9'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:32.609828 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-bc1db60a-e700-4121-a1a0-1bb2d033e47d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fbccdf7070145c699514e4a4e5764d9'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:32.610848 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-bc1db60a-e700-4121-a1a0-1bb2d033e47d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fbccdf7070145c699514e4a4e5764d9'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:32.661224 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-bc1db60a-e700-4121-a1a0-1bb2d033e47d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fbccdf7070145c699514e4a4e5764d9'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:32.680309 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1400/2831] 10.222.0.118 () {58 vars in 1228 bytes} [Thu Jul 14 15:44:32 2022] DELETE /identity/v3/users/6fbccdf7070145c699514e4a4e5764d9 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:44:32.685336 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c0dfa7-a053-4b84-8bfe-749af227c8e3 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:32.685886 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c0dfa7-a053-4b84-8bfe-749af227c8e3 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:32.685886 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c0dfa7-a053-4b84-8bfe-749af227c8e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:32.714084 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-96c0dfa7-a053-4b84-8bfe-749af227c8e3 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:44:32.716035 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-96c0dfa7-a053-4b84-8bfe-749af227c8e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:44:32.790299 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1432/2832] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:44:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:44:32.800749 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1db60a-e700-4121-a1a0-1bb2d033e47d admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:32.802526 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-bc1db60a-e700-4121-a1a0-1bb2d033e47d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:44:32.856792 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91907db5-6a28-4719-86a2-6e6d9494aeb1 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:32.857411 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91907db5-6a28-4719-86a2-6e6d9494aeb1 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:32.857571 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:44:32.857747 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91907db5-6a28-4719-86a2-6e6d9494aeb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:32.878336 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1db60a-e700-4121-a1a0-1bb2d033e47d admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:32.885778 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61670e41-9ac4-4253-9dca-2ba03fce1164 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b650be8114b64df0ac88441f1c50b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:32.886421 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61670e41-9ac4-4253-9dca-2ba03fce1164 service neutron] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:32.886763 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61670e41-9ac4-4253-9dca-2ba03fce1164 service neutron] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:32.887018 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61670e41-9ac4-4253-9dca-2ba03fce1164 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:32.887663 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-91907db5-6a28-4719-86a2-6e6d9494aeb1 None None] MFA Rules not processed for user `6e3d7ca5f6ce447484b64000c290ea6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:44:32.889045 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-91907db5-6a28-4719-86a2-6e6d9494aeb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:44:32.897361 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61670e41-9ac4-4253-9dca-2ba03fce1164 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:32.898842 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61670e41-9ac4-4253-9dca-2ba03fce1164 service neutron] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:32.911118 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1401/2833] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:44:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:44:32.976364 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1433/2834] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:44:32 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:44:32.989382 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61670e41-9ac4-4253-9dca-2ba03fce1164 service neutron] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:32.992167 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-61670e41-9ac4-4253-9dca-2ba03fce1164 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:44:33.081395 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61670e41-9ac4-4253-9dca-2ba03fce1164 service neutron] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:33.088023 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8213e9-58a9-440a-99ba-dac622f55a51 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0177fc696ea40069902803da09f437c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:33.089428 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8213e9-58a9-440a-99ba-dac622f55a51 service nova] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:33.089708 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8213e9-58a9-440a-99ba-dac622f55a51 service nova] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:33.090065 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8213e9-58a9-440a-99ba-dac622f55a51 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:33.092609 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-7a8213e9-58a9-440a-99ba-dac622f55a51 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:44:33.168473 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8213e9-58a9-440a-99ba-dac622f55a51 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:33.170268 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8213e9-58a9-440a-99ba-dac622f55a51 service nova] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:33.181758 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1402/2835] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:44:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:44:33.226728 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91907db5-6a28-4719-86a2-6e6d9494aeb1 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:33.228310 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-91907db5-6a28-4719-86a2-6e6d9494aeb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:44:33.255882 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91907db5-6a28-4719-86a2-6e6d9494aeb1 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:33.262978 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b08ebd9-2e91-4ccf-b623-37ec32c1bdea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:33.264024 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b08ebd9-2e91-4ccf-b623-37ec32c1bdea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:33.264213 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b08ebd9-2e91-4ccf-b623-37ec32c1bdea admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:33.264507 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b08ebd9-2e91-4ccf-b623-37ec32c1bdea admin admin] PATH_INFO: `/v3/projects/f56d74ebdc32430dbc0e3b62e3d807ab` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:33.266607 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b08ebd9-2e91-4ccf-b623-37ec32c1bdea admin admin] RBAC: Authorizing `identity:delete_project(project_id=f56d74ebdc32430dbc0e3b62e3d807ab)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:33.268901 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b08ebd9-2e91-4ccf-b623-37ec32c1bdea admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:33.321309 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:44:33.333192 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-7b08ebd9-2e91-4ccf-b623-37ec32c1bdea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f56d74ebdc32430dbc0e3b62e3d807ab', 'request_id': 'req-7b08ebd9-2e91-4ccf-b623-37ec32c1bdea'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:33.339946 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-7b08ebd9-2e91-4ccf-b623-37ec32c1bdea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f56d74ebdc32430dbc0e3b62e3d807ab', 'request_id': 'req-7b08ebd9-2e91-4ccf-b623-37ec32c1bdea'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:33.349094 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-7b08ebd9-2e91-4ccf-b623-37ec32c1bdea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f56d74ebdc32430dbc0e3b62e3d807ab', 'request_id': 'req-7b08ebd9-2e91-4ccf-b623-37ec32c1bdea'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:33.364779 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-7b08ebd9-2e91-4ccf-b623-37ec32c1bdea admin admin] The token cache is being invalidate because project f56d74ebdc32430dbc0e3b62e3d807ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:44:33.365067 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-7b08ebd9-2e91-4ccf-b623-37ec32c1bdea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:33.365702 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-7b08ebd9-2e91-4ccf-b623-37ec32c1bdea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:33.367504 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1434/2836] 10.222.0.118 () {58 vars in 1237 bytes} [Thu Jul 14 15:44:33 2022] DELETE /identity/v3/projects/f56d74ebdc32430dbc0e3b62e3d807ab => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:44:33.371425 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8213e9-58a9-440a-99ba-dac622f55a51 service nova] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:33.384881 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8213e9-58a9-440a-99ba-dac622f55a51 service nova] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:33.453052 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3920a752-a37b-4465-93fa-fd8a75d2e70f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:33.454175 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3920a752-a37b-4465-93fa-fd8a75d2e70f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:33.454425 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3920a752-a37b-4465-93fa-fd8a75d2e70f admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:33.454698 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3920a752-a37b-4465-93fa-fd8a75d2e70f admin admin] PATH_INFO: `/v3/users/ee858f7e786f44ba9e933198051beb53` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:33.455895 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3920a752-a37b-4465-93fa-fd8a75d2e70f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee858f7e786f44ba9e933198051beb53)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:33.457859 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3920a752-a37b-4465-93fa-fd8a75d2e70f admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:33.480384 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:44:33.510959 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-3920a752-a37b-4465-93fa-fd8a75d2e70f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee858f7e786f44ba9e933198051beb53'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:33.519130 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-3920a752-a37b-4465-93fa-fd8a75d2e70f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee858f7e786f44ba9e933198051beb53'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:33.519827 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-3920a752-a37b-4465-93fa-fd8a75d2e70f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee858f7e786f44ba9e933198051beb53'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:33.520676 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-3920a752-a37b-4465-93fa-fd8a75d2e70f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee858f7e786f44ba9e933198051beb53'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:33.533822 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-3920a752-a37b-4465-93fa-fd8a75d2e70f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee858f7e786f44ba9e933198051beb53'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:33.548367 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1403/2837] 10.222.0.118 () {58 vars in 1228 bytes} [Thu Jul 14 15:44:33 2022] DELETE /identity/v3/users/ee858f7e786f44ba9e933198051beb53 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:44:33.847501 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b08ebd9-2e91-4ccf-b623-37ec32c1bdea admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:33.849524 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-7b08ebd9-2e91-4ccf-b623-37ec32c1bdea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:44:33.867860 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b08ebd9-2e91-4ccf-b623-37ec32c1bdea admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:33.945020 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3e925f-c749-45cb-aef8-14fbcaca7e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:33.946009 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e925f-c749-45cb-aef8-14fbcaca7e1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:33.946305 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e925f-c749-45cb-aef8-14fbcaca7e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:33.946650 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e925f-c749-45cb-aef8-14fbcaca7e1c admin admin] PATH_INFO: `/v3/projects/ebbc97de484d48b4805bdb2a2143bfad` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:33.948003 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3e925f-c749-45cb-aef8-14fbcaca7e1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebbc97de484d48b4805bdb2a2143bfad)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:33.950443 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3e925f-c749-45cb-aef8-14fbcaca7e1c admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:34.020963 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-ea3e925f-c749-45cb-aef8-14fbcaca7e1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebbc97de484d48b4805bdb2a2143bfad', 'request_id': 'req-ea3e925f-c749-45cb-aef8-14fbcaca7e1c'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:34.028934 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-ea3e925f-c749-45cb-aef8-14fbcaca7e1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebbc97de484d48b4805bdb2a2143bfad', 'request_id': 'req-ea3e925f-c749-45cb-aef8-14fbcaca7e1c'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:34.036877 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-ea3e925f-c749-45cb-aef8-14fbcaca7e1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebbc97de484d48b4805bdb2a2143bfad', 'request_id': 'req-ea3e925f-c749-45cb-aef8-14fbcaca7e1c'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:34.050485 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-ea3e925f-c749-45cb-aef8-14fbcaca7e1c admin admin] The token cache is being invalidate because project ebbc97de484d48b4805bdb2a2143bfad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:44:34.050658 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-ea3e925f-c749-45cb-aef8-14fbcaca7e1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:34.051285 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-ea3e925f-c749-45cb-aef8-14fbcaca7e1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:44:34.053376 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1435/2838] 10.222.0.118 () {58 vars in 1237 bytes} [Thu Jul 14 15:44:33 2022] DELETE /identity/v3/projects/ebbc97de484d48b4805bdb2a2143bfad => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:44:34.058097 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a439d74-7cac-4d8e-9326-0d70f8f94ad3 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:34.058388 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a439d74-7cac-4d8e-9326-0d70f8f94ad3 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:34.058657 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a439d74-7cac-4d8e-9326-0d70f8f94ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:34.080734 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-0a439d74-7cac-4d8e-9326-0d70f8f94ad3 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:44:34.082163 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-0a439d74-7cac-4d8e-9326-0d70f8f94ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:44:34.187889 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1404/2839] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:44:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:44:34.198070 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a29aeed-9251-49fe-809c-eba3c22e78f6 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:34.198439 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a29aeed-9251-49fe-809c-eba3c22e78f6 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:34.198728 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a29aeed-9251-49fe-809c-eba3c22e78f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:34.226133 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-5a29aeed-9251-49fe-809c-eba3c22e78f6 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:44:34.227394 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-5a29aeed-9251-49fe-809c-eba3c22e78f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:44:34.242053 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1436/2840] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:44:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:44:34.246379 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a439d74-7cac-4d8e-9326-0d70f8f94ad3 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:34.257598 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a439d74-7cac-4d8e-9326-0d70f8f94ad3 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:34.262993 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71707c5e-a15f-4f90-9309-ffee1fe1990b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:34.264223 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71707c5e-a15f-4f90-9309-ffee1fe1990b admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:34.264223 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71707c5e-a15f-4f90-9309-ffee1fe1990b admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:34.264478 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71707c5e-a15f-4f90-9309-ffee1fe1990b admin admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:34.265247 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71707c5e-a15f-4f90-9309-ffee1fe1990b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:44:34.266109 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71707c5e-a15f-4f90-9309-ffee1fe1990b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:34.267326 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71707c5e-a15f-4f90-9309-ffee1fe1990b admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:34.297140 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79841ca-371a-432b-bc4e-801529be4acb None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:34.297495 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79841ca-371a-432b-bc4e-801529be4acb None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:34.297857 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79841ca-371a-432b-bc4e-801529be4acb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:34.298301 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1405/2841] 10.222.0.118 () {58 vars in 1157 bytes} [Thu Jul 14 15:44:34 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:44:34.299374 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71707c5e-a15f-4f90-9309-ffee1fe1990b admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:34.309390 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71707c5e-a15f-4f90-9309-ffee1fe1990b admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:34.314503 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459b0799-aec8-42ed-a383-381394acbaf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:34.315300 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459b0799-aec8-42ed-a383-381394acbaf5 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:34.315648 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459b0799-aec8-42ed-a383-381394acbaf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:34.316131 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459b0799-aec8-42ed-a383-381394acbaf5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:34.317362 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459b0799-aec8-42ed-a383-381394acbaf5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:34.317491 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-b79841ca-371a-432b-bc4e-801529be4acb None None] MFA Rules not processed for user `9f2d1efbd5fd44669581bd6a33c01cf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:44:34.318728 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-b79841ca-371a-432b-bc4e-801529be4acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:44:34.319164 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459b0799-aec8-42ed-a383-381394acbaf5 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:34.357719 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1406/2842] 10.222.0.118 () {60 vars in 1157 bytes} [Thu Jul 14 15:44:34 2022] POST /identity/v3/projects => generated 370 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:44:34.361748 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459b0799-aec8-42ed-a383-381394acbaf5 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:34.375064 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:44:34.398973 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1437/2843] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:44:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:44:34.441349 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459b0799-aec8-42ed-a383-381394acbaf5 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:34.446829 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88700c44-993e-4840-a39e-72893e8be65e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:34.447893 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88700c44-993e-4840-a39e-72893e8be65e admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:34.448181 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88700c44-993e-4840-a39e-72893e8be65e admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:34.448496 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88700c44-993e-4840-a39e-72893e8be65e admin admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:34.449376 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88700c44-993e-4840-a39e-72893e8be65e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:34.451612 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88700c44-993e-4840-a39e-72893e8be65e admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:34.461322 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:44:34.484139 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1407/2844] 10.222.0.118 () {60 vars in 1148 bytes} [Thu Jul 14 15:44:34 2022] POST /identity/v3/users => generated 286 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:44:34.485481 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79841ca-371a-432b-bc4e-801529be4acb None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:34.500915 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79841ca-371a-432b-bc4e-801529be4acb None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:34.506999 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d86b2e7-8e43-4066-9b11-af4f30d682a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:34.508326 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d86b2e7-8e43-4066-9b11-af4f30d682a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:34.508906 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d86b2e7-8e43-4066-9b11-af4f30d682a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:34.509068 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d86b2e7-8e43-4066-9b11-af4f30d682a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:34.510446 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d86b2e7-8e43-4066-9b11-af4f30d682a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:34.513224 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d86b2e7-8e43-4066-9b11-af4f30d682a9 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:34.525827 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1438/2845] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:44:34 2022] GET /identity/v3/roles => generated 1427 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:44:34.530569 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88700c44-993e-4840-a39e-72893e8be65e admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:34.542621 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88700c44-993e-4840-a39e-72893e8be65e admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:34.548294 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fc1557-0ffe-4874-841c-66cb5c722180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:34.548969 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fc1557-0ffe-4874-841c-66cb5c722180 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:34.549250 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fc1557-0ffe-4874-841c-66cb5c722180 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:34.549649 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fc1557-0ffe-4874-841c-66cb5c722180 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:34.550274 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fc1557-0ffe-4874-841c-66cb5c722180 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:34.552251 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fc1557-0ffe-4874-841c-66cb5c722180 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:34.574230 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1408/2846] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:44:34 2022] GET /identity/v3/roles => generated 1427 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:44:34.576267 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d86b2e7-8e43-4066-9b11-af4f30d682a9 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:34.588415 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d86b2e7-8e43-4066-9b11-af4f30d682a9 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:34.594103 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96f244f-8e37-4b04-82da-a53902e38eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:34.595221 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96f244f-8e37-4b04-82da-a53902e38eec admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:34.595503 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96f244f-8e37-4b04-82da-a53902e38eec admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:34.595873 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96f244f-8e37-4b04-82da-a53902e38eec admin admin] PATH_INFO: `/v3/projects/ee37d667c3e4443fabb698524bd7a90f/users/86c8f0510dd243adb4331a0286a55014/roles/4abcf5e5e7cd4b53ae1828fec6550d53` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:34.614135 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96f244f-8e37-4b04-82da-a53902e38eec admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee37d667c3e4443fabb698524bd7a90f, user_id=86c8f0510dd243adb4331a0286a55014, role_id=4abcf5e5e7cd4b53ae1828fec6550d53)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:34.616676 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96f244f-8e37-4b04-82da-a53902e38eec admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:34.634232 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1439/2847] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:44:34 2022] PUT /identity/v3/projects/ee37d667c3e4443fabb698524bd7a90f/users/86c8f0510dd243adb4331a0286a55014/roles/4abcf5e5e7cd4b53ae1828fec6550d53 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:44:34.646668 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3abf691-6ce4-4496-ae6b-33e75ae1f70a None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:34.647034 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3abf691-6ce4-4496-ae6b-33e75ae1f70a None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:34.647404 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3abf691-6ce4-4496-ae6b-33e75ae1f70a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:34.677147 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-e3abf691-6ce4-4496-ae6b-33e75ae1f70a None None] MFA Rules not processed for user `86c8f0510dd243adb4331a0286a55014`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:44:34.678614 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-e3abf691-6ce4-4496-ae6b-33e75ae1f70a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:44:34.760128 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1409/2848] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:44:34 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:44:34.772738 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96f244f-8e37-4b04-82da-a53902e38eec admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:34.775203 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-e96f244f-8e37-4b04-82da-a53902e38eec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:44:34.861557 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96f244f-8e37-4b04-82da-a53902e38eec admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:34.866185 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef2577e-4a30-4d18-baa0-b796c336ce2f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4336c3d678a4d33b00885def42dfb1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:34.866920 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef2577e-4a30-4d18-baa0-b796c336ce2f service glance] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:34.867310 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef2577e-4a30-4d18-baa0-b796c336ce2f service glance] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:34.867706 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef2577e-4a30-4d18-baa0-b796c336ce2f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:34.879213 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef2577e-4a30-4d18-baa0-b796c336ce2f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:34.881087 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef2577e-4a30-4d18-baa0-b796c336ce2f service glance] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:34.896755 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1440/2849] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:44:34 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:44:44.754873 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:INSERT=2,keystone:SELECT=39 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:44:44.897059 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=45,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:44:52.710447 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3abf691-6ce4-4496-ae6b-33e75ae1f70a None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:52.711868 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-e3abf691-6ce4-4496-ae6b-33e75ae1f70a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:44:52.862077 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3abf691-6ce4-4496-ae6b-33e75ae1f70a None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:52.867806 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acae57b-c8af-4035-a815-60b59d5c6895 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b0f8be7e04adca6e3f218fbe3a295', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:52.869006 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acae57b-c8af-4035-a815-60b59d5c6895 service placement] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:52.869297 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acae57b-c8af-4035-a815-60b59d5c6895 service placement] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:52.869592 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acae57b-c8af-4035-a815-60b59d5c6895 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:52.871968 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-8acae57b-c8af-4035-a815-60b59d5c6895 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:44:52.883916 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acae57b-c8af-4035-a815-60b59d5c6895 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:52.885529 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acae57b-c8af-4035-a815-60b59d5c6895 service placement] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:52.895980 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1410/2850] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:44:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:45:02.099249 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef2577e-4a30-4d18-baa0-b796c336ce2f service glance] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:45:02.194729 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef2577e-4a30-4d18-baa0-b796c336ce2f service glance] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:45:02.199400 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aeaf41-d57f-4d36-926d-d91999004515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:45:02.200254 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aeaf41-d57f-4d36-926d-d91999004515 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:45:02.200527 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aeaf41-d57f-4d36-926d-d91999004515 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:45:02.200800 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aeaf41-d57f-4d36-926d-d91999004515 admin admin] PATH_INFO: `/v3/users/86c8f0510dd243adb4331a0286a55014` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:45:02.202004 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aeaf41-d57f-4d36-926d-d91999004515 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86c8f0510dd243adb4331a0286a55014)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:45:02.203913 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aeaf41-d57f-4d36-926d-d91999004515 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:45:02.250844 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-00aeaf41-d57f-4d36-926d-d91999004515 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86c8f0510dd243adb4331a0286a55014'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:45:02.257783 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-00aeaf41-d57f-4d36-926d-d91999004515 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86c8f0510dd243adb4331a0286a55014'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:45:02.258551 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-00aeaf41-d57f-4d36-926d-d91999004515 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86c8f0510dd243adb4331a0286a55014'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:45:02.259159 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-00aeaf41-d57f-4d36-926d-d91999004515 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86c8f0510dd243adb4331a0286a55014'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:45:02.271230 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-00aeaf41-d57f-4d36-926d-d91999004515 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86c8f0510dd243adb4331a0286a55014'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:45:02.284759 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1441/2851] 10.222.0.118 () {58 vars in 1228 bytes} [Thu Jul 14 15:45:02 2022] DELETE /identity/v3/users/86c8f0510dd243adb4331a0286a55014 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:45:02.289235 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b41c32-ee13-44e7-ade9-699df399f9c9 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:45:02.289742 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b41c32-ee13-44e7-ade9-699df399f9c9 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:45:02.289854 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b41c32-ee13-44e7-ade9-699df399f9c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:45:02.329882 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-78b41c32-ee13-44e7-ade9-699df399f9c9 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:45:02.331232 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-78b41c32-ee13-44e7-ade9-699df399f9c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:45:02.393305 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1411/2852] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:45:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:45:02.403637 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aeaf41-d57f-4d36-926d-d91999004515 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:45:02.405064 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-00aeaf41-d57f-4d36-926d-d91999004515 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:45:02.452011 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:45:02.485322 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aeaf41-d57f-4d36-926d-d91999004515 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:45:02.489312 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5ae17a-e65f-401c-abb2-196c9cca392b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b650be8114b64df0ac88441f1c50b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:45:02.489955 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5ae17a-e65f-401c-abb2-196c9cca392b service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:45:02.490266 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5ae17a-e65f-401c-abb2-196c9cca392b service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:45:02.490541 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5ae17a-e65f-401c-abb2-196c9cca392b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:45:02.499967 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5ae17a-e65f-401c-abb2-196c9cca392b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:45:02.501439 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5ae17a-e65f-401c-abb2-196c9cca392b service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:45:02.511606 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1442/2853] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:45:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:45:02.782154 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b41c32-ee13-44e7-ade9-699df399f9c9 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:45:02.783684 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-78b41c32-ee13-44e7-ade9-699df399f9c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:45:02.794906 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:45:02.800213 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b41c32-ee13-44e7-ade9-699df399f9c9 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:45:02.805031 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cf4b33-3d15-4a54-a83d-40e0d4e82175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:45:02.805933 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf4b33-3d15-4a54-a83d-40e0d4e82175 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:45:02.806274 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf4b33-3d15-4a54-a83d-40e0d4e82175 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:45:02.806548 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf4b33-3d15-4a54-a83d-40e0d4e82175 admin admin] PATH_INFO: `/v3/projects/ee37d667c3e4443fabb698524bd7a90f` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:45:02.808328 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cf4b33-3d15-4a54-a83d-40e0d4e82175 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee37d667c3e4443fabb698524bd7a90f)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:45:02.810852 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cf4b33-3d15-4a54-a83d-40e0d4e82175 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:45:02.859653 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-42cf4b33-3d15-4a54-a83d-40e0d4e82175 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee37d667c3e4443fabb698524bd7a90f', 'request_id': 'req-42cf4b33-3d15-4a54-a83d-40e0d4e82175'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:45:02.866129 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-42cf4b33-3d15-4a54-a83d-40e0d4e82175 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee37d667c3e4443fabb698524bd7a90f', 'request_id': 'req-42cf4b33-3d15-4a54-a83d-40e0d4e82175'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:45:02.872632 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-42cf4b33-3d15-4a54-a83d-40e0d4e82175 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee37d667c3e4443fabb698524bd7a90f', 'request_id': 'req-42cf4b33-3d15-4a54-a83d-40e0d4e82175'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:45:02.886818 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-42cf4b33-3d15-4a54-a83d-40e0d4e82175 admin admin] The token cache is being invalidate because project ee37d667c3e4443fabb698524bd7a90f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:45:02.887111 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-42cf4b33-3d15-4a54-a83d-40e0d4e82175 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:45:02.887738 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-42cf4b33-3d15-4a54-a83d-40e0d4e82175 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:45:02.889369 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1412/2854] 10.222.0.118 () {58 vars in 1237 bytes} [Thu Jul 14 15:45:02 2022] DELETE /identity/v3/projects/ee37d667c3e4443fabb698524bd7a90f => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:45:02.894329 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127028c8-88e7-43f7-96f0-a64b485b4264 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:45:02.894622 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127028c8-88e7-43f7-96f0-a64b485b4264 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:45:02.894902 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127028c8-88e7-43f7-96f0-a64b485b4264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:45:02.943581 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-127028c8-88e7-43f7-96f0-a64b485b4264 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:45:02.944951 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-127028c8-88e7-43f7-96f0-a64b485b4264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:45:03.013396 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1443/2855] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:45:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:45:03.021083 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37ae27e-6154-4c31-b9e4-dd94f67a7ff3 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:45:03.021373 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37ae27e-6154-4c31-b9e4-dd94f67a7ff3 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:45:03.021647 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37ae27e-6154-4c31-b9e4-dd94f67a7ff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:45:03.039417 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-c37ae27e-6154-4c31-b9e4-dd94f67a7ff3 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:45:03.040621 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-c37ae27e-6154-4c31-b9e4-dd94f67a7ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:45:03.049032 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1413/2856] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:45:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:45:03.053271 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127028c8-88e7-43f7-96f0-a64b485b4264 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:45:03.063697 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127028c8-88e7-43f7-96f0-a64b485b4264 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:45:03.068566 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360e155a-08e6-4b52-8dea-bf2ca49c571b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:45:03.069300 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e155a-08e6-4b52-8dea-bf2ca49c571b admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:45:03.069580 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e155a-08e6-4b52-8dea-bf2ca49c571b admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:45:03.069858 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e155a-08e6-4b52-8dea-bf2ca49c571b admin admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:45:03.070628 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360e155a-08e6-4b52-8dea-bf2ca49c571b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:45:03.070939 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360e155a-08e6-4b52-8dea-bf2ca49c571b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:45:03.072595 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360e155a-08e6-4b52-8dea-bf2ca49c571b admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:45:03.084942 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1444/2857] 10.222.0.118 () {58 vars in 1157 bytes} [Thu Jul 14 15:45:03 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:45:03.089150 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37ae27e-6154-4c31-b9e4-dd94f67a7ff3 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:45:03.098545 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37ae27e-6154-4c31-b9e4-dd94f67a7ff3 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:45:03.103304 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cb9fc7-52e7-46b2-b6a0-53ce5b33fa90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:45:03.103960 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cb9fc7-52e7-46b2-b6a0-53ce5b33fa90 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:45:03.104842 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cb9fc7-52e7-46b2-b6a0-53ce5b33fa90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:45:03.105117 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cb9fc7-52e7-46b2-b6a0-53ce5b33fa90 admin admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:45:03.105817 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cb9fc7-52e7-46b2-b6a0-53ce5b33fa90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:45:03.107752 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cb9fc7-52e7-46b2-b6a0-53ce5b33fa90 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:45:03.137510 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1414/2858] 10.222.0.118 () {60 vars in 1157 bytes} [Thu Jul 14 15:45:03 2022] POST /identity/v3/projects => generated 364 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:45:03.138546 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360e155a-08e6-4b52-8dea-bf2ca49c571b admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:45:03.148653 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360e155a-08e6-4b52-8dea-bf2ca49c571b admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:45:03.178266 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cb9fc7-52e7-46b2-b6a0-53ce5b33fa90 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:45:03.180236 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-33cb9fc7-52e7-46b2-b6a0-53ce5b33fa90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:45:03.212877 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c89a7ac-d26a-47af-a56b-ee93cb27e4c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:45:03.213704 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c89a7ac-d26a-47af-a56b-ee93cb27e4c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:45:03.214093 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c89a7ac-d26a-47af-a56b-ee93cb27e4c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:45:03.214448 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c89a7ac-d26a-47af-a56b-ee93cb27e4c9 admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:45:03.215170 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c89a7ac-d26a-47af-a56b-ee93cb27e4c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:45:03.217077 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c89a7ac-d26a-47af-a56b-ee93cb27e4c9 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:45:03.238378 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1445/2859] 10.222.0.118 () {60 vars in 1148 bytes} [Thu Jul 14 15:45:03 2022] POST /identity/v3/users => generated 283 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:45:03.241828 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cb9fc7-52e7-46b2-b6a0-53ce5b33fa90 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:45:03.242909 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c89a7ac-d26a-47af-a56b-ee93cb27e4c9 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:45:03.246173 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe66e5eb-83d5-4f6c-a9ed-db2e292df08a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b650be8114b64df0ac88441f1c50b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:45:03.246817 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe66e5eb-83d5-4f6c-a9ed-db2e292df08a service neutron] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:45:03.247099 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe66e5eb-83d5-4f6c-a9ed-db2e292df08a service neutron] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:45:03.247368 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe66e5eb-83d5-4f6c-a9ed-db2e292df08a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:45:03.249150 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-fe66e5eb-83d5-4f6c-a9ed-db2e292df08a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:45:03.253288 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c89a7ac-d26a-47af-a56b-ee93cb27e4c9 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:45:03.258350 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa2064d-8d69-458b-a4f7-d4227534c743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:45:03.259000 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa2064d-8d69-458b-a4f7-d4227534c743 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:45:03.259286 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa2064d-8d69-458b-a4f7-d4227534c743 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:45:03.259560 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa2064d-8d69-458b-a4f7-d4227534c743 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:45:03.260391 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa2064d-8d69-458b-a4f7-d4227534c743 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:45:03.261894 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa2064d-8d69-458b-a4f7-d4227534c743 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:45:03.274829 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1446/2860] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:45:03 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:45:03.278809 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa2064d-8d69-458b-a4f7-d4227534c743 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:45:03.291139 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa2064d-8d69-458b-a4f7-d4227534c743 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:45:03.297045 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6b9b5d-cf24-4f8b-aa6b-e8a236b25774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:45:03.297913 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6b9b5d-cf24-4f8b-aa6b-e8a236b25774 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:45:03.298228 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6b9b5d-cf24-4f8b-aa6b-e8a236b25774 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:45:03.298507 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6b9b5d-cf24-4f8b-aa6b-e8a236b25774 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:45:03.299231 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6b9b5d-cf24-4f8b-aa6b-e8a236b25774 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:45:03.300861 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6b9b5d-cf24-4f8b-aa6b-e8a236b25774 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:45:03.303202 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:45:03.314123 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe66e5eb-83d5-4f6c-a9ed-db2e292df08a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:45:03.318266 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1447/2861] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:45:03 2022] GET /identity/v3/roles => generated 1427 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:45:03.318397 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe66e5eb-83d5-4f6c-a9ed-db2e292df08a service neutron] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:45:03.319344 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6b9b5d-cf24-4f8b-aa6b-e8a236b25774 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:45:03.325989 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1415/2862] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:45:03 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:45:03.329134 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6b9b5d-cf24-4f8b-aa6b-e8a236b25774 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:45:03.333794 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b304e56-ba37-400f-a60d-10f02fe1d662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:45:03.334695 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b304e56-ba37-400f-a60d-10f02fe1d662 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:45:03.334975 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b304e56-ba37-400f-a60d-10f02fe1d662 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:45:03.335247 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b304e56-ba37-400f-a60d-10f02fe1d662 admin admin] PATH_INFO: `/v3/projects/f2373cd9b2494ee3a01fca76da9559b1/users/6acf6959971842aa8d709f8c91e9f5c7/roles/4abcf5e5e7cd4b53ae1828fec6550d53` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:45:03.349642 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b304e56-ba37-400f-a60d-10f02fe1d662 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2373cd9b2494ee3a01fca76da9559b1, user_id=6acf6959971842aa8d709f8c91e9f5c7, role_id=4abcf5e5e7cd4b53ae1828fec6550d53)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:45:03.352455 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b304e56-ba37-400f-a60d-10f02fe1d662 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:45:03.366877 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1448/2863] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:45:03 2022] PUT /identity/v3/projects/f2373cd9b2494ee3a01fca76da9559b1/users/6acf6959971842aa8d709f8c91e9f5c7/roles/4abcf5e5e7cd4b53ae1828fec6550d53 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:45:03.377660 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc76eda-d924-4a0b-91a6-5158f2b99f47 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:45:03.377953 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc76eda-d924-4a0b-91a6-5158f2b99f47 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:45:03.378273 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc76eda-d924-4a0b-91a6-5158f2b99f47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:45:03.397220 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:45:03.410239 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-2dc76eda-d924-4a0b-91a6-5158f2b99f47 None None] MFA Rules not processed for user `6acf6959971842aa8d709f8c91e9f5c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:45:03.411471 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-2dc76eda-d924-4a0b-91a6-5158f2b99f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:45:03.476155 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1416/2864] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:45:03 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:45:03.487970 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b304e56-ba37-400f-a60d-10f02fe1d662 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:45:03.490230 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-8b304e56-ba37-400f-a60d-10f02fe1d662 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:45:03.552156 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b304e56-ba37-400f-a60d-10f02fe1d662 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:45:03.555970 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6820e21a-f6f9-49b8-bef4-d5ad6e1a62fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea647438ea1c438987f28cbe39c3ff2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:45:03.556621 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6820e21a-f6f9-49b8-bef4-d5ad6e1a62fe service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:45:03.556924 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6820e21a-f6f9-49b8-bef4-d5ad6e1a62fe service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:45:03.557197 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6820e21a-f6f9-49b8-bef4-d5ad6e1a62fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:45:03.565988 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6820e21a-f6f9-49b8-bef4-d5ad6e1a62fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:45:03.567431 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6820e21a-f6f9-49b8-bef4-d5ad6e1a62fe service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:45:03.576595 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1449/2865] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:45:03 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:45:04.922124 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc76eda-d924-4a0b-91a6-5158f2b99f47 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:45:04.923494 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-2dc76eda-d924-4a0b-91a6-5158f2b99f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:45:05.039643 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc76eda-d924-4a0b-91a6-5158f2b99f47 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:45:05.046998 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cccc663-cf79-468c-abfa-35debb4fc040 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0177fc696ea40069902803da09f437c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:45:05.047876 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cccc663-cf79-468c-abfa-35debb4fc040 service nova] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:45:05.048236 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cccc663-cf79-468c-abfa-35debb4fc040 service nova] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:45:05.048651 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cccc663-cf79-468c-abfa-35debb4fc040 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:45:05.055182 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-9cccc663-cf79-468c-abfa-35debb4fc040 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:45:05.070182 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cccc663-cf79-468c-abfa-35debb4fc040 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:45:05.073948 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cccc663-cf79-468c-abfa-35debb4fc040 service nova] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:45:05.086674 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1417/2866] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:45:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:45:13.572525 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=37,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:45:15.081461 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=74 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:45:33.224350 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6820e21a-f6f9-49b8-bef4-d5ad6e1a62fe service cinder] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:45:33.285855 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6820e21a-f6f9-49b8-bef4-d5ad6e1a62fe service cinder] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:45:33.290408 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74db3364-0b83-4b1f-b9e4-e59198d6678a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:45:33.291259 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74db3364-0b83-4b1f-b9e4-e59198d6678a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:45:33.291542 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74db3364-0b83-4b1f-b9e4-e59198d6678a admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:45:33.291817 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74db3364-0b83-4b1f-b9e4-e59198d6678a admin admin] PATH_INFO: `/v3/users/6acf6959971842aa8d709f8c91e9f5c7` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:45:33.293008 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74db3364-0b83-4b1f-b9e4-e59198d6678a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6acf6959971842aa8d709f8c91e9f5c7)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:45:33.294976 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74db3364-0b83-4b1f-b9e4-e59198d6678a admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:45:33.341617 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-74db3364-0b83-4b1f-b9e4-e59198d6678a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6acf6959971842aa8d709f8c91e9f5c7'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:45:33.349011 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-74db3364-0b83-4b1f-b9e4-e59198d6678a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6acf6959971842aa8d709f8c91e9f5c7'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:45:33.349660 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-74db3364-0b83-4b1f-b9e4-e59198d6678a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6acf6959971842aa8d709f8c91e9f5c7'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:45:33.350270 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-74db3364-0b83-4b1f-b9e4-e59198d6678a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6acf6959971842aa8d709f8c91e9f5c7'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:45:33.361682 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-74db3364-0b83-4b1f-b9e4-e59198d6678a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6acf6959971842aa8d709f8c91e9f5c7'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:45:33.374092 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1450/2867] 10.222.0.118 () {58 vars in 1228 bytes} [Thu Jul 14 15:45:33 2022] DELETE /identity/v3/users/6acf6959971842aa8d709f8c91e9f5c7 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:45:33.379296 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7218e5-7970-4fd7-bcf5-2a0d5aad1bb3 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:45:33.379775 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7218e5-7970-4fd7-bcf5-2a0d5aad1bb3 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:45:33.379906 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7218e5-7970-4fd7-bcf5-2a0d5aad1bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:45:33.398624 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-9a7218e5-7970-4fd7-bcf5-2a0d5aad1bb3 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:45:33.399827 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-9a7218e5-7970-4fd7-bcf5-2a0d5aad1bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:45:33.457335 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1418/2868] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:45:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:45:33.466916 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74db3364-0b83-4b1f-b9e4-e59198d6678a admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:45:33.468314 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-74db3364-0b83-4b1f-b9e4-e59198d6678a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:45:33.526675 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74db3364-0b83-4b1f-b9e4-e59198d6678a admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:45:33.530351 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25b745c-8d99-42a8-addc-4b025550dc2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b650be8114b64df0ac88441f1c50b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:45:33.530992 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25b745c-8d99-42a8-addc-4b025550dc2e service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:45:33.531272 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25b745c-8d99-42a8-addc-4b025550dc2e service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:45:33.531557 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25b745c-8d99-42a8-addc-4b025550dc2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:45:33.541185 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25b745c-8d99-42a8-addc-4b025550dc2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:45:33.542649 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25b745c-8d99-42a8-addc-4b025550dc2e service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:45:33.552124 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1451/2869] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:45:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:45:33.824999 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7218e5-7970-4fd7-bcf5-2a0d5aad1bb3 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:45:33.826574 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-9a7218e5-7970-4fd7-bcf5-2a0d5aad1bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:45:33.839862 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7218e5-7970-4fd7-bcf5-2a0d5aad1bb3 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:45:33.844783 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43380f7-0d07-4c32-97d4-c1a6e8bf523a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:45:33.845792 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43380f7-0d07-4c32-97d4-c1a6e8bf523a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:45:33.846133 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43380f7-0d07-4c32-97d4-c1a6e8bf523a admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:45:33.846444 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43380f7-0d07-4c32-97d4-c1a6e8bf523a admin admin] PATH_INFO: `/v3/projects/f2373cd9b2494ee3a01fca76da9559b1` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:45:33.847646 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43380f7-0d07-4c32-97d4-c1a6e8bf523a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2373cd9b2494ee3a01fca76da9559b1)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:45:33.849577 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43380f7-0d07-4c32-97d4-c1a6e8bf523a admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:45:33.898171 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-f43380f7-0d07-4c32-97d4-c1a6e8bf523a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2373cd9b2494ee3a01fca76da9559b1', 'request_id': 'req-f43380f7-0d07-4c32-97d4-c1a6e8bf523a'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:45:33.904154 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-f43380f7-0d07-4c32-97d4-c1a6e8bf523a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2373cd9b2494ee3a01fca76da9559b1', 'request_id': 'req-f43380f7-0d07-4c32-97d4-c1a6e8bf523a'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:45:33.909594 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-f43380f7-0d07-4c32-97d4-c1a6e8bf523a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2373cd9b2494ee3a01fca76da9559b1', 'request_id': 'req-f43380f7-0d07-4c32-97d4-c1a6e8bf523a'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:45:33.926465 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-f43380f7-0d07-4c32-97d4-c1a6e8bf523a admin admin] The token cache is being invalidate because project f2373cd9b2494ee3a01fca76da9559b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:45:33.926757 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-f43380f7-0d07-4c32-97d4-c1a6e8bf523a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:45:33.927415 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-f43380f7-0d07-4c32-97d4-c1a6e8bf523a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:45:33.928991 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1419/2870] 10.222.0.118 () {58 vars in 1237 bytes} [Thu Jul 14 15:45:33 2022] DELETE /identity/v3/projects/f2373cd9b2494ee3a01fca76da9559b1 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:45:33.934217 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d7a62f-4e6b-4678-b3e2-fd21a3590818 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:45:33.934503 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d7a62f-4e6b-4678-b3e2-fd21a3590818 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:45:33.934770 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d7a62f-4e6b-4678-b3e2-fd21a3590818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:45:33.952807 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-77d7a62f-4e6b-4678-b3e2-fd21a3590818 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:45:33.954039 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-77d7a62f-4e6b-4678-b3e2-fd21a3590818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:45:33.971270 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:45:34.014322 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1452/2871] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:45:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:45:34.021789 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbbe868-eacb-4e8d-8c53-5a474357e59c None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:45:34.022118 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbbe868-eacb-4e8d-8c53-5a474357e59c None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:45:34.022399 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbbe868-eacb-4e8d-8c53-5a474357e59c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:45:34.042610 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-8bbbe868-eacb-4e8d-8c53-5a474357e59c None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:45:34.043850 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-8bbbe868-eacb-4e8d-8c53-5a474357e59c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:45:34.052856 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1420/2872] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:45:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:45:34.056975 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d7a62f-4e6b-4678-b3e2-fd21a3590818 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:45:34.067101 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d7a62f-4e6b-4678-b3e2-fd21a3590818 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:45:34.071649 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9bd512-1b0b-446f-b1cd-aa2ec4b3fb02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:45:34.072298 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9bd512-1b0b-446f-b1cd-aa2ec4b3fb02 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:45:34.072580 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9bd512-1b0b-446f-b1cd-aa2ec4b3fb02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:45:34.072853 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9bd512-1b0b-446f-b1cd-aa2ec4b3fb02 admin admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:45:34.073581 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9bd512-1b0b-446f-b1cd-aa2ec4b3fb02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:45:34.073887 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9bd512-1b0b-446f-b1cd-aa2ec4b3fb02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:45:34.075516 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9bd512-1b0b-446f-b1cd-aa2ec4b3fb02 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:45:34.087612 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1453/2873] 10.222.0.118 () {58 vars in 1157 bytes} [Thu Jul 14 15:45:34 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:45:34.092123 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbbe868-eacb-4e8d-8c53-5a474357e59c None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:45:34.101901 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbbe868-eacb-4e8d-8c53-5a474357e59c None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:45:34.106620 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aa4a15-c5a0-4b9c-a2e5-796078ca8bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:45:34.107276 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aa4a15-c5a0-4b9c-a2e5-796078ca8bae admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:45:34.107561 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aa4a15-c5a0-4b9c-a2e5-796078ca8bae admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:45:34.107839 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aa4a15-c5a0-4b9c-a2e5-796078ca8bae admin admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:45:34.108557 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aa4a15-c5a0-4b9c-a2e5-796078ca8bae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:45:34.110508 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aa4a15-c5a0-4b9c-a2e5-796078ca8bae admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:45:34.137129 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1421/2874] 10.222.0.118 () {60 vars in 1157 bytes} [Thu Jul 14 15:45:34 2022] POST /identity/v3/projects => generated 372 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:45:34.141229 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9bd512-1b0b-446f-b1cd-aa2ec4b3fb02 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:45:34.151084 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9bd512-1b0b-446f-b1cd-aa2ec4b3fb02 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:45:34.206519 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caa2869-ebf9-461d-97c9-3e3ceb9ad90e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:45:34.207169 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caa2869-ebf9-461d-97c9-3e3ceb9ad90e admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:45:34.207443 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caa2869-ebf9-461d-97c9-3e3ceb9ad90e admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:45:34.207709 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caa2869-ebf9-461d-97c9-3e3ceb9ad90e admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:45:34.208414 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caa2869-ebf9-461d-97c9-3e3ceb9ad90e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:45:34.210361 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caa2869-ebf9-461d-97c9-3e3ceb9ad90e admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:45:34.230385 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1454/2875] 10.222.0.118 () {60 vars in 1148 bytes} [Thu Jul 14 15:45:34 2022] POST /identity/v3/users => generated 287 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:45:34.234543 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aa4a15-c5a0-4b9c-a2e5-796078ca8bae admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:45:34.245661 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aa4a15-c5a0-4b9c-a2e5-796078ca8bae admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:45:34.250336 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf7f923-b621-4f0b-b259-4a022aaf9e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:45:34.250998 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf7f923-b621-4f0b-b259-4a022aaf9e84 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:45:34.251280 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf7f923-b621-4f0b-b259-4a022aaf9e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:45:34.252083 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf7f923-b621-4f0b-b259-4a022aaf9e84 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:45:34.252818 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf7f923-b621-4f0b-b259-4a022aaf9e84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:45:34.254449 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf7f923-b621-4f0b-b259-4a022aaf9e84 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:45:34.264841 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1422/2876] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:45:34 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:45:34.268782 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caa2869-ebf9-461d-97c9-3e3ceb9ad90e admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:45:34.278952 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caa2869-ebf9-461d-97c9-3e3ceb9ad90e admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:45:34.283766 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4648aed-f458-4394-85cc-b665c85f98a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:45:34.284423 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4648aed-f458-4394-85cc-b665c85f98a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:45:34.284791 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4648aed-f458-4394-85cc-b665c85f98a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:45:34.284987 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4648aed-f458-4394-85cc-b665c85f98a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:45:34.285714 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4648aed-f458-4394-85cc-b665c85f98a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:45:34.287348 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4648aed-f458-4394-85cc-b665c85f98a8 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:45:34.297946 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1455/2877] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:45:34 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:45:34.302629 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf7f923-b621-4f0b-b259-4a022aaf9e84 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:45:34.312865 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf7f923-b621-4f0b-b259-4a022aaf9e84 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:45:34.318151 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc03bd8a-0838-426c-a533-12236a106b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:45:34.319033 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc03bd8a-0838-426c-a533-12236a106b1a admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:45:34.319310 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc03bd8a-0838-426c-a533-12236a106b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:45:34.320401 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc03bd8a-0838-426c-a533-12236a106b1a admin admin] PATH_INFO: `/v3/projects/973f296889bd4c17aa484d6b83015791/users/3cf0f231113e40888a6b9da9636262ae/roles/4abcf5e5e7cd4b53ae1828fec6550d53` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:45:34.334103 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc03bd8a-0838-426c-a533-12236a106b1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=973f296889bd4c17aa484d6b83015791, user_id=3cf0f231113e40888a6b9da9636262ae, role_id=4abcf5e5e7cd4b53ae1828fec6550d53)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:45:34.336745 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc03bd8a-0838-426c-a533-12236a106b1a admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:45:34.350000 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1423/2878] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:45:34 2022] PUT /identity/v3/projects/973f296889bd4c17aa484d6b83015791/users/3cf0f231113e40888a6b9da9636262ae/roles/4abcf5e5e7cd4b53ae1828fec6550d53 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:45:34.360019 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ccde0-f541-4f5f-8cd3-b861da9dcfb0 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:45:34.360307 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ccde0-f541-4f5f-8cd3-b861da9dcfb0 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:45:34.360582 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ccde0-f541-4f5f-8cd3-b861da9dcfb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:45:34.388415 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-259ccde0-f541-4f5f-8cd3-b861da9dcfb0 None None] MFA Rules not processed for user `3cf0f231113e40888a6b9da9636262ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:45:34.389811 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-259ccde0-f541-4f5f-8cd3-b861da9dcfb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:45:34.456141 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1456/2879] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:45:34 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:45:34.467161 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc03bd8a-0838-426c-a533-12236a106b1a admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:45:34.468940 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-cc03bd8a-0838-426c-a533-12236a106b1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:45:34.493001 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:45:34.548337 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc03bd8a-0838-426c-a533-12236a106b1a admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:45:34.552672 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7acb814-66cd-4d1f-8927-4b5b76c45d4c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea647438ea1c438987f28cbe39c3ff2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:45:34.553322 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7acb814-66cd-4d1f-8927-4b5b76c45d4c service cinder] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:45:34.553599 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7acb814-66cd-4d1f-8927-4b5b76c45d4c service cinder] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:45:34.553872 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7acb814-66cd-4d1f-8927-4b5b76c45d4c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:45:34.562161 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7acb814-66cd-4d1f-8927-4b5b76c45d4c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:45:34.563620 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7acb814-66cd-4d1f-8927-4b5b76c45d4c service cinder] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:45:34.572386 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1424/2880] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:45:34 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:45:34.595646 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259ccde0-f541-4f5f-8cd3-b861da9dcfb0 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:45:34.615612 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:45:34.658694 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259ccde0-f541-4f5f-8cd3-b861da9dcfb0 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:45:34.664109 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ff613f-b706-473e-90ea-6e2dcdaaaa54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:45:34.665000 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ff613f-b706-473e-90ea-6e2dcdaaaa54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:45:34.665271 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ff613f-b706-473e-90ea-6e2dcdaaaa54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:45:34.665540 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ff613f-b706-473e-90ea-6e2dcdaaaa54 admin admin] PATH_INFO: `/v3/users/3cf0f231113e40888a6b9da9636262ae` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:45:34.666752 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ff613f-b706-473e-90ea-6e2dcdaaaa54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cf0f231113e40888a6b9da9636262ae)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:45:34.668663 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ff613f-b706-473e-90ea-6e2dcdaaaa54 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:45:34.713192 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-99ff613f-b706-473e-90ea-6e2dcdaaaa54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cf0f231113e40888a6b9da9636262ae'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:45:34.720146 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-99ff613f-b706-473e-90ea-6e2dcdaaaa54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cf0f231113e40888a6b9da9636262ae'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:45:34.720842 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-99ff613f-b706-473e-90ea-6e2dcdaaaa54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cf0f231113e40888a6b9da9636262ae'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:45:34.721467 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-99ff613f-b706-473e-90ea-6e2dcdaaaa54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cf0f231113e40888a6b9da9636262ae'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:45:34.734368 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-99ff613f-b706-473e-90ea-6e2dcdaaaa54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cf0f231113e40888a6b9da9636262ae'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:45:34.747301 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1457/2881] 10.222.0.118 () {58 vars in 1228 bytes} [Thu Jul 14 15:45:34 2022] DELETE /identity/v3/users/3cf0f231113e40888a6b9da9636262ae => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:45:34.751733 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2342386e-add0-4c3a-bc3e-93c4967ed0af None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:45:34.752014 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2342386e-add0-4c3a-bc3e-93c4967ed0af None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:45:34.752312 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2342386e-add0-4c3a-bc3e-93c4967ed0af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:45:34.770150 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-2342386e-add0-4c3a-bc3e-93c4967ed0af None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:45:34.771416 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-2342386e-add0-4c3a-bc3e-93c4967ed0af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:45:34.827453 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1425/2882] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:45:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:45:34.837581 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ff613f-b706-473e-90ea-6e2dcdaaaa54 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:45:34.839002 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-99ff613f-b706-473e-90ea-6e2dcdaaaa54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:45:34.895788 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ff613f-b706-473e-90ea-6e2dcdaaaa54 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:45:34.899432 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0050dbb5-cd97-4308-88e1-ec542a311ed4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b650be8114b64df0ac88441f1c50b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:45:34.900068 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0050dbb5-cd97-4308-88e1-ec542a311ed4 service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:45:34.900348 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0050dbb5-cd97-4308-88e1-ec542a311ed4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:45:34.900621 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0050dbb5-cd97-4308-88e1-ec542a311ed4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:45:34.910186 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0050dbb5-cd97-4308-88e1-ec542a311ed4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:45:34.911622 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0050dbb5-cd97-4308-88e1-ec542a311ed4 service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:45:34.920978 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1458/2883] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:45:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:45:35.183567 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2342386e-add0-4c3a-bc3e-93c4967ed0af None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:45:35.185026 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-2342386e-add0-4c3a-bc3e-93c4967ed0af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:45:35.197778 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2342386e-add0-4c3a-bc3e-93c4967ed0af None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:45:35.202665 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee94ca86-f5e7-48d9-adf9-0b9a42dc6ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:45:35.203633 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee94ca86-f5e7-48d9-adf9-0b9a42dc6ba2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:45:35.203965 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee94ca86-f5e7-48d9-adf9-0b9a42dc6ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:45:35.204300 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee94ca86-f5e7-48d9-adf9-0b9a42dc6ba2 admin admin] PATH_INFO: `/v3/projects/973f296889bd4c17aa484d6b83015791` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:45:35.205694 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee94ca86-f5e7-48d9-adf9-0b9a42dc6ba2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=973f296889bd4c17aa484d6b83015791)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:45:35.208045 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee94ca86-f5e7-48d9-adf9-0b9a42dc6ba2 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:45:35.256094 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-ee94ca86-f5e7-48d9-adf9-0b9a42dc6ba2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '973f296889bd4c17aa484d6b83015791', 'request_id': 'req-ee94ca86-f5e7-48d9-adf9-0b9a42dc6ba2'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:45:35.262277 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-ee94ca86-f5e7-48d9-adf9-0b9a42dc6ba2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '973f296889bd4c17aa484d6b83015791', 'request_id': 'req-ee94ca86-f5e7-48d9-adf9-0b9a42dc6ba2'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:45:35.267545 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-ee94ca86-f5e7-48d9-adf9-0b9a42dc6ba2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '973f296889bd4c17aa484d6b83015791', 'request_id': 'req-ee94ca86-f5e7-48d9-adf9-0b9a42dc6ba2'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:45:35.279285 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-ee94ca86-f5e7-48d9-adf9-0b9a42dc6ba2 admin admin] The token cache is being invalidate because project 973f296889bd4c17aa484d6b83015791 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:45:35.279575 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-ee94ca86-f5e7-48d9-adf9-0b9a42dc6ba2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:45:35.280186 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-ee94ca86-f5e7-48d9-adf9-0b9a42dc6ba2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:45:35.281714 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1426/2884] 10.222.0.118 () {58 vars in 1237 bytes} [Thu Jul 14 15:45:35 2022] DELETE /identity/v3/projects/973f296889bd4c17aa484d6b83015791 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:45:35.287310 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b337137c-c122-4c45-aa1f-9638376237ba None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:45:35.287796 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b337137c-c122-4c45-aa1f-9638376237ba None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:45:35.287911 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b337137c-c122-4c45-aa1f-9638376237ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:45:35.305509 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-b337137c-c122-4c45-aa1f-9638376237ba None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:45:35.306743 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-b337137c-c122-4c45-aa1f-9638376237ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:45:35.340046 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:45:35.368220 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1459/2885] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:45:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:45:35.377015 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06674274-d5cc-4e48-a8f0-7162e9a0a008 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:45:35.377300 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06674274-d5cc-4e48-a8f0-7162e9a0a008 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:45:35.377596 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06674274-d5cc-4e48-a8f0-7162e9a0a008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:45:35.395519 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-06674274-d5cc-4e48-a8f0-7162e9a0a008 None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:45:35.396707 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-06674274-d5cc-4e48-a8f0-7162e9a0a008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:45:35.404465 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1427/2886] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:45:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:45:35.408573 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b337137c-c122-4c45-aa1f-9638376237ba None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:45:35.418824 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b337137c-c122-4c45-aa1f-9638376237ba None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:45:35.423302 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8308e8-630d-47a1-8324-c60eb696435c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:45:35.423947 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8308e8-630d-47a1-8324-c60eb696435c admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:45:35.424212 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8308e8-630d-47a1-8324-c60eb696435c admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:45:35.424491 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8308e8-630d-47a1-8324-c60eb696435c admin admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:45:35.425804 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8308e8-630d-47a1-8324-c60eb696435c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:45:35.426138 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8308e8-630d-47a1-8324-c60eb696435c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:45:35.427735 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8308e8-630d-47a1-8324-c60eb696435c admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:45:35.438977 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1460/2887] 10.222.0.118 () {58 vars in 1157 bytes} [Thu Jul 14 15:45:35 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:45:35.443382 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06674274-d5cc-4e48-a8f0-7162e9a0a008 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:45:35.452671 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06674274-d5cc-4e48-a8f0-7162e9a0a008 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:45:35.457940 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7954b0d4-dc00-4747-93bb-9099756dbaf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:45:35.458705 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7954b0d4-dc00-4747-93bb-9099756dbaf2 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:45:35.458902 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7954b0d4-dc00-4747-93bb-9099756dbaf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:45:35.459181 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7954b0d4-dc00-4747-93bb-9099756dbaf2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:45:35.459878 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7954b0d4-dc00-4747-93bb-9099756dbaf2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:45:35.461791 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7954b0d4-dc00-4747-93bb-9099756dbaf2 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:45:35.480883 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:45:35.490304 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1428/2888] 10.222.0.118 () {60 vars in 1157 bytes} [Thu Jul 14 15:45:35 2022] POST /identity/v3/projects => generated 400 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:45:35.494751 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8308e8-630d-47a1-8324-c60eb696435c admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:45:35.504626 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8308e8-630d-47a1-8324-c60eb696435c admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:45:35.563631 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ccaa1c-ac23-40f6-8695-96325e1047ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:45:35.564255 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ccaa1c-ac23-40f6-8695-96325e1047ce admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:45:35.564538 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ccaa1c-ac23-40f6-8695-96325e1047ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:45:35.564818 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ccaa1c-ac23-40f6-8695-96325e1047ce admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:45:35.565542 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ccaa1c-ac23-40f6-8695-96325e1047ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:45:35.567504 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ccaa1c-ac23-40f6-8695-96325e1047ce admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:45:35.587811 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1461/2889] 10.222.0.118 () {60 vars in 1148 bytes} [Thu Jul 14 15:45:35 2022] POST /identity/v3/users => generated 301 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:45:35.591894 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7954b0d4-dc00-4747-93bb-9099756dbaf2 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:45:35.602762 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7954b0d4-dc00-4747-93bb-9099756dbaf2 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:45:35.607379 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeb0507-3d7b-41c6-bbde-fae5f142de03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:45:35.608042 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeb0507-3d7b-41c6-bbde-fae5f142de03 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:45:35.608326 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeb0507-3d7b-41c6-bbde-fae5f142de03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:45:35.608603 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeb0507-3d7b-41c6-bbde-fae5f142de03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:45:35.609333 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeb0507-3d7b-41c6-bbde-fae5f142de03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:45:35.610962 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeb0507-3d7b-41c6-bbde-fae5f142de03 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:45:35.622114 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1429/2890] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:45:35 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:45:35.626097 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ccaa1c-ac23-40f6-8695-96325e1047ce admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:45:35.636251 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ccaa1c-ac23-40f6-8695-96325e1047ce admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:45:35.640912 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3868430-ee1c-40ba-b156-7c6dd9b554ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:45:35.641565 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3868430-ee1c-40ba-b156-7c6dd9b554ab admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:45:35.641849 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3868430-ee1c-40ba-b156-7c6dd9b554ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:45:35.642154 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3868430-ee1c-40ba-b156-7c6dd9b554ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:45:35.642884 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3868430-ee1c-40ba-b156-7c6dd9b554ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:45:35.645006 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3868430-ee1c-40ba-b156-7c6dd9b554ab admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:45:35.654886 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1462/2891] 10.222.0.118 () {58 vars in 1126 bytes} [Thu Jul 14 15:45:35 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:45:35.658969 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeb0507-3d7b-41c6-bbde-fae5f142de03 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:45:35.669971 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeb0507-3d7b-41c6-bbde-fae5f142de03 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:45:35.674669 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016a08a9-8135-4ada-9bff-0a31f135b0a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:45:35.675585 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016a08a9-8135-4ada-9bff-0a31f135b0a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:45:35.675865 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016a08a9-8135-4ada-9bff-0a31f135b0a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:45:35.676140 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016a08a9-8135-4ada-9bff-0a31f135b0a3 admin admin] PATH_INFO: `/v3/projects/14d35cff092e4839aa4b8e6a271d0c4f/users/0368e3f99da74f7c8ec33dff06e69df7/roles/4abcf5e5e7cd4b53ae1828fec6550d53` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:45:35.691321 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016a08a9-8135-4ada-9bff-0a31f135b0a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14d35cff092e4839aa4b8e6a271d0c4f, user_id=0368e3f99da74f7c8ec33dff06e69df7, role_id=4abcf5e5e7cd4b53ae1828fec6550d53)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:45:35.693953 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016a08a9-8135-4ada-9bff-0a31f135b0a3 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:45:35.707880 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1430/2892] 10.222.0.118 () {60 vars in 1487 bytes} [Thu Jul 14 15:45:35 2022] PUT /identity/v3/projects/14d35cff092e4839aa4b8e6a271d0c4f/users/0368e3f99da74f7c8ec33dff06e69df7/roles/4abcf5e5e7cd4b53ae1828fec6550d53 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:45:35.718224 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b89364-d9bd-4248-8ba2-12f62866acf3 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:45:35.718511 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b89364-d9bd-4248-8ba2-12f62866acf3 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:45:35.718786 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b89364-d9bd-4248-8ba2-12f62866acf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:45:35.745878 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-18b89364-d9bd-4248-8ba2-12f62866acf3 None None] MFA Rules not processed for user `0368e3f99da74f7c8ec33dff06e69df7`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:45:35.747126 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-18b89364-d9bd-4248-8ba2-12f62866acf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:45:35.809785 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1463/2893] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:45:35 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:45:35.822867 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016a08a9-8135-4ada-9bff-0a31f135b0a3 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:45:35.824567 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-016a08a9-8135-4ada-9bff-0a31f135b0a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:45:35.882194 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016a08a9-8135-4ada-9bff-0a31f135b0a3 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:45:35.885828 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f86e67-8e62-4919-a797-33838fc4a0f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea647438ea1c438987f28cbe39c3ff2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:45:35.886504 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f86e67-8e62-4919-a797-33838fc4a0f5 service cinder] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:45:35.886782 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f86e67-8e62-4919-a797-33838fc4a0f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:45:35.887071 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f86e67-8e62-4919-a797-33838fc4a0f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:45:35.895927 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f86e67-8e62-4919-a797-33838fc4a0f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:45:35.897359 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f86e67-8e62-4919-a797-33838fc4a0f5 service cinder] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:45:35.906102 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1431/2894] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:45:35 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:45:40.852987 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b89364-d9bd-4248-8ba2-12f62866acf3 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:45:40.892206 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:45:40.915832 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b89364-d9bd-4248-8ba2-12f62866acf3 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:45:40.920462 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3815764-ef96-425b-a107-9e2cb2f6fd8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:45:40.921349 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3815764-ef96-425b-a107-9e2cb2f6fd8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:45:40.921629 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3815764-ef96-425b-a107-9e2cb2f6fd8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:45:40.921900 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3815764-ef96-425b-a107-9e2cb2f6fd8e admin admin] PATH_INFO: `/v3/users/0368e3f99da74f7c8ec33dff06e69df7` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:45:40.923161 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3815764-ef96-425b-a107-9e2cb2f6fd8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0368e3f99da74f7c8ec33dff06e69df7)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:45:40.925152 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3815764-ef96-425b-a107-9e2cb2f6fd8e admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:45:40.970220 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-c3815764-ef96-425b-a107-9e2cb2f6fd8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0368e3f99da74f7c8ec33dff06e69df7'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:45:40.978269 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-c3815764-ef96-425b-a107-9e2cb2f6fd8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0368e3f99da74f7c8ec33dff06e69df7'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:45:40.978880 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-c3815764-ef96-425b-a107-9e2cb2f6fd8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0368e3f99da74f7c8ec33dff06e69df7'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:45:40.979475 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-c3815764-ef96-425b-a107-9e2cb2f6fd8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0368e3f99da74f7c8ec33dff06e69df7'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:45:40.992353 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-c3815764-ef96-425b-a107-9e2cb2f6fd8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0368e3f99da74f7c8ec33dff06e69df7'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:45:41.005332 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1464/2895] 10.222.0.118 () {58 vars in 1228 bytes} [Thu Jul 14 15:45:40 2022] DELETE /identity/v3/users/0368e3f99da74f7c8ec33dff06e69df7 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:45:41.009763 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16528a74-7a8e-4a77-b352-bd01a7ebeefa None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:45:41.010269 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16528a74-7a8e-4a77-b352-bd01a7ebeefa None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:45:41.010402 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16528a74-7a8e-4a77-b352-bd01a7ebeefa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:45:41.027362 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-16528a74-7a8e-4a77-b352-bd01a7ebeefa None None] MFA Rules not processed for user `3c839799004e4bd49aeaeae2457a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:45:41.028722 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-16528a74-7a8e-4a77-b352-bd01a7ebeefa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:45:41.088729 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1432/2896] 10.222.0.118 () {58 vars in 962 bytes} [Thu Jul 14 15:45:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:45:41.098246 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3815764-ef96-425b-a107-9e2cb2f6fd8e admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:45:41.100358 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-c3815764-ef96-425b-a107-9e2cb2f6fd8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:45:41.159674 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3815764-ef96-425b-a107-9e2cb2f6fd8e admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:45:41.164113 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999cd256-81bc-4a0e-bd8d-2c451b7f6b66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b650be8114b64df0ac88441f1c50b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:45:41.164760 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999cd256-81bc-4a0e-bd8d-2c451b7f6b66 service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:45:41.165042 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999cd256-81bc-4a0e-bd8d-2c451b7f6b66 service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:45:41.165315 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999cd256-81bc-4a0e-bd8d-2c451b7f6b66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:45:41.174337 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999cd256-81bc-4a0e-bd8d-2c451b7f6b66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:45:41.175768 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999cd256-81bc-4a0e-bd8d-2c451b7f6b66 service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:45:41.186006 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1465/2897] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:45:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:45:41.450852 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16528a74-7a8e-4a77-b352-bd01a7ebeefa None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:45:41.452314 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-16528a74-7a8e-4a77-b352-bd01a7ebeefa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:45:41.465747 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16528a74-7a8e-4a77-b352-bd01a7ebeefa None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:45:41.470353 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06af856-91e3-4e6c-bdf7-e1924a60d470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:45:41.471206 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06af856-91e3-4e6c-bdf7-e1924a60d470 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:45:41.471484 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06af856-91e3-4e6c-bdf7-e1924a60d470 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:45:41.471753 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06af856-91e3-4e6c-bdf7-e1924a60d470 admin admin] PATH_INFO: `/v3/projects/14d35cff092e4839aa4b8e6a271d0c4f` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:45:41.473066 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06af856-91e3-4e6c-bdf7-e1924a60d470 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14d35cff092e4839aa4b8e6a271d0c4f)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:45:41.475716 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06af856-91e3-4e6c-bdf7-e1924a60d470 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:45:41.530301 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-b06af856-91e3-4e6c-bdf7-e1924a60d470 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14d35cff092e4839aa4b8e6a271d0c4f', 'request_id': 'req-b06af856-91e3-4e6c-bdf7-e1924a60d470'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:45:41.536857 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-b06af856-91e3-4e6c-bdf7-e1924a60d470 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14d35cff092e4839aa4b8e6a271d0c4f', 'request_id': 'req-b06af856-91e3-4e6c-bdf7-e1924a60d470'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:45:41.542248 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:45:41.543741 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-b06af856-91e3-4e6c-bdf7-e1924a60d470 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14d35cff092e4839aa4b8e6a271d0c4f', 'request_id': 'req-b06af856-91e3-4e6c-bdf7-e1924a60d470'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:45:41.557944 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-b06af856-91e3-4e6c-bdf7-e1924a60d470 admin admin] The token cache is being invalidate because project 14d35cff092e4839aa4b8e6a271d0c4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:45:41.558357 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-b06af856-91e3-4e6c-bdf7-e1924a60d470 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:45:41.558977 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-b06af856-91e3-4e6c-bdf7-e1924a60d470 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:45:41.560555 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1433/2898] 10.222.0.118 () {58 vars in 1237 bytes} [Thu Jul 14 15:45:41 2022] DELETE /identity/v3/projects/14d35cff092e4839aa4b8e6a271d0c4f => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:45:51.181600 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=63,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:45:51.554938 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=3,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:47:02.563951 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999cd256-81bc-4a0e-bd8d-2c451b7f6b66 service neutron] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:47:02.565443 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-999cd256-81bc-4a0e-bd8d-2c451b7f6b66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:47:02.577547 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999cd256-81bc-4a0e-bd8d-2c451b7f6b66 service neutron] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:47:02.627971 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8395d119-ed76-48ae-9113-b4aaeaf580c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b650be8114b64df0ac88441f1c50b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:47:02.628612 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8395d119-ed76-48ae-9113-b4aaeaf580c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:47:02.628890 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8395d119-ed76-48ae-9113-b4aaeaf580c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:47:02.629164 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8395d119-ed76-48ae-9113-b4aaeaf580c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:47:02.630982 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-8395d119-ed76-48ae-9113-b4aaeaf580c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:47:02.701266 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8395d119-ed76-48ae-9113-b4aaeaf580c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:47:02.702723 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8395d119-ed76-48ae-9113-b4aaeaf580c9 service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:47:02.713749 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1466/2899] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:47:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:47:03.887846 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06af856-91e3-4e6c-bdf7-e1924a60d470 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:47:03.889253 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-b06af856-91e3-4e6c-bdf7-e1924a60d470 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:47:03.901342 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06af856-91e3-4e6c-bdf7-e1924a60d470 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:47:03.905531 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7be72f-c56a-472f-9efd-e50bebfb3537 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b650be8114b64df0ac88441f1c50b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:47:03.906208 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7be72f-c56a-472f-9efd-e50bebfb3537 service neutron] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:47:03.906485 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7be72f-c56a-472f-9efd-e50bebfb3537 service neutron] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:47:03.906758 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7be72f-c56a-472f-9efd-e50bebfb3537 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:47:03.908462 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-7d7be72f-c56a-472f-9efd-e50bebfb3537 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:47:03.921568 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7be72f-c56a-472f-9efd-e50bebfb3537 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:47:03.923029 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7be72f-c56a-472f-9efd-e50bebfb3537 service neutron] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:47:03.933993 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1434/2900] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:47:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:47:12.709077 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=54 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:47:13.929101 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=6 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:47:16.112704 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d260cea0-23b5-4234-a912-ea731231f326 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:47:16.113342 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d260cea0-23b5-4234-a912-ea731231f326 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:47:16.113342 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d260cea0-23b5-4234-a912-ea731231f326 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:47:16.115137 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1467/2901] 10.222.0.118 () {54 vars in 926 bytes} [Thu Jul 14 15:47:16 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:47:16.121520 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74202820-8c38-42cb-9d22-c239f286b3f6 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:47:16.122587 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74202820-8c38-42cb-9d22-c239f286b3f6 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:47:16.122587 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74202820-8c38-42cb-9d22-c239f286b3f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:47:16.169773 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-74202820-8c38-42cb-9d22-c239f286b3f6 None None] MFA Rules not processed for user `b650be8114b64df0ac88441f1c50b2cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:47:16.171038 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-74202820-8c38-42cb-9d22-c239f286b3f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:47:16.177873 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1435/2902] 10.222.0.118 () {58 vars in 1023 bytes} [Thu Jul 14 15:47:16 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:47:16.190570 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d260cea0-23b5-4234-a912-ea731231f326 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:47:16.192298 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-d260cea0-23b5-4234-a912-ea731231f326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:47:16.205943 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d260cea0-23b5-4234-a912-ea731231f326 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:47:16.209619 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf60eae7-2c67-46b4-8684-bd3102c05562 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b650be8114b64df0ac88441f1c50b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:47:16.210421 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf60eae7-2c67-46b4-8684-bd3102c05562 service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:47:16.210703 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf60eae7-2c67-46b4-8684-bd3102c05562 service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:47:16.210980 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf60eae7-2c67-46b4-8684-bd3102c05562 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:47:16.218668 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf60eae7-2c67-46b4-8684-bd3102c05562 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:47:16.220098 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf60eae7-2c67-46b4-8684-bd3102c05562 service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:47:16.228412 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1468/2903] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:47:16 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:47:16.312635 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74202820-8c38-42cb-9d22-c239f286b3f6 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:47:16.321530 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74202820-8c38-42cb-9d22-c239f286b3f6 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:47:16.325606 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47ca023-de26-43cf-b3e4-3675592c5072 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b650be8114b64df0ac88441f1c50b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:47:16.326281 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47ca023-de26-43cf-b3e4-3675592c5072 service neutron] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:47:16.326582 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47ca023-de26-43cf-b3e4-3675592c5072 service neutron] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:47:16.326838 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47ca023-de26-43cf-b3e4-3675592c5072 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:47:16.328613 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-c47ca023-de26-43cf-b3e4-3675592c5072 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:47:16.342689 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47ca023-de26-43cf-b3e4-3675592c5072 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:47:16.344142 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47ca023-de26-43cf-b3e4-3675592c5072 service neutron] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:47:16.355081 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1436/2904] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:47:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:47:26.225278 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=6 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:47:26.350232 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=19 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:47:56.433384 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf60eae7-2c67-46b4-8684-bd3102c05562 service neutron] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:47:56.442745 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf60eae7-2c67-46b4-8684-bd3102c05562 service neutron] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:47:56.446505 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c153515-c985-4cb2-97ff-b68c952485cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b650be8114b64df0ac88441f1c50b2cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:47:56.447138 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c153515-c985-4cb2-97ff-b68c952485cc service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:47:56.447437 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c153515-c985-4cb2-97ff-b68c952485cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:47:56.447749 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c153515-c985-4cb2-97ff-b68c952485cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:47:56.449675 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-4c153515-c985-4cb2-97ff-b68c952485cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:47:56.460023 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c153515-c985-4cb2-97ff-b68c952485cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:47:56.461504 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c153515-c985-4cb2-97ff-b68c952485cc service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:47:56.470003 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1469/2905] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:47:56 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:48:06.466291 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=6 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:48:41.259043 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47ca023-de26-43cf-b3e4-3675592c5072 service neutron] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:48:41.261158 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-c47ca023-de26-43cf-b3e4-3675592c5072 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:48:41.350943 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47ca023-de26-43cf-b3e4-3675592c5072 service neutron] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:48:41.356687 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a1fcb3-4bb3-4aff-a1e8-0a41cecbd34d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b0f8be7e04adca6e3f218fbe3a295', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:48:41.357411 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a1fcb3-4bb3-4aff-a1e8-0a41cecbd34d service placement] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:48:41.357751 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a1fcb3-4bb3-4aff-a1e8-0a41cecbd34d service placement] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:48:41.358126 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a1fcb3-4bb3-4aff-a1e8-0a41cecbd34d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:48:41.359930 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-63a1fcb3-4bb3-4aff-a1e8-0a41cecbd34d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:48:41.372278 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a1fcb3-4bb3-4aff-a1e8-0a41cecbd34d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:48:41.373872 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a1fcb3-4bb3-4aff-a1e8-0a41cecbd34d service placement] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:48:41.384112 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1437/2906] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:48:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:48:44.388949 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c153515-c985-4cb2-97ff-b68c952485cc service neutron] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:48:44.407594 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c153515-c985-4cb2-97ff-b68c952485cc service neutron] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:48:44.414344 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830aae31-3700-499a-ac4a-0c32a88654c7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b0f8be7e04adca6e3f218fbe3a295', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:48:44.415205 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830aae31-3700-499a-ac4a-0c32a88654c7 service placement] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:48:44.415669 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830aae31-3700-499a-ac4a-0c32a88654c7 service placement] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:48:44.416117 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830aae31-3700-499a-ac4a-0c32a88654c7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:48:44.418764 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-830aae31-3700-499a-ac4a-0c32a88654c7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:48:44.434754 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830aae31-3700-499a-ac4a-0c32a88654c7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:48:44.436409 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830aae31-3700-499a-ac4a-0c32a88654c7 service placement] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:48:44.451235 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1470/2907] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:48:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:48:44.474723 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a1fcb3-4bb3-4aff-a1e8-0a41cecbd34d service placement] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:48:44.476349 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-63a1fcb3-4bb3-4aff-a1e8-0a41cecbd34d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:48:44.550517 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a1fcb3-4bb3-4aff-a1e8-0a41cecbd34d service placement] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:48:44.555180 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549c3700-cac7-44b3-99c2-a935935c94b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:48:44.556041 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549c3700-cac7-44b3-99c2-a935935c94b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:48:44.556319 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549c3700-cac7-44b3-99c2-a935935c94b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:48:44.556593 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549c3700-cac7-44b3-99c2-a935935c94b9 admin admin] PATH_INFO: `/v3/users/9f2d1efbd5fd44669581bd6a33c01cf7` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:48:44.557809 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549c3700-cac7-44b3-99c2-a935935c94b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f2d1efbd5fd44669581bd6a33c01cf7)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:48:44.559826 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549c3700-cac7-44b3-99c2-a935935c94b9 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:48:44.605823 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-549c3700-cac7-44b3-99c2-a935935c94b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f2d1efbd5fd44669581bd6a33c01cf7'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:48:44.612938 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-549c3700-cac7-44b3-99c2-a935935c94b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f2d1efbd5fd44669581bd6a33c01cf7'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:48:44.613595 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-549c3700-cac7-44b3-99c2-a935935c94b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f2d1efbd5fd44669581bd6a33c01cf7'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:48:44.614231 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-549c3700-cac7-44b3-99c2-a935935c94b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f2d1efbd5fd44669581bd6a33c01cf7'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:48:44.626662 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-549c3700-cac7-44b3-99c2-a935935c94b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f2d1efbd5fd44669581bd6a33c01cf7'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:48:44.640335 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1438/2908] 10.222.0.118 () {58 vars in 1228 bytes} [Thu Jul 14 15:48:44 2022] DELETE /identity/v3/users/9f2d1efbd5fd44669581bd6a33c01cf7 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:48:44.814420 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830aae31-3700-499a-ac4a-0c32a88654c7 service placement] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:48:44.827421 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830aae31-3700-499a-ac4a-0c32a88654c7 service placement] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:48:44.884297 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4984a8-8e85-4077-adef-c265afb11ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:48:44.885139 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4984a8-8e85-4077-adef-c265afb11ea5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:48:44.885412 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4984a8-8e85-4077-adef-c265afb11ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:48:44.885679 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4984a8-8e85-4077-adef-c265afb11ea5 admin admin] PATH_INFO: `/v3/projects/22b7c000e72845498904e740f775d18d` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:48:44.887616 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4984a8-8e85-4077-adef-c265afb11ea5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22b7c000e72845498904e740f775d18d)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:48:44.889532 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4984a8-8e85-4077-adef-c265afb11ea5 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:48:44.933618 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-7e4984a8-8e85-4077-adef-c265afb11ea5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22b7c000e72845498904e740f775d18d', 'request_id': 'req-7e4984a8-8e85-4077-adef-c265afb11ea5'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:48:44.939188 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-7e4984a8-8e85-4077-adef-c265afb11ea5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22b7c000e72845498904e740f775d18d', 'request_id': 'req-7e4984a8-8e85-4077-adef-c265afb11ea5'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:48:44.945174 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-7e4984a8-8e85-4077-adef-c265afb11ea5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22b7c000e72845498904e740f775d18d', 'request_id': 'req-7e4984a8-8e85-4077-adef-c265afb11ea5'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:48:44.958490 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-7e4984a8-8e85-4077-adef-c265afb11ea5 admin admin] The token cache is being invalidate because project 22b7c000e72845498904e740f775d18d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:48:44.958835 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-7e4984a8-8e85-4077-adef-c265afb11ea5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:48:44.959470 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-7e4984a8-8e85-4077-adef-c265afb11ea5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:48:44.961057 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1471/2909] 10.222.0.118 () {58 vars in 1237 bytes} [Thu Jul 14 15:48:44 2022] DELETE /identity/v3/projects/22b7c000e72845498904e740f775d18d => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:48:44.965395 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549c3700-cac7-44b3-99c2-a935935c94b9 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:48:44.967015 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-549c3700-cac7-44b3-99c2-a935935c94b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:48:44.980148 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549c3700-cac7-44b3-99c2-a935935c94b9 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:48:44.984841 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:48:45.039369 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acb3960-9dcf-474b-aa1b-31a6f2b91af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:48:45.040245 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acb3960-9dcf-474b-aa1b-31a6f2b91af3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:48:45.040524 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acb3960-9dcf-474b-aa1b-31a6f2b91af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:48:45.040797 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acb3960-9dcf-474b-aa1b-31a6f2b91af3 admin admin] PATH_INFO: `/v3/users/6e3d7ca5f6ce447484b64000c290ea6b` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:48:45.042066 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acb3960-9dcf-474b-aa1b-31a6f2b91af3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e3d7ca5f6ce447484b64000c290ea6b)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:48:45.043969 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acb3960-9dcf-474b-aa1b-31a6f2b91af3 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:48:45.090873 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-2acb3960-9dcf-474b-aa1b-31a6f2b91af3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e3d7ca5f6ce447484b64000c290ea6b'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:48:45.097709 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-2acb3960-9dcf-474b-aa1b-31a6f2b91af3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e3d7ca5f6ce447484b64000c290ea6b'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:48:45.098454 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-2acb3960-9dcf-474b-aa1b-31a6f2b91af3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e3d7ca5f6ce447484b64000c290ea6b'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:48:45.099195 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-2acb3960-9dcf-474b-aa1b-31a6f2b91af3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e3d7ca5f6ce447484b64000c290ea6b'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:48:45.112304 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-2acb3960-9dcf-474b-aa1b-31a6f2b91af3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e3d7ca5f6ce447484b64000c290ea6b'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:48:45.124831 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1439/2910] 10.222.0.118 () {58 vars in 1228 bytes} [Thu Jul 14 15:48:44 2022] DELETE /identity/v3/users/6e3d7ca5f6ce447484b64000c290ea6b => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:48:45.309395 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4984a8-8e85-4077-adef-c265afb11ea5 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:48:45.313807 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-7e4984a8-8e85-4077-adef-c265afb11ea5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:48:45.330709 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4984a8-8e85-4077-adef-c265afb11ea5 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:48:45.390129 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9e76e5-d52e-4992-be44-ec3c731c4cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c839799004e4bd49aeaeae2457a9c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e864e571207e4b019bbf56cc1f0bce35', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:48:45.390986 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e76e5-d52e-4992-be44-ec3c731c4cce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:48:45.391261 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e76e5-d52e-4992-be44-ec3c731c4cce admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:48:45.391560 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e76e5-d52e-4992-be44-ec3c731c4cce admin admin] PATH_INFO: `/v3/projects/9b7c221ddc3745afa9e214214cc3a6ba` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:48:45.392720 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9e76e5-d52e-4992-be44-ec3c731c4cce admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b7c221ddc3745afa9e214214cc3a6ba)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:48:45.394657 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9e76e5-d52e-4992-be44-ec3c731c4cce admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:48:45.415460 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:48:45.440563 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-9c9e76e5-d52e-4992-be44-ec3c731c4cce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b7c221ddc3745afa9e214214cc3a6ba', 'request_id': 'req-9c9e76e5-d52e-4992-be44-ec3c731c4cce'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:48:45.446181 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-9c9e76e5-d52e-4992-be44-ec3c731c4cce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b7c221ddc3745afa9e214214cc3a6ba', 'request_id': 'req-9c9e76e5-d52e-4992-be44-ec3c731c4cce'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:48:45.452785 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-9c9e76e5-d52e-4992-be44-ec3c731c4cce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b7c221ddc3745afa9e214214cc3a6ba', 'request_id': 'req-9c9e76e5-d52e-4992-be44-ec3c731c4cce'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:48:45.467258 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-9c9e76e5-d52e-4992-be44-ec3c731c4cce admin admin] The token cache is being invalidate because project 9b7c221ddc3745afa9e214214cc3a6ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:48:45.467542 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-9c9e76e5-d52e-4992-be44-ec3c731c4cce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:48:45.468152 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-9c9e76e5-d52e-4992-be44-ec3c731c4cce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:48:45.469711 dv-cinder-826510-8-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1472/2911] 10.222.0.118 () {58 vars in 1237 bytes} [Thu Jul 14 15:48:45 2022] DELETE /identity/v3/projects/9b7c221ddc3745afa9e214214cc3a6ba => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:48:55.121411 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=49,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:48:55.463620 dv-cinder-826510-8-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:49:57.694519 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acb3960-9dcf-474b-aa1b-31a6f2b91af3 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:49:57.696447 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-2acb3960-9dcf-474b-aa1b-31a6f2b91af3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:49:57.767856 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acb3960-9dcf-474b-aa1b-31a6f2b91af3 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:49:57.827010 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2438d6f3-9bbf-41a1-b5e7-830f02ae3c2a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b0f8be7e04adca6e3f218fbe3a295', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '939bf9541f4a4afe86550f749d337680', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:49:57.827662 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2438d6f3-9bbf-41a1-b5e7-830f02ae3c2a service placement] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:49:57.827961 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2438d6f3-9bbf-41a1-b5e7-830f02ae3c2a service placement] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:49:57.828233 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2438d6f3-9bbf-41a1-b5e7-830f02ae3c2a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:49:57.829986 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-2438d6f3-9bbf-41a1-b5e7-830f02ae3c2a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:49:57.841522 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2438d6f3-9bbf-41a1-b5e7-830f02ae3c2a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:49:57.843194 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2438d6f3-9bbf-41a1-b5e7-830f02ae3c2a service placement] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:49:57.853527 dv-cinder-826510-8-smb devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1440/2912] 10.222.0.118 () {60 vars in 1370 bytes} [Thu Jul 14 15:49:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:50:07.848750 dv-cinder-826510-8-smb devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=58 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}